annotate memcached_fake.t @ 1961:fe6f22da53ec default tip

Tests: tests for usage of discarded body. The client_max_body_size limit should be ignored when the request body is already discarded. In HTTP/1.x, this is done by checking the r->discard_body flag when the body is being discarded, and because r->headers_in.content_length_n is 0 when it's already discarded. This, however, does not happen with HTTP/2 and HTTP/3, and therefore "error_page 413" does not work without relaxing the limit. Further, with proxy_pass, r->headers_in.content_length_n is used to determine length of the request body, and therefore is not correct if discarding of the request body isn't yet complete. While discarding the request body, r->headers_in.content_length_n contains the rest of the body to discard (or, in case of chunked request body, the rest of the current chunk to discard). Similarly, the $content_length variable uses r->headers_in.content_length if available, and also incorrect. The $content_length variable is used when proxying with fastcgi_pass, grpc_pass, and uwsgi_pass (scgi_pass uses the value calculated based on the actual request body buffers, and therefore works correctly).
author Maxim Dounin <mdounin@mdounin.ru>
date Sat, 27 Apr 2024 18:55:50 +0300
parents 4442767118e0
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
1 #!/usr/bin/perl
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
2
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
3 # (C) Maxim Dounin
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
4
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
5 # Test for memcached backend with fake daemon.
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
6
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
7 ###############################################################################
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
8
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
9 use warnings;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
10 use strict;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
11
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
12 use Test::More;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
13 use Socket qw/ CRLF /;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
14
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
15 BEGIN { use FindBin; chdir($FindBin::Bin); }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
16
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
17 use lib 'lib';
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
18 use Test::Nginx;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
19
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
20 ###############################################################################
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
21
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
22 select STDERR; $| = 1;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
23 select STDOUT; $| = 1;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
24
128
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
25 my $t = Test::Nginx->new()->has(qw/http rewrite memcached ssi/)->plan(3)
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
26 ->write_file_expand('nginx.conf', <<'EOF');
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
27
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
28 %%TEST_GLOBALS%%
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
29
249
6a0d934950bc Tests: remove extra spaces in "daemon off".
Maxim Dounin <mdounin@mdounin.ru>
parents: 166
diff changeset
30 daemon off;
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
31
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
32 events {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
33 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
34
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
35 http {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
36 %%TEST_GLOBALS_HTTP%%
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
37
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
38 server {
974
882267679006 Tests: simplified parallel modifications in tests.
Andrey Zelenkov <zelenkov@nginx.com>
parents: 952
diff changeset
39 listen 127.0.0.1:8080;
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
40 server_name localhost;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
41
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
42 location / {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
43 set $memcached_key $uri;
974
882267679006 Tests: simplified parallel modifications in tests.
Andrey Zelenkov <zelenkov@nginx.com>
parents: 952
diff changeset
44 memcached_pass 127.0.0.1:8081;
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
45 }
128
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
46
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
47 location /ssi {
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
48 default_type text/html;
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
49 ssi on;
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
50 }
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
51 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
52 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
53
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
54 EOF
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
55
1293
4442767118e0 Tests: wrap long line.
Sergey Kandaurov <pluknet@nginx.com>
parents: 1009
diff changeset
56 $t->write_file('ssi.html',
4442767118e0 Tests: wrap long line.
Sergey Kandaurov <pluknet@nginx.com>
parents: 1009
diff changeset
57 '<!--#include virtual="/" set="blah" -->' .
4442767118e0 Tests: wrap long line.
Sergey Kandaurov <pluknet@nginx.com>
parents: 1009
diff changeset
58 'blah: <!--#echo var="blah" -->');
4442767118e0 Tests: wrap long line.
Sergey Kandaurov <pluknet@nginx.com>
parents: 1009
diff changeset
59
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
60 $t->run_daemon(\&memcached_fake_daemon);
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
61 $t->run();
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
62
974
882267679006 Tests: simplified parallel modifications in tests.
Andrey Zelenkov <zelenkov@nginx.com>
parents: 952
diff changeset
63 $t->waitforsocket('127.0.0.1:' . port(8081))
267
9cd1a8dd47fc Tests: eliminate race in memcached_fake.t startup.
Valentin Bartenev <vbart@nginx.com>
parents: 257
diff changeset
64 or die "Can't start fake memcached";
9cd1a8dd47fc Tests: eliminate race in memcached_fake.t startup.
Valentin Bartenev <vbart@nginx.com>
parents: 257
diff changeset
65
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
66 ###############################################################################
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
67
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
68 like(http_get('/'), qr/SEE-THIS/, 'memcached split trailer');
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
69
128
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
70 like(http_get('/ssi.html'), qr/SEE-THIS/, 'memcached ssi var');
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
71
1009
9f576b8bb4c8 Tests: use consistent naming for no errors tests.
Sergey Kandaurov <pluknet@nginx.com>
parents: 974
diff changeset
72 like(`grep -F '[error]' ${\($t->testdir())}/error.log`, qr/^$/s, 'no errors');
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
73
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
74 ###############################################################################
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
75
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
76 sub memcached_fake_daemon {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
77 my $server = IO::Socket::INET->new(
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
78 Proto => 'tcp',
974
882267679006 Tests: simplified parallel modifications in tests.
Andrey Zelenkov <zelenkov@nginx.com>
parents: 952
diff changeset
79 LocalAddr => '127.0.0.1:' . port(8081),
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
80 Listen => 5,
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
81 Reuse => 1
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
82 )
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
83 or die "Can't create listening socket: $!\n";
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
84
267
9cd1a8dd47fc Tests: eliminate race in memcached_fake.t startup.
Valentin Bartenev <vbart@nginx.com>
parents: 257
diff changeset
85 local $SIG{PIPE} = 'IGNORE';
9cd1a8dd47fc Tests: eliminate race in memcached_fake.t startup.
Valentin Bartenev <vbart@nginx.com>
parents: 257
diff changeset
86
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
87 while (my $client = $server->accept()) {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
88 $client->autoflush(1);
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
89
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
90 while (<$client>) {
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
91 last if (/\x0d\x0a$/);
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
92 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
93
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
94 print $client 'VALUE / 0 8' . CRLF;
128
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
95 print $client 'SEE-TH';
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
96 select(undef, undef, undef, 0.1);
25047dc6ae9b Tests: add test for memcached parsing problem as fixed in 0.6.14.
Maxim Dounin <mdounin@mdounin.ru>
parents: 127
diff changeset
97 print $client 'IS';
127
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
98 select(undef, undef, undef, 0.1);
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
99 print $client CRLF . 'EN';
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
100 select(undef, undef, undef, 0.1);
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
101 print $client 'D' . CRLF;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
102 close $client;
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
103 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
104 }
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
105
2bf0c4c80aa7 Tests: memcached split trailer test.
Maxim Dounin <mdounin@mdounin.ru>
parents:
diff changeset
106 ###############################################################################