nginx: src/os/unix/ngx_linux_sendfile

annotate src/os/unix/ngx_linux_sendfile_chain.c @ 5997:c901f2764c27

Refactored ngx_linux_sendfile_chain() even more. The code that calls sendfile() was cut into a separate function. This simplifies EINTR processing, yet is needed for the following changes that add threads support.

author	Valentin Bartenev <vbart@nginx.com>
date	Fri, 27 Feb 2015 19:19:08 +0300
parents	c50b5ed3cd4b
children	b550563ef96e

rev	line source
272 d4e65d74db9f nginx-0.0.2-2004-03-01-00:03:02 import Igor Sysoev <igor@sysoev.ru> parents: 262 diff changeset	1
d4e65d74db9f nginx-0.0.2-2004-03-01-00:03:02 import Igor Sysoev <igor@sysoev.ru> parents: 262 diff changeset	2 /*
444 42d11f017717 nginx-0.1.0-2004-09-29-20:00:49 import; remove years from copyright Igor Sysoev <igor@sysoev.ru> parents: 441 diff changeset	3 * Copyright (C) Igor Sysoev
4412 d620f497c50f Copyright updated. Maxim Konovalov <maxim@nginx.com> parents: 3063 diff changeset	4 * Copyright (C) Nginx, Inc.
272 d4e65d74db9f nginx-0.0.2-2004-03-01-00:03:02 import Igor Sysoev <igor@sysoev.ru> parents: 262 diff changeset	5 */
d4e65d74db9f nginx-0.0.2-2004-03-01-00:03:02 import Igor Sysoev <igor@sysoev.ru> parents: 262 diff changeset	6
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	7
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	8 #include <ngx_config.h>
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	9 #include <ngx_core.h>
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	10 #include <ngx_event.h>
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	11
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	12
5997 c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	13 static ssize_t ngx_linux_sendfile(ngx_connection_t c, ngx_buf_t file,
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	14 size_t size);
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	15
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	16
199 a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	17 /*
a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	18 * On Linux up to 2.4.21 sendfile() (syscall #187) works with 32-bit
479 c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	19 * offsets only, and the including <sys/sendfile.h> breaks the compiling,
c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	20 * if off_t is 64 bit wide. So we use own sendfile() definition, where offset
c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	21 * parameter is int32_t, and use sendfile() for the file parts below 2G only,
c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	22 * see src/os/unix/ngx_linux_config.h
199 a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	23 *
687 8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	24 * Linux 2.4.21 has the new sendfile64() syscall #239.
8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	25 *
8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	26 * On Linux up to 2.6.16 sendfile() does not allow to pass the count parameter
8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	27 * more than 2G-1 bytes even on 64-bit platforms: it returns EINVAL,
8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	28 * so we limit it to 2G-1 bytes.
199 a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	29 */
a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	30
5322 bdb3588681c9 Unbreak building on Linux without sendfile64() support. Valentin Bartenev <vbart@nginx.com> parents: 5320 diff changeset	31 #define NGX_SENDFILE_MAXSIZE 2147483647L
687 8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	32
199 a65b630b3a66 nginx-0.0.1-2003-11-28-11:40:40 import Igor Sysoev <igor@sysoev.ru> parents: 198 diff changeset	33
585 401de5a43ba5 nginx-0.3.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 577 diff changeset	34 ngx_chain_t *
401de5a43ba5 nginx-0.3.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 577 diff changeset	35 ngx_linux_sendfile_chain(ngx_connection_t c, ngx_chain_t in, off_t limit)
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	36 {
5918 c50b5ed3cd4b Fixed type of sendfile() return value on Linux. Valentin Bartenev <vbart@nginx.com> parents: 5917 diff changeset	37 int tcp_nodelay;
5915 ac3f78219f85 Moved the code for coalescing file buffers to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5913 diff changeset	38 off_t send, prev_send, sent;
589 d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	39 size_t file_size;
5917 2c64b69daec5 Moved writev() handling code to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5916 diff changeset	40 ssize_t n;
589 d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	41 ngx_err_t err;
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	42 ngx_buf_t *file;
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	43 ngx_event_t *wev;
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	44 ngx_chain_t *cl;
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	45 ngx_iovec_t header;
8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	46 struct iovec headers[NGX_IOVS_PREALLOCATE];
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	47
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	48 wev = c->write;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	49
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	50 if (!wev->ready) {
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	51 return in;
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	52 }
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	53
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	54
687 8e446a2daf48 workaround of 2G+ file bug in 64-bit Linux sendfile() Igor Sysoev <igor@sysoev.ru> parents: 597 diff changeset	55 /* the maximum limit size is 2G-1 - the page size */
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	56
5322 bdb3588681c9 Unbreak building on Linux without sendfile64() support. Valentin Bartenev <vbart@nginx.com> parents: 5320 diff changeset	57 if (limit == 0 \|\| limit > (off_t) (NGX_SENDFILE_MAXSIZE - ngx_pagesize)) {
bdb3588681c9 Unbreak building on Linux without sendfile64() support. Valentin Bartenev <vbart@nginx.com> parents: 5320 diff changeset	58 limit = NGX_SENDFILE_MAXSIZE - ngx_pagesize;
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	59 }
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	60
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	61
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	62 send = 0;
7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	63
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	64 header.iovs = headers;
5854 b63e829621ab Generalized definitions of the number of preallocated iovec's. Valentin Bartenev <vbart@nginx.com> parents: 5851 diff changeset	65 header.nalloc = NGX_IOVS_PREALLOCATE;
428 5e73d0ea4dab nginx-0.0.11-2004-09-16-20:10:13 import Igor Sysoev <igor@sysoev.ru> parents: 402 diff changeset	66
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	67 for ( ;; ) {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	68 prev_send = send;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	69
343 6bdf858bff8c nginx-0.0.3-2004-05-28-19:49:23 import; rename ngx_hunk_t to ngx_buf_t Igor Sysoev <igor@sysoev.ru> parents: 290 diff changeset	70 /* create the iovec and coalesce the neighbouring bufs */
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	71
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	72 cl = ngx_output_chain_to_iovec(&header, in, limit - send, c->log);
479 c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	73
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	74 if (cl == NGX_CHAIN_ERROR) {
8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	75 return NGX_CHAIN_ERROR;
8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	76 }
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	77
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	78 send += header.size;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	79
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	80 /* set TCP_CORK if there is a header before a file */
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	81
344 e366ba5db8f8 nginx-0.0.3-2004-06-01-10:04:46 import Igor Sysoev <igor@sysoev.ru> parents: 343 diff changeset	82 if (c->tcp_nopush == NGX_TCP_NOPUSH_UNSET
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	83 && header.count != 0
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	84 && cl
344 e366ba5db8f8 nginx-0.0.3-2004-06-01-10:04:46 import Igor Sysoev <igor@sysoev.ru> parents: 343 diff changeset	85 && cl->buf->in_file)
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	86 {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	87 /* the TCP_CORK and TCP_NODELAY are mutually exclusive */
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	88
483 621229427cba nginx-0.1.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 479 diff changeset	89 if (c->tcp_nodelay == NGX_TCP_NODELAY_SET) {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	90
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	91 tcp_nodelay = 0;
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	92
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	93 if (setsockopt(c->fd, IPPROTO_TCP, TCP_NODELAY,
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	94 (const void *) &tcp_nodelay, sizeof(int)) == -1)
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	95 {
5557 188481078faf Use ngx_socket_errno where appropriate. Piotr Sikora <piotr@cloudflare.com> parents: 5322 diff changeset	96 err = ngx_socket_errno;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	97
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	98 /*
479 c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	99 * there is a tiny chance to be interrupted, however,
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	100 * we continue a processing with the TCP_NODELAY
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	101 * and without the TCP_CORK
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	102 */
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	103
577 4d9ea73a627a nginx-0.3.10-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 501 diff changeset	104 if (err != NGX_EINTR) {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	105 wev->error = 1;
483 621229427cba nginx-0.1.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 479 diff changeset	106 ngx_connection_error(c, err,
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	107 "setsockopt(TCP_NODELAY) failed");
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	108 return NGX_CHAIN_ERROR;
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	109 }
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	110
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	111 } else {
483 621229427cba nginx-0.1.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 479 diff changeset	112 c->tcp_nodelay = NGX_TCP_NODELAY_UNSET;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	113
5222 23a186e8ca45 Style: remove unnecessary references to HTTP from non-HTTP modules. Piotr Sikora <piotr@cloudflare.com> parents: 4596 diff changeset	114 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	115 "no tcp_nodelay");
253 b6793bc5034b nginx-0.0.2-2004-02-09-10:46:43 import Igor Sysoev <igor@sysoev.ru> parents: 247 diff changeset	116 }
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	117 }
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	118
483 621229427cba nginx-0.1.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 479 diff changeset	119 if (c->tcp_nodelay == NGX_TCP_NODELAY_UNSET) {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	120
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	121 if (ngx_tcp_nopush(c->fd) == NGX_ERROR) {
5557 188481078faf Use ngx_socket_errno where appropriate. Piotr Sikora <piotr@cloudflare.com> parents: 5322 diff changeset	122 err = ngx_socket_errno;
253 b6793bc5034b nginx-0.0.2-2004-02-09-10:46:43 import Igor Sysoev <igor@sysoev.ru> parents: 247 diff changeset	123
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	124 /*
479 c52408583801 nginx-0.1.14-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 477 diff changeset	125 * there is a tiny chance to be interrupted, however,
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	126 * we continue a processing without the TCP_CORK
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	127 */
344 e366ba5db8f8 nginx-0.0.3-2004-06-01-10:04:46 import Igor Sysoev <igor@sysoev.ru> parents: 343 diff changeset	128
577 4d9ea73a627a nginx-0.3.10-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 501 diff changeset	129 if (err != NGX_EINTR) {
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	130 wev->error = 1;
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	131 ngx_connection_error(c, err,
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	132 ngx_tcp_nopush_n " failed");
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	133 return NGX_CHAIN_ERROR;
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	134 }
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	135
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	136 } else {
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	137 c->tcp_nopush = NGX_TCP_NOPUSH_SET;
577 4d9ea73a627a nginx-0.3.10-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 501 diff changeset	138
473 8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	139 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	140 "tcp_nopush");
8e8f3af115b5 nginx-0.1.11-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 469 diff changeset	141 }
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	142 }
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	143 }
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	144
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	145 /* get the file buf */
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	146
5913 8e903522c17a Introduced the ngx_output_chain_to_iovec() function. Valentin Bartenev <vbart@nginx.com> parents: 5912 diff changeset	147 if (header.count == 0 && cl && cl->buf->in_file && send < limit) {
344 e366ba5db8f8 nginx-0.0.3-2004-06-01-10:04:46 import Igor Sysoev <igor@sysoev.ru> parents: 343 diff changeset	148 file = cl->buf;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	149
344 e366ba5db8f8 nginx-0.0.3-2004-06-01-10:04:46 import Igor Sysoev <igor@sysoev.ru> parents: 343 diff changeset	150 /* coalesce the neighbouring file bufs */
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	151
5915 ac3f78219f85 Moved the code for coalescing file buffers to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5913 diff changeset	152 file_size = (size_t) ngx_chain_coalesce_file(&cl, limit - send);
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	153
5915 ac3f78219f85 Moved the code for coalescing file buffers to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5913 diff changeset	154 send += file_size;
589 d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	155 #if 1
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	156 if (file_size == 0) {
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	157 ngx_debug_point();
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	158 return NGX_CHAIN_ERROR;
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	159 }
d4e858a5751a nginx-0.3.16-RELEASE import Igor Sysoev <igor@sysoev.ru> parents: 585 diff changeset	160 #endif
5997 c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	161 n = ngx_linux_sendfile(c, file, file_size);
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	162
5997 c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	163 if (n == NGX_ERROR) {
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	164 return NGX_CHAIN_ERROR;
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	165 }
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	166
5997 c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	167 sent = (n == NGX_AGAIN) ? 0 : n;
253 b6793bc5034b nginx-0.0.2-2004-02-09-10:46:43 import Igor Sysoev <igor@sysoev.ru> parents: 247 diff changeset	168
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	169 } else {
5917 2c64b69daec5 Moved writev() handling code to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5916 diff changeset	170 n = ngx_writev(c, &header);
253 b6793bc5034b nginx-0.0.2-2004-02-09-10:46:43 import Igor Sysoev <igor@sysoev.ru> parents: 247 diff changeset	171
5917 2c64b69daec5 Moved writev() handling code to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5916 diff changeset	172 if (n == NGX_ERROR) {
2c64b69daec5 Moved writev() handling code to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5916 diff changeset	173 return NGX_CHAIN_ERROR;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	174 }
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	175
5917 2c64b69daec5 Moved writev() handling code to a separate function. Valentin Bartenev <vbart@nginx.com> parents: 5916 diff changeset	176 sent = (n == NGX_AGAIN) ? 0 : n;
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	177 }
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	178
195 8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	179 c->sent += sent;
8dee38ea9117 nginx-0.0.1-2003-11-25-23:44:56 import Igor Sysoev <igor@sysoev.ru> parents: 97 diff changeset	180
5912 de68ed551bfb Renamed ngx_handle_sent_chain() to ngx_chain_update_sent(). Valentin Bartenev <vbart@nginx.com> parents: 5868 diff changeset	181 in = ngx_chain_update_sent(in, sent);
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	182
5851 150df089fe47 Removed the "complete" variable from various send chain functions. Valentin Bartenev <vbart@nginx.com> parents: 5850 diff changeset	183 if (send - prev_send != sent) {
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	184 wev->ready = 0;
5320 ad137a80919f Don't lose pointer to first nonempty buf in ngx__sendfile_chain(). Gleb Smirnoff <glebius@nginx.com>* parents: 5222 diff changeset	185 return in;
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	186 }
7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	187
5320 ad137a80919f Don't lose pointer to first nonempty buf in ngx__sendfile_chain(). Gleb Smirnoff <glebius@nginx.com>* parents: 5222 diff changeset	188 if (send >= limit \|\| in == NULL) {
ad137a80919f Don't lose pointer to first nonempty buf in ngx__sendfile_chain(). Gleb Smirnoff <glebius@nginx.com>* parents: 5222 diff changeset	189 return in;
362 7650aea1816f nginx-0.0.7-2004-06-21-19:59:32 import Igor Sysoev <igor@sysoev.ru> parents: 344 diff changeset	190 }
97 70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	191 }
70d2345a903f nginx-0.0.1-2003-05-29-17:02:09 import Igor Sysoev <igor@sysoev.ru> parents: diff changeset	192 }
5997 c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	193
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	194
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	195 static ssize_t
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	196 ngx_linux_sendfile(ngx_connection_t c, ngx_buf_t file, size_t size)
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	197 {
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	198 #if (NGX_HAVE_SENDFILE64)
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	199 off_t offset;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	200 #else
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	201 int32_t offset;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	202 #endif
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	203 ssize_t n;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	204 ngx_err_t err;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	205
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	206 #if (NGX_HAVE_SENDFILE64)
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	207 offset = file->file_pos;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	208 #else
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	209 offset = (int32_t) file->file_pos;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	210 #endif
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	211
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	212 eintr:
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	213
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	214 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	215 "sendfile: @%O %uz", file->file_pos, size);
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	216
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	217 n = sendfile(c->fd, file->file->fd, &offset, size);
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	218
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	219 if (n == -1) {
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	220 err = ngx_errno;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	221
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	222 switch (err) {
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	223 case NGX_EAGAIN:
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	224 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, err,
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	225 "sendfile() is not ready");
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	226 return NGX_AGAIN;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	227
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	228 case NGX_EINTR:
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	229 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, err,
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	230 "sendfile() was interrupted");
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	231 goto eintr;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	232
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	233 default:
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	234 c->write->error = 1;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	235 ngx_connection_error(c, err, "sendfile() failed");
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	236 return NGX_ERROR;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	237 }
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	238 }
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	239
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	240 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0, "sendfile: %z of %uz @%O",
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	241 n, size, file->file_pos);
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	242
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	243 return n;
c901f2764c27 Refactored ngx_linux_sendfile_chain() even more. Valentin Bartenev <vbart@nginx.com> parents: 5918 diff changeset	244 }

Mercurial > hg > nginx

annotate src/os/unix/ngx_linux_sendfile_chain.c @ 5997:c901f2764c27