nginx: src/event/ngx_event

annotate src/event/ngx_event_quic.c @ 8520:357b8afe915e quic

HTTP/3: request more client body bytes. Previously the request body DATA frame header was read by one byte because filters were called only when the requested number of bytes were read. Now, after 08ff2e10ae92 (1.19.2), filters are called after each read. More bytes can be read at once, which simplifies and optimizes the code. This also reduces diff with the default branch.

author	Roman Arutyunyan <arut@nginx.com>
date	Tue, 18 Aug 2020 17:23:16 +0300
parents	de7d6d943f68
children	fc89d02bdca2

rev	line source
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2 /*
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	3 * Copyright (C) Nginx, Inc.
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	4 */
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	5
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	6
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	7 #include <ngx_config.h>
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	8 #include <ngx_core.h>
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	9 #include <ngx_event.h>
8486 d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	10 #include <ngx_event_quic_transport.h>
d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	11 #include <ngx_event_quic_protection.h>
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	12
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	13
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	14 /* 0-RTT and 1-RTT data exist in the same packet number space,
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	15 * so we have 3 packet number spaces:
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	16 *
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	17 * 0 - Initial
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	18 * 1 - Handshake
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	19 * 2 - 0-RTT and 1-RTT
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	20 */
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	21 #define ngx_quic_get_send_ctx(qc, level) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	22 ((level) == ssl_encryption_initial) ? &((qc)->send_ctx[0]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	23 : (((level) == ssl_encryption_handshake) ? &((qc)->send_ctx[1]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	24 : &((qc)->send_ctx[2]))
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	25
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	26 #define NGX_QUIC_SEND_CTX_LAST (NGX_QUIC_ENCRYPTION_LAST - 1)
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	27
8314 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	28 #define NGX_QUIC_STREAMS_INC 16
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	29 #define NGX_QUIC_STREAMS_LIMIT (1ULL < 60)
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	30
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	31 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	32 * 7.4. Cryptographic Message Buffering
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	33 * Implementations MUST support buffering at least 4096 bytes of data
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	34 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	35 #define NGX_QUIC_MAX_BUFFERED 65535
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	36
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	37 #define NGX_QUIC_STREAM_GONE (void *) -1
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	38
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	39
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	40 typedef struct {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	41 ngx_rbtree_t tree;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	42 ngx_rbtree_node_t sentinel;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	43
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	44 uint64_t received;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	45 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	46 uint64_t recv_max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	47 uint64_t send_max_data;
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	48
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	49 uint64_t server_max_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	50 uint64_t server_max_streams_bidi;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	51 uint64_t server_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	52 uint64_t server_streams_bidi;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	53
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	54 uint64_t client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	55 uint64_t client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	56 uint64_t client_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	57 uint64_t client_streams_bidi;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	58 } ngx_quic_streams_t;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	59
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	60
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	61 typedef struct {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	62 size_t in_flight;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	63 size_t window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	64 size_t ssthresh;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	65 ngx_msec_t recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	66 } ngx_quic_congestion_t;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	67
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	68
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	69 /*
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	70 * 12.3. Packet Numbers
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	71 *
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	72 * Conceptually, a packet number space is the context in which a packet
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	73 * can be processed and acknowledged. Initial packets can only be sent
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	74 * with Initial packet protection keys and acknowledged in packets which
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	75 * are also Initial packets.
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	76 */
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	77 typedef struct {
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	78 ngx_quic_secret_t client_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	79 ngx_quic_secret_t server_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	80
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	81 uint64_t pnum; /* to be sent */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	82 uint64_t largest_ack; /* received from peer */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	83 uint64_t largest_pn; /* received from peer */
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	84
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	85 ngx_queue_t frames;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	86 ngx_queue_t sent;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	87 } ngx_quic_send_ctx_t;
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	88
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	89
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	90 struct ngx_quic_connection_s {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	91 ngx_str_t scid;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	92 ngx_str_t dcid;
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	93 ngx_str_t odcid;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	94 ngx_str_t token;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	95
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	96 ngx_uint_t client_tp_done;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	97 ngx_quic_tp_t tp;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	98 ngx_quic_tp_t ctp;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	99
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	100 ngx_quic_send_ctx_t send_ctx[NGX_QUIC_SEND_CTX_LAST];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	101 ngx_quic_secrets_t keys[NGX_QUIC_ENCRYPTION_LAST];
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	102 ngx_quic_secrets_t next_key;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	103 ngx_quic_frames_stream_t crypto[NGX_QUIC_ENCRYPTION_LAST];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	104
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	105 ngx_quic_conf_t *conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	106
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	107 ngx_ssl_t *ssl;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	108
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	109 ngx_event_t push;
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	110 ngx_event_t pto;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	111 ngx_event_t close;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	112 ngx_queue_t free_frames;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	113 ngx_msec_t last_cc;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	114
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	115 ngx_msec_t latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	116 ngx_msec_t avg_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	117 ngx_msec_t min_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	118 ngx_msec_t rttvar;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	119
8518 f9b1a4e52597 QUIC: changed c->quic->pto_count type to ngx_uint_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8517 diff changeset	120 ngx_uint_t pto_count;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	121
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	122 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	123 ngx_uint_t nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	124 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	125
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	126 ngx_quic_streams_t streams;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	127 ngx_quic_congestion_t congestion;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	128 size_t received;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	129
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	130 ngx_uint_t error;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	131 enum ssl_encryption_level_t error_level;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	132 ngx_uint_t error_ftype;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	133 const char *error_reason;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	134
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	135 unsigned error_app:1;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	136 unsigned send_timer_set:1;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	137 unsigned closing:1;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	138 unsigned draining:1;
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	139 unsigned key_phase:1;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	140 unsigned in_retry:1;
8397 1245e274b9ba Avoided excessive definitions for connection state. Vladimir Homutov <vl@nginx.com> parents: 8394 diff changeset	141 unsigned initialized:1;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	142 unsigned validated:1;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	143 };
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	144
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	145
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	146 typedef ngx_int_t (ngx_quic_frame_handler_pt)(ngx_connection_t c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	147 ngx_quic_frame_t frame, void data);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	148
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	149
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	150 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	151 static int ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	152 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	153 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	154 static int ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	155 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	156 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	157 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	158 static int ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	159 enum ssl_encryption_level_t level, const uint8_t *read_secret,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	160 const uint8_t *write_secret, size_t secret_len);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	161 #endif
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	162
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	163 static int ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	164 enum ssl_encryption_level_t level, const uint8_t *data, size_t len);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	165 static int ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	166 static int ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	167 enum ssl_encryption_level_t level, uint8_t alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	168
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	169
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	170 static ngx_int_t ngx_quic_new_connection(ngx_connection_t c, ngx_ssl_t ssl,
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	171 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	172 static ngx_int_t ngx_quic_new_dcid(ngx_connection_t c, ngx_str_t odcid);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	173 static ngx_int_t ngx_quic_retry(ngx_connection_t *c);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	174 static ngx_int_t ngx_quic_new_token(ngx_connection_t c, ngx_str_t token);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	175 static ngx_int_t ngx_quic_validate_token(ngx_connection_t *c,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	176 ngx_quic_header_t *pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	177 static ngx_int_t ngx_quic_init_connection(ngx_connection_t *c);
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	178 static ngx_inline size_t ngx_quic_max_udp_payload(ngx_connection_t *c);
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	179 static void ngx_quic_input_handler(ngx_event_t *rev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	180
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	181 static void ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	182 static ngx_int_t ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	183 static void ngx_quic_close_timer_handler(ngx_event_t *ev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	184 static ngx_int_t ngx_quic_close_streams(ngx_connection_t *c,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	185 ngx_quic_connection_t *qc);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	186
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	187 static ngx_int_t ngx_quic_input(ngx_connection_t c, ngx_buf_t b);
8377 2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	188 static ngx_inline u_char ngx_quic_skip_zero_padding(ngx_buf_t b);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	189 static ngx_int_t ngx_quic_retry_input(ngx_connection_t *c,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	190 ngx_quic_header_t *pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	191 static ngx_int_t ngx_quic_initial_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	192 ngx_quic_header_t *pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	193 static ngx_int_t ngx_quic_handshake_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	194 ngx_quic_header_t *pkt);
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	195 static ngx_int_t ngx_quic_early_input(ngx_connection_t *c,
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	196 ngx_quic_header_t *pkt);
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	197 static ngx_int_t ngx_quic_check_peer(ngx_quic_connection_t *qc,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	198 ngx_quic_header_t *pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	199 static ngx_int_t ngx_quic_app_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	200 ngx_quic_header_t *pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	201 static ngx_int_t ngx_quic_payload_handler(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	202 ngx_quic_header_t *pkt);
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	203 static ngx_int_t ngx_quic_send_ack(ngx_connection_t c, ngx_quic_header_t pkt);
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	204 static ngx_int_t ngx_quic_ack_delay(ngx_connection_t *c,
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	205 struct timeval *received, enum ssl_encryption_level_t level);
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	206 static ngx_int_t ngx_quic_send_cc(ngx_connection_t *c);
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	207 static ngx_int_t ngx_quic_send_new_token(ngx_connection_t *c);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	208
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	209 static ngx_int_t ngx_quic_handle_ack_frame(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	210 ngx_quic_header_t pkt, ngx_quic_ack_frame_t f);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	211 static ngx_int_t ngx_quic_handle_ack_frame_range(ngx_connection_t *c,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	212 ngx_quic_send_ctx_t *ctx, uint64_t min, uint64_t max,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	213 ngx_msec_t *send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	214 static void ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	215 enum ssl_encryption_level_t level, ngx_msec_t send_time);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	216 static ngx_inline ngx_msec_t ngx_quic_pto(ngx_connection_t *c,
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	217 ngx_quic_send_ctx_t *ctx);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	218 static void ngx_quic_handle_stream_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	219 ngx_quic_frame_t *f);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	220
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	221 static ngx_int_t ngx_quic_handle_ordered_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	222 ngx_quic_frames_stream_t fs, ngx_quic_frame_t frame,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	223 ngx_quic_frame_handler_pt handler, void *data);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	224 static ngx_int_t ngx_quic_adjust_frame_offset(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	225 ngx_quic_frame_t *f, uint64_t offset_in);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	226 static ngx_int_t ngx_quic_buffer_frame(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	227 ngx_quic_frames_stream_t stream, ngx_quic_frame_t f);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	228
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	229 static ngx_int_t ngx_quic_handle_crypto_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	230 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	231 static ngx_int_t ngx_quic_crypto_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	232 ngx_quic_frame_t frame, void data);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	233 static ngx_int_t ngx_quic_handle_stream_frame(ngx_connection_t *c,
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	234 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	235 static ngx_int_t ngx_quic_stream_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	236 ngx_quic_frame_t frame, void data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	237
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	238 static ngx_int_t ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	239 ngx_quic_max_data_frame_t *f);
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	240 static ngx_int_t ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	241 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	242 static ngx_int_t ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	243 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f);
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	244 static ngx_int_t ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	245 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	246 static ngx_int_t ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	247 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	248 static ngx_int_t ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	249 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f);
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	250 static ngx_int_t ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	251 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	252
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	253 static void ngx_quic_queue_frame(ngx_quic_connection_t *qc,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	254 ngx_quic_frame_t *frame);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	255
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	256 static ngx_int_t ngx_quic_output(ngx_connection_t *c);
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	257 static ngx_int_t ngx_quic_output_frames(ngx_connection_t *c,
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	258 ngx_quic_send_ctx_t *ctx);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	259 static void ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames);
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	260 static ngx_int_t ngx_quic_send_frames(ngx_connection_t *c,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	261 ngx_quic_send_ctx_t ctx, ngx_queue_t frames);
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	262
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	263 static void ngx_quic_set_packet_number(ngx_quic_header_t *pkt,
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	264 ngx_quic_send_ctx_t *ctx);
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	265 static void ngx_quic_pto_handler(ngx_event_t *ev);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	266 static void ngx_quic_lost_handler(ngx_event_t *ev);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	267 static ngx_int_t ngx_quic_detect_lost(ngx_connection_t *c);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	268 static ngx_int_t ngx_quic_resend_frames(ngx_connection_t *c,
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	269 ngx_quic_send_ctx_t ctx, ngx_quic_frame_t start);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	270 static void ngx_quic_push_handler(ngx_event_t *ev);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	271
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	272 static void ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	273 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	274 static ngx_quic_stream_t ngx_quic_find_stream(ngx_rbtree_t rbtree,
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	275 uint64_t id);
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	276 static ngx_quic_stream_t ngx_quic_create_client_stream(ngx_connection_t c,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	277 uint64_t id);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	278 static ngx_quic_stream_t ngx_quic_create_stream(ngx_connection_t c,
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	279 uint64_t id, size_t rcvbuf_size);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	280 static ssize_t ngx_quic_stream_recv(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	281 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	282 static ssize_t ngx_quic_stream_send(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	283 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	284 static ngx_chain_t ngx_quic_stream_send_chain(ngx_connection_t c,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	285 ngx_chain_t *in, off_t limit);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	286 static size_t ngx_quic_max_stream_frame(ngx_quic_connection_t *qc);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	287 static size_t ngx_quic_max_stream_flow(ngx_connection_t *c);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	288 static void ngx_quic_stream_cleanup_handler(void *data);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	289 static ngx_quic_frame_t ngx_quic_alloc_frame(ngx_connection_t c, size_t size);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	290 static void ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	291
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	292 static void ngx_quic_congestion_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	293 ngx_quic_frame_t *frame);
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	294 static void ngx_quic_congestion_lost(ngx_connection_t *c,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	295 ngx_quic_frame_t *frame);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	296
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	297
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	298 static SSL_QUIC_METHOD quic_method = {
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	299 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	300 ngx_quic_set_read_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	301 ngx_quic_set_write_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	302 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	303 ngx_quic_set_encryption_secrets,
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	304 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	305 ngx_quic_add_handshake_data,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	306 ngx_quic_flush_flight,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	307 ngx_quic_send_alert,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	308 };
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	309
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	310
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	311 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	312
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	313 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	314 ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	315 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	316 const uint8_t *rsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	317 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	318 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	319 ngx_quic_secrets_t *keys;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	320
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	321 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	322
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	323 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	324 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	325 "quic ngx_quic_set_read_secret() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	326 ngx_quic_hexdump(c->log, "quic read secret", rsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	327 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	328
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	329 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	330
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	331 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	332 rsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	333 &keys->client);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	334 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	335
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	336
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	337 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	338 ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	339 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	340 const uint8_t *wsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	341 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	342 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	343 ngx_quic_secrets_t *keys;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	344
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	345 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	346
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	347 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	348 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	349 "quic ngx_quic_set_write_secret() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	350 ngx_quic_hexdump(c->log, "quic write secret", wsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	351 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	352
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	353 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	354
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	355 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	356 wsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	357 &keys->server);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	358 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	359
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	360 #else
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	361
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	362 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	363 ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	364 enum ssl_encryption_level_t level, const uint8_t *rsecret,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	365 const uint8_t *wsecret, size_t secret_len)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	366 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	367 ngx_int_t rc;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	368 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	369 ngx_quic_secrets_t *keys;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	370
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	371 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	372
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	373 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	374 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	375 "quic ngx_quic_set_encryption_secrets() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	376 ngx_quic_hexdump(c->log, "quic read", rsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	377 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	378
8327 0ae50d90658a Fixed build with OpenSSL using old callbacks API. Sergey Kandaurov <pluknet@nginx.com> parents: 8326 diff changeset	379 keys = &c->quic->keys[level];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	380
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	381 rc = ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	382 rsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	383 &keys->client);
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	384 if (rc != 1) {
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	385 return rc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	386 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	387
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	388 if (level == ssl_encryption_early_data) {
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	389 return 1;
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	390 }
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	391
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	392 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	393 ngx_quic_hexdump(c->log, "quic write", wsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	394 #endif
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	395
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	396 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	397 wsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	398 &keys->server);
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	399 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	400
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	401 #endif
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	402
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	403
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	404 static int
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	405 ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	406 enum ssl_encryption_level_t level, const uint8_t *data, size_t len)
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	407 {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	408 u_char p, end;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	409 size_t client_params_len, fsize, limit;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	410 const uint8_t *client_params;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	411 ngx_quic_frame_t *frame;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	412 ngx_connection_t *c;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	413 ngx_quic_connection_t *qc;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	414 ngx_quic_frames_stream_t *fs;
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	415
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	416 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	417 qc = c->quic;
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	418
8186 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 8185 diff changeset	419 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	420 "quic ngx_quic_add_handshake_data");
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	421
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	422 if (!qc->client_tp_done) {
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	423 /*
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	424 * things to do once during handshake: check ALPN and transport
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	425 * parameters; we want to break handshake if something is wrong
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	426 * here;
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	427 */
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	428
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	429 #if defined(TLSEXT_TYPE_application_layer_protocol_negotiation)
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	430 if (qc->conf->require_alpn) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	431 unsigned int len;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	432 const unsigned char *data;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	433
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	434 SSL_get0_alpn_selected(c->ssl->connection, &data, &len);
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	435
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	436 if (len == 0) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	437 qc->error = 0x100 + SSL_AD_NO_APPLICATION_PROTOCOL;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	438 qc->error_reason = "unsupported protocol in ALPN extension";
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	439
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	440 ngx_log_error(NGX_LOG_INFO, c->log, 0,
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	441 "quic unsupported protocol in ALPN extension");
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	442 return 0;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	443 }
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	444 }
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	445 #endif
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	446
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	447 SSL_get_peer_quic_transport_params(ssl_conn, &client_params,
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	448 &client_params_len);
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	449
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	450 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	451 "quic SSL_get_peer_quic_transport_params():"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	452 " params_len %ui", client_params_len);
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	453
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	454 if (client_params_len == 0) {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	455 /* quic-tls 8.2 */
8447 97adb87f149b Get rid of hardcoded numbers used for quic handshake errors. Sergey Kandaurov <pluknet@nginx.com> parents: 8446 diff changeset	456 qc->error = NGX_QUIC_ERR_CRYPTO(SSL_AD_MISSING_EXTENSION);
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	457 qc->error_reason = "missing transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	458
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	459 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	460 "missing transport parameters");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	461 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	462 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	463
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	464 p = (u_char *) client_params;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	465 end = p + client_params_len;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	466
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	467 if (ngx_quic_parse_transport_params(p, end, &qc->ctp, c->log)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	468 != NGX_OK)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	469 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	470 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	471 qc->error_reason = "failed to process transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	472
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	473 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	474 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	475
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	476 if (qc->ctp.max_idle_timeout > 0
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	477 && qc->ctp.max_idle_timeout < qc->tp.max_idle_timeout)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	478 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	479 qc->tp.max_idle_timeout = qc->ctp.max_idle_timeout;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	480 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	481
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	482 if (qc->ctp.max_udp_payload_size < NGX_QUIC_MIN_INITIAL_SIZE
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	483 \|\| qc->ctp.max_udp_payload_size > NGX_QUIC_MAX_UDP_PAYLOAD_SIZE)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	484 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	485 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	486 qc->error_reason = "invalid maximum packet size";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	487
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	488 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	489 "quic maximum packet size is invalid");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	490 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	491 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	492
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	493 if (qc->ctp.max_udp_payload_size > ngx_quic_max_udp_payload(c)) {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	494 qc->ctp.max_udp_payload_size = ngx_quic_max_udp_payload(c);
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	495 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	496 "quic client maximum packet size truncated");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	497 }
8432 391d06a51bc0 Limited max udp payload size for outgoing packets. Vladimir Homutov <vl@nginx.com> parents: 8431 diff changeset	498
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	499 #if (NGX_QUIC_DRAFT_VERSION >= 28)
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	500 if (qc->scid.len != qc->ctp.initial_scid.len
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	501 \|\| ngx_memcmp(qc->scid.data, qc->ctp.initial_scid.data,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	502 qc->scid.len) != 0)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	503 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	504 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	505 "quic client initial_source_connection_id "
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	506 "mismatch");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	507 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	508 }
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	509 #endif
6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	510
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	511 qc->streams.server_max_streams_bidi = qc->ctp.initial_max_streams_bidi;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	512 qc->streams.server_max_streams_uni = qc->ctp.initial_max_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	513
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	514 qc->client_tp_done = 1;
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	515 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	516
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	517 /*
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	518 * we need to fit at least 1 frame into a packet, thus account head/tail;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	519 * 17 = 1 + 8x2 is max header for CRYPTO frame, with 1 byte for frame type
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	520 */
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	521 limit = qc->ctp.max_udp_payload_size - NGX_QUIC_MAX_LONG_HEADER - 17
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	522 - EVP_GCM_TLS_TAG_LEN;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	523
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	524 fs = &qc->crypto[level];
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	525
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	526 p = (u_char *) data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	527 end = (u_char *) data + len;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	528
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	529 while (p < end) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	530
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	531 fsize = ngx_min(limit, (size_t) (end - p));
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	532
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	533 frame = ngx_quic_alloc_frame(c, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	534 if (frame == NULL) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	535 return 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	536 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	537
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	538 ngx_memcpy(frame->data, p, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	539
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	540 frame->level = level;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	541 frame->type = NGX_QUIC_FT_CRYPTO;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	542 frame->u.crypto.offset = fs->sent;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	543 frame->u.crypto.length = fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	544 frame->u.crypto.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	545
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	546 fs->sent += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	547 p += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	548
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	549 ngx_sprintf(frame->info, "crypto, generated by SSL len=%ui level=%d",
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	550 fsize, level);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	551
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	552 ngx_quic_queue_frame(qc, frame);
8186 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 8185 diff changeset	553 }
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	554
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	555 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	556 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	557
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	558
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	559 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	560 ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	561 {
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	562 #if (NGX_DEBUG)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	563 ngx_connection_t *c;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	564
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	565 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	566
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	567 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	568 "quic ngx_quic_flush_flight()");
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	569 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	570 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	571 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	572
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	573
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	574 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	575 ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn, enum ssl_encryption_level_t level,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	576 uint8_t alert)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	577 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	578 ngx_connection_t *c;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	579 ngx_quic_connection_t *qc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	580
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	581 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	582
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	583 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	584 "quic ngx_quic_send_alert(), lvl=%d, alert=%d",
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	585 (int) level, (int) alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	586
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	587 qc = c->quic;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	588 if (qc == NULL) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	589 return 1;
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	590 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	591
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	592 qc->error_level = level;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	593 qc->error = NGX_QUIC_ERR_CRYPTO(alert);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	594 qc->error_reason = "TLS alert";
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	595 qc->error_app = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	596 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	597
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	598 if (ngx_quic_send_cc(c) != NGX_OK) {
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	599 return 0;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	600 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	601
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	602 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	603 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	604
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	605
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	606 void
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	607 ngx_quic_run(ngx_connection_t c, ngx_ssl_t ssl, ngx_quic_conf_t *conf)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	608 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	609 ngx_buf_t *b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	610 ngx_quic_header_t pkt;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	611
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	612 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic run");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	613
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	614 c->log->action = "QUIC initialization";
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	615
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	616 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	617
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	618 b = c->buffer;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	619
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	620 pkt.log = c->log;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	621 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	622 pkt.data = b->start;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	623 pkt.len = b->last - b->start;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	624
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	625 if (ngx_quic_new_connection(c, ssl, conf, &pkt) != NGX_OK) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	626 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	627 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	628 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	629
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	630 ngx_add_timer(c->read, c->quic->in_retry ? NGX_QUIC_RETRY_TIMEOUT
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	631 : c->quic->tp.max_idle_timeout);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	632
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	633 c->read->handler = ngx_quic_input_handler;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	634
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	635 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	636 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	637
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	638
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	639 static ngx_int_t
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	640 ngx_quic_new_connection(ngx_connection_t c, ngx_ssl_t ssl,
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	641 ngx_quic_conf_t conf, ngx_quic_header_t pkt)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	642 {
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	643 ngx_int_t rc;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	644 ngx_uint_t i;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	645 ngx_quic_tp_t *ctp;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	646 ngx_quic_secrets_t *keys;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	647 ngx_quic_send_ctx_t *ctx;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	648 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	649 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	650
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	651 if (ngx_buf_size(pkt->raw) < NGX_QUIC_MIN_INITIAL_SIZE) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	652 ngx_log_error(NGX_LOG_INFO, c->log, 0,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	653 "quic UDP datagram is too small for initial packet");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	654 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	655 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	656
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	657 rc = ngx_quic_parse_long_header(pkt);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	658 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	659 return rc;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	660 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	661
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	662 if (!ngx_quic_pkt_in(pkt->flags)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	663 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	664 "quic invalid initial packet: 0x%xd", pkt->flags);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	665 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	666 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	667
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	668 if (ngx_quic_parse_initial_header(pkt) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	669 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	670 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	671
8387 eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	672 if (pkt->dcid.len < NGX_QUIC_CID_LEN_MIN) {
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	673 /* 7.2. Negotiating Connection IDs */
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	674 ngx_log_error(NGX_LOG_INFO, c->log, 0,
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	675 "quic too short dcid in initial packet: length %i",
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	676 pkt->dcid.len);
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	677 return NGX_ERROR;
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	678 }
eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	679
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	680 c->log->action = "creating new quic connection";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	681
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	682 qc = ngx_pcalloc(c->pool, sizeof(ngx_quic_connection_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	683 if (qc == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	684 return NGX_ERROR;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	685 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	686
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	687 ngx_rbtree_init(&qc->streams.tree, &qc->streams.sentinel,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	688 ngx_quic_rbtree_insert_stream);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	689
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	690 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	691 ngx_queue_init(&qc->send_ctx[i].frames);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	692 ngx_queue_init(&qc->send_ctx[i].sent);
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	693 qc->send_ctx[i].largest_pn = (uint64_t) -1;
8512 6e1c88f82280 QUIC: changed ctx->largest_ack initial value to type maximum. Sergey Kandaurov <pluknet@nginx.com> parents: 8509 diff changeset	694 qc->send_ctx[i].largest_ack = (uint64_t) -1;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	695 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	696
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	697 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	698 ngx_queue_init(&qc->crypto[i].frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	699 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	700
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	701 ngx_queue_init(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	702
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	703 qc->avg_rtt = NGX_QUIC_INITIAL_RTT;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	704 qc->rttvar = NGX_QUIC_INITIAL_RTT / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	705 qc->min_rtt = NGX_TIMER_INFINITE;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	706
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	707 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	708 * qc->latest_rtt = 0
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	709 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	710
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	711 qc->received = pkt->raw->last - pkt->raw->start;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	712
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	713 qc->pto.log = c->log;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	714 qc->pto.data = c;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	715 qc->pto.handler = ngx_quic_pto_handler;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	716 qc->pto.cancelable = 1;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	717
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	718 qc->push.log = c->log;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	719 qc->push.data = c;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	720 qc->push.handler = ngx_quic_push_handler;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	721 qc->push.cancelable = 1;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	722
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	723 c->quic = qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	724 qc->ssl = ssl;
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	725 qc->conf = conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	726 qc->tp = conf->tp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	727
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	728 ctp = &qc->ctp;
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	729 ctp->max_udp_payload_size = ngx_quic_max_udp_payload(c);
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	730 ctp->ack_delay_exponent = NGX_QUIC_DEFAULT_ACK_DELAY_EXPONENT;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	731 ctp->max_ack_delay = NGX_QUIC_DEFAULT_MAX_ACK_DELAY;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	732
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	733 qc->streams.recv_max_data = qc->tp.initial_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	734
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	735 qc->streams.client_max_streams_uni = qc->tp.initial_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	736 qc->streams.client_max_streams_bidi = qc->tp.initial_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	737
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	738 qc->congestion.window = ngx_min(10 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	739 ngx_max(2 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	740 14720));
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	741 qc->congestion.ssthresh = NGX_MAX_SIZE_T_VALUE;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	742 qc->congestion.recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	743
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	744 if (ngx_quic_new_dcid(c, &pkt->dcid) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	745 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	746 }
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	747
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	748 #if (NGX_QUIC_DRAFT_VERSION >= 28)
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	749 qc->tp.original_dcid = c->quic->odcid;
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	750 #endif
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	751 qc->tp.initial_scid = c->quic->dcid;
6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	752
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	753 qc->scid.len = pkt->scid.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	754 qc->scid.data = ngx_pnalloc(c->pool, qc->scid.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	755 if (qc->scid.data == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	756 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	757 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	758 ngx_memcpy(qc->scid.data, pkt->scid.data, qc->scid.len);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	759
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	760 keys = &c->quic->keys[ssl_encryption_initial];
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	761
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	762 if (ngx_quic_set_initial_secret(c->pool, &keys->client, &keys->server,
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	763 &qc->odcid)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	764 != NGX_OK)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	765 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	766 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	767 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	768
8397 1245e274b9ba Avoided excessive definitions for connection state. Vladimir Homutov <vl@nginx.com> parents: 8394 diff changeset	769 qc->initialized = 1;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	770
8443 3b5fbf1bcdee Reject new QUIC connection with CONNECTION_REFUSED on shutdown. Sergey Kandaurov <pluknet@nginx.com> parents: 8442 diff changeset	771 if (ngx_terminate \|\| ngx_exiting) {
3b5fbf1bcdee Reject new QUIC connection with CONNECTION_REFUSED on shutdown. Sergey Kandaurov <pluknet@nginx.com> parents: 8442 diff changeset	772 qc->error = NGX_QUIC_ERR_CONNECTION_REFUSED;
3b5fbf1bcdee Reject new QUIC connection with CONNECTION_REFUSED on shutdown. Sergey Kandaurov <pluknet@nginx.com> parents: 8442 diff changeset	773 return NGX_ERROR;
3b5fbf1bcdee Reject new QUIC connection with CONNECTION_REFUSED on shutdown. Sergey Kandaurov <pluknet@nginx.com> parents: 8442 diff changeset	774 }
3b5fbf1bcdee Reject new QUIC connection with CONNECTION_REFUSED on shutdown. Sergey Kandaurov <pluknet@nginx.com> parents: 8442 diff changeset	775
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	776 if (pkt->token.len) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	777 rc = ngx_quic_validate_token(c, pkt);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	778
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	779 if (rc == NGX_ERROR) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	780 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic invalid token");
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	781 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	782 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	783
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	784 if (rc == NGX_DECLINED) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	785 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic expired token");
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	786 return ngx_quic_retry(c);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	787 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	788
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	789 /* NGX_OK */
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	790 qc->validated = 1;
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	791
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	792 } else if (conf->retry) {
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	793 return ngx_quic_retry(c);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	794 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	795
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	796 pkt->secret = &keys->client;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	797 pkt->level = ssl_encryption_initial;
8288 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 8286 diff changeset	798 pkt->plaintext = buf;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	799
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	800 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	801
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	802 if (ngx_quic_decrypt(pkt, NULL, &ctx->largest_pn) != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	803 qc->error = pkt->error;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	804 qc->error_reason = "failed to decrypt packet";
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	805
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	806 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	807 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	808
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	809 if (ngx_quic_init_connection(c) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	810 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	811 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	812
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	813 if (ngx_quic_payload_handler(c, pkt) != NGX_OK) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	814 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	815 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	816
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	817 /* pos is at header end, adjust by actual packet length */
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	818 pkt->raw->pos += pkt->len;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	819
8377 2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	820 (void) ngx_quic_skip_zero_padding(pkt->raw);
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	821
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	822 return ngx_quic_input(c, pkt->raw);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	823 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	824
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	825
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	826 static ngx_int_t
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	827 ngx_quic_new_dcid(ngx_connection_t c, ngx_str_t odcid)
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	828 {
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	829 uint8_t len;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	830 ngx_quic_connection_t *qc;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	831
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	832 qc = c->quic;
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	833
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	834 if (RAND_bytes(&len, sizeof(len)) != 1) {
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	835 return NGX_ERROR;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	836 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	837
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	838 len = len % 10 + 10;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	839
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	840 qc->dcid.len = len;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	841 qc->dcid.data = ngx_pnalloc(c->pool, len);
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	842 if (qc->dcid.data == NULL) {
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	843 return NGX_ERROR;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	844 }
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	845
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	846 if (RAND_bytes(qc->dcid.data, len) != 1) {
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	847 return NGX_ERROR;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	848 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	849
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	850 #ifdef NGX_QUIC_DEBUG_PACKETS
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	851 ngx_quic_hexdump(c->log, "quic server CID", qc->dcid.data, qc->dcid.len);
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	852 #endif
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	853
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	854 qc->odcid.len = odcid->len;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	855 qc->odcid.data = ngx_pstrdup(c->pool, odcid);
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	856 if (qc->odcid.data == NULL) {
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	857 return NGX_ERROR;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	858 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	859
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	860 return NGX_OK;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	861 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	862
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	863
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	864 static ngx_int_t
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	865 ngx_quic_retry(ngx_connection_t *c)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	866 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	867 ssize_t len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	868 ngx_str_t res, token;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	869 ngx_quic_header_t pkt;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	870 u_char buf[NGX_QUIC_RETRY_BUFFER_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	871
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	872 if (ngx_quic_new_token(c, &token) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	873 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	874 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	875
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	876 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	877 pkt.flags = NGX_QUIC_PKT_FIXED_BIT \| NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_RETRY;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	878 pkt.log = c->log;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	879 pkt.odcid = c->quic->odcid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	880 pkt.dcid = c->quic->scid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	881 pkt.scid = c->quic->dcid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	882 pkt.token = token;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	883
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	884 res.data = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	885
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	886 if (ngx_quic_encrypt(&pkt, NULL, &res) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	887 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	888 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	889
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	890 #ifdef NGX_QUIC_DEBUG_PACKETS
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	891 ngx_quic_hexdump(c->log, "quic packet to send", res.data, res.len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	892 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	893
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	894 len = c->send(c, res.data, res.len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	895 if (len == NGX_ERROR \|\| (size_t) len != res.len) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	896 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	897 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	898
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	899 c->quic->token = token;
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	900 #if (NGX_QUIC_DRAFT_VERSION < 28)
c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	901 c->quic->tp.original_dcid = c->quic->odcid;
c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	902 #endif
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	903 c->quic->tp.retry_scid = c->quic->dcid;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	904 c->quic->in_retry = 1;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	905
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	906 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	907 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	908
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	909
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	910 static ngx_int_t
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	911 ngx_quic_new_token(ngx_connection_t c, ngx_str_t token)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	912 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	913 int len, iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	914 u_char data, p, key, iv;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	915 ngx_msec_t now;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	916 EVP_CIPHER_CTX *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	917 const EVP_CIPHER *cipher;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	918 struct sockaddr_in *sin;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	919 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	920 struct sockaddr_in6 *sin6;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	921 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	922 u_char in[NGX_QUIC_MAX_TOKEN_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	923
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	924 switch (c->sockaddr->sa_family) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	925
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	926 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	927 case AF_INET6:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	928 sin6 = (struct sockaddr_in6 *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	929
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	930 len = sizeof(struct in6_addr);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	931 data = sin6->sin6_addr.s6_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	932
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	933 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	934 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	935
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	936 #if (NGX_HAVE_UNIX_DOMAIN)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	937 case AF_UNIX:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	938
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	939 len = ngx_min(c->addr_text.len, NGX_QUIC_MAX_TOKEN_SIZE - sizeof(now));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	940 data = c->addr_text.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	941
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	942 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	943 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	944
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	945 default: /* AF_INET */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	946 sin = (struct sockaddr_in *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	947
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	948 len = sizeof(in_addr_t);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	949 data = (u_char *) &sin->sin_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	950
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	951 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	952 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	953
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	954 p = ngx_cpymem(in, data, len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	955
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	956 now = ngx_current_msec;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	957 len += sizeof(now);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	958 ngx_memcpy(p, &now, sizeof(now));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	959
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	960 cipher = EVP_aes_256_cbc();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	961 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	962
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	963 token->len = iv_len + len + EVP_CIPHER_block_size(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	964 token->data = ngx_pnalloc(c->pool, token->len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	965 if (token->data == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	966 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	967 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	968
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	969 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	970 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	971 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	972 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	973
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	974 key = c->quic->conf->token_key;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	975 iv = token->data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	976
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	977 if (RAND_bytes(iv, iv_len) <= 0
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	978 \|\| !EVP_EncryptInit_ex(ctx, cipher, NULL, key, iv))
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	979 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	980 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	981 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	982 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	983
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	984 token->len = iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	985
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	986 if (EVP_EncryptUpdate(ctx, token->data + token->len, &len, in, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	987 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	988 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	989 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	990
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	991 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	992
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	993 if (EVP_EncryptFinal_ex(ctx, token->data + token->len, &len) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	994 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	995 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	996 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	997
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	998 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	999
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1000 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1001
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1002 #ifdef NGX_QUIC_DEBUG_PACKETS
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1003 ngx_quic_hexdump(c->log, "quic new token", token->data, token->len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1004 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1005
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1006 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1007 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1008
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1009
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1010 static ngx_int_t
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1011 ngx_quic_validate_token(ngx_connection_t c, ngx_quic_header_t pkt)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1012 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1013 int len, tlen, iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1014 u_char key, iv, p, data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1015 ngx_msec_t msec;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1016 EVP_CIPHER_CTX *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1017 const EVP_CIPHER *cipher;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1018 struct sockaddr_in *sin;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1019 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1020 struct sockaddr_in6 *sin6;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1021 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1022 ngx_quic_connection_t *qc;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1023 u_char tdec[NGX_QUIC_MAX_TOKEN_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1024
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1025 if (pkt->token.len == 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1026 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1027 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1028
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1029 qc = c->quic;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1030
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1031 /* Retry token */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1032
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1033 if (qc->token.len) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1034 if (pkt->token.len != qc->token.len) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1035 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1036 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1037
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1038 if (ngx_memcmp(pkt->token.data, qc->token.data, pkt->token.len) != 0) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1039 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1040 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1041
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1042 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1043 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1044
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1045 /* NEW_TOKEN in a previous connection */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1046
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1047 cipher = EVP_aes_256_cbc();
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	1048 key = c->quic->conf->token_key;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1049 iv = pkt->token.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1050 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1051
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1052 /* sanity checks */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1053
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1054 if (pkt->token.len < (size_t) iv_len + EVP_CIPHER_block_size(cipher)) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1055 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1056 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1057
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1058 if (pkt->token.len > (size_t) iv_len + NGX_QUIC_MAX_TOKEN_SIZE) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1059 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1060 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1061
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1062 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1063 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1064 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1065 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1066
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1067 if (!EVP_DecryptInit_ex(ctx, cipher, NULL, key, iv)) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1068 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1069 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1070 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1071
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1072 p = pkt->token.data + iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1073 len = pkt->token.len - iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1074
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1075 if (EVP_DecryptUpdate(ctx, tdec, &len, p, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1076 EVP_CIPHER_CTX_free(ctx);
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1077 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1078 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1079
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1080 if (EVP_DecryptFinal_ex(ctx, tdec + len, &tlen) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1081 EVP_CIPHER_CTX_free(ctx);
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1082 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1083 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1084
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1085 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1086
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1087 switch (c->sockaddr->sa_family) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1088
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1089 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1090 case AF_INET6:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1091 sin6 = (struct sockaddr_in6 *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1092
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1093 len = sizeof(struct in6_addr);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1094 data = sin6->sin6_addr.s6_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1095
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1096 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1097 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1098
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1099 #if (NGX_HAVE_UNIX_DOMAIN)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1100 case AF_UNIX:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1101
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1102 len = ngx_min(c->addr_text.len, NGX_QUIC_MAX_TOKEN_SIZE - sizeof(msec));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1103 data = c->addr_text.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1104
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1105 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1106 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1107
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1108 default: /* AF_INET */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1109 sin = (struct sockaddr_in *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1110
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1111 len = sizeof(in_addr_t);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1112 data = (u_char *) &sin->sin_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1113
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1114 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1115 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1116
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1117 if (ngx_memcmp(tdec, data, len) != 0) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1118 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1119 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1120
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1121 ngx_memcpy(&msec, tdec + len, sizeof(msec));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1122
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1123 if (ngx_current_msec - msec > NGX_QUIC_RETRY_LIFETIME) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1124 return NGX_DECLINED;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1125 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1126
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1127 return NGX_OK;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1128
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1129 bad_token:
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1130
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1131 qc->error = NGX_QUIC_ERR_INVALID_TOKEN;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1132 qc->error_reason = "invalid_token";
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1133
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1134 return NGX_ERROR;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1135 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1136
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1137
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1138 static ngx_int_t
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	1139 ngx_quic_init_connection(ngx_connection_t *c)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1140 {
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1141 u_char *p;
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1142 size_t clen;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1143 ssize_t len;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1144 ngx_ssl_conn_t *ssl_conn;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1145 ngx_quic_connection_t *qc;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1146
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1147 qc = c->quic;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1148
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1149 if (ngx_ssl_create_connection(qc->ssl, c, NGX_SSL_BUFFER) != NGX_OK) {
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1150 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1151 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1152
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1153 ssl_conn = c->ssl->connection;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1154
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1155 if (SSL_set_quic_method(ssl_conn, &quic_method) == 0) {
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1156 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1157 "quic SSL_set_quic_method() failed");
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1158 return NGX_ERROR;
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1159 }
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1160
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1161 #ifdef SSL_READ_EARLY_DATA_SUCCESS
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1162 if (SSL_CTX_get_max_early_data(qc->ssl->ctx)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1163 SSL_set_quic_early_data_enabled(ssl_conn, 1);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1164 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1165 #endif
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1166
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1167 len = ngx_quic_create_transport_params(NULL, NULL, &qc->tp, &clen);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1168 /* always succeeds */
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1169
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1170 p = ngx_pnalloc(c->pool, len);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1171 if (p == NULL) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1172 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1173 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1174
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1175 len = ngx_quic_create_transport_params(p, p + len, &qc->tp, NULL);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1176 if (len < 0) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1177 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1178 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1179
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1180 #ifdef NGX_QUIC_DEBUG_PACKETS
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	1181 ngx_quic_hexdump(c->log, "quic transport parameters", p, len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1182 #endif
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1183
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1184 if (SSL_set_quic_transport_params(ssl_conn, p, len) == 0) {
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1185 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1186 "quic SSL_set_quic_transport_params() failed");
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1187 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1188 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1189
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1190 #if NGX_OPENSSL_QUIC_ZRTT_CTX
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1191 if (SSL_set_quic_early_data_context(ssl_conn, p, clen) == 0) {
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1192 ngx_log_error(NGX_LOG_INFO, c->log, 0,
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1193 "quic SSL_set_quic_early_data_context() failed");
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1194 return NGX_ERROR;
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1195 }
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1196 #endif
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1197
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1198 return NGX_OK;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1199 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1200
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1201
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1202 static ngx_inline size_t
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1203 ngx_quic_max_udp_payload(ngx_connection_t *c)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1204 {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1205 /* TODO: path MTU discovery */
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1206
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1207 #if (NGX_HAVE_INET6)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1208 if (c->sockaddr->sa_family == AF_INET6) {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1209 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT6;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1210 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1211 #endif
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1212
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1213 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1214 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1215
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1216
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1217 static void
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1218 ngx_quic_input_handler(ngx_event_t *rev)
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1219 {
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1220 ssize_t n;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1221 ngx_buf_t b;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1222 ngx_connection_t *c;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1223 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1224 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1225
8394 df18ae7161b8 Assorted fixes. Sergey Kandaurov <pluknet@nginx.com> parents: 8393 diff changeset	1226 ngx_memzero(&b, sizeof(ngx_buf_t));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1227 b.start = buf;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1228 b.end = buf + sizeof(buf);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1229 b.pos = b.last = b.start;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1230 b.memory = 1;
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1231
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1232 c = rev->data;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1233 qc = c->quic;
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1234
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1235 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, rev->log, 0, "quic input handler");
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1236
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1237 if (rev->timedout) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1238 ngx_log_error(NGX_LOG_INFO, c->log, NGX_ETIMEDOUT,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1239 "quic client timed out");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1240 ngx_quic_close_connection(c, NGX_DONE);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1241 return;
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1242 }
e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1243
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1244 if (c->close) {
8442 b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1245 qc->error_reason = "graceful shutdown";
b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1246 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1247 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1248 }
8220 7ada2feeac18 Added processing of CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8218 diff changeset	1249
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1250 n = c->recv(c, b.start, b.end - b.start);
8215 38c0898b6df7 HTTP/3. Roman Arutyunyan <arut@nginx.com> parents: 8214 diff changeset	1251
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1252 if (n == NGX_AGAIN) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1253 if (qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1254 ngx_quic_close_connection(c, NGX_OK);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1255 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1256 return;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1257 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1258
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1259 if (n == NGX_ERROR) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1260 c->read->eof = 1;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1261 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1262 return;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1263 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1264
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1265 b.last += n;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1266 qc->received += n;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1267
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1268 if (ngx_quic_input(c, &b) != NGX_OK) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1269 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1270 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1271 }
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1272
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1273 qc->send_timer_set = 0;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1274 ngx_add_timer(rev, qc->tp.max_idle_timeout);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1275 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1276
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1277
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1278 static void
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1279 ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc)
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1280 {
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1281 ngx_pool_t *pool;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1282
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1283 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1284 "quic ngx_quic_close_connection, rc: %i", rc);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1285
8397 1245e274b9ba Avoided excessive definitions for connection state. Vladimir Homutov <vl@nginx.com> parents: 8394 diff changeset	1286 if (!c->quic \|\| !c->quic->initialized) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1287 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1288 "quic close connection early error");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1289
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1290 } else if (ngx_quic_close_quic(c, rc) == NGX_AGAIN) {
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1291 return;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1292 }
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1293
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1294 if (c->ssl) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1295 (void) ngx_ssl_shutdown(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1296 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1297
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1298 if (c->read->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1299 ngx_del_timer(c->read);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1300 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1301
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1302 #if (NGX_STAT_STUB)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1303 (void) ngx_atomic_fetch_add(ngx_stat_active, -1);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1304 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1305
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1306 c->destroyed = 1;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1307
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1308 pool = c->pool;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1309
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1310 ngx_close_connection(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1311
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1312 ngx_destroy_pool(pool);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1313 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1314
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1315
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1316 static ngx_int_t
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1317 ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc)
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1318 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1319 ngx_uint_t i;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1320 ngx_quic_send_ctx_t *ctx;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1321 ngx_quic_connection_t *qc;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1322
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1323 qc = c->quic;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1324
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1325 if (!qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1326
8398 8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1327 /* drop packets from retransmit queues, no ack is expected */
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1328 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1329 ctx = ngx_quic_get_send_ctx(qc, i);
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1330 ngx_quic_free_frames(c, &ctx->sent);
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1331 }
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1332
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1333 if (rc == NGX_DONE) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1334
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1335 /*
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1336 * 10.2. Idle Timeout
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1337 *
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1338 * If the idle timeout is enabled by either peer, a connection is
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1339 * silently closed and its state is discarded when it remains idle
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1340 */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1341
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1342 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1343 "quic closing %s connection",
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1344 qc->draining ? "drained" : "idle");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1345
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1346 } else {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1347
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1348 /*
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1349 * 10.3. Immediate Close
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1350 *
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1351 * An endpoint sends a CONNECTION_CLOSE frame (Section 19.19)
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1352 * to terminate the connection immediately.
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1353 */
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1354
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1355 qc->error_level = c->ssl ? SSL_quic_read_level(c->ssl->connection)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1356 : ssl_encryption_initial;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1357
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1358 if (rc == NGX_OK) {
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1359 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1360 "quic immediate close, drain = %d",
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1361 qc->draining);
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1362
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1363 qc->close.log = c->log;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1364 qc->close.data = c;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1365 qc->close.handler = ngx_quic_close_timer_handler;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1366 qc->close.cancelable = 1;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1367
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1368 ctx = ngx_quic_get_send_ctx(qc, qc->error_level);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1369
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1370 ngx_add_timer(&qc->close, 3 * ngx_quic_pto(c, ctx));
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1371
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1372 qc->error = NGX_QUIC_ERR_NO_ERROR;
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1373
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1374 } else {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1375 if (qc->error == 0 && !qc->error_app) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1376 qc->error = NGX_QUIC_ERR_INTERNAL_ERROR;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1377 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1378
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1379 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1380 "quic immediate close due to %serror: %ui %s",
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1381 qc->error_app ? "app " : "", qc->error,
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1382 qc->error_reason ? qc->error_reason : "");
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1383 }
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1384
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1385 (void) ngx_quic_send_cc(c);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1386
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1387 if (qc->error_level == ssl_encryption_handshake) {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1388 /* for clients that might not have handshake keys */
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1389 qc->error_level = ssl_encryption_initial;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1390 (void) ngx_quic_send_cc(c);
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1391 }
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1392 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1393
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1394 qc->closing = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1395 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1396
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1397 if (rc == NGX_ERROR && qc->close.timer_set) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1398 /* do not wait for timer in case of fatal error */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1399 ngx_del_timer(&qc->close);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1400 }
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1401
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1402 if (ngx_quic_close_streams(c, qc) == NGX_AGAIN) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1403 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1404 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1405
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1406 if (qc->close.timer_set) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1407 return NGX_AGAIN;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1408 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1409
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1410 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1411 ngx_quic_free_frames(c, &qc->crypto[i].frames);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1412 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1413
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1414 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1415 ngx_quic_free_frames(c, &qc->send_ctx[i].frames);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1416 ngx_quic_free_frames(c, &qc->send_ctx[i].sent);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1417 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1418
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1419 if (qc->push.timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1420 ngx_del_timer(&qc->push);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1421 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1422
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1423 if (qc->pto.timer_set) {
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1424 ngx_del_timer(&qc->pto);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1425 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1426
8434 ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1427 if (qc->push.posted) {
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1428 ngx_delete_posted_event(&qc->push);
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1429 }
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1430
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1431 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1432 "quic part of connection is terminated");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1433
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1434 /* may be tested from SSL callback during SSL shutdown */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1435 c->quic = NULL;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1436
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1437 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1438 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1439
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1440
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1441 void
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1442 ngx_quic_finalize_connection(ngx_connection_t *c, ngx_uint_t err,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1443 const char *reason)
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1444 {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1445 ngx_quic_connection_t *qc;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1446
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1447 qc = c->quic;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1448 qc->error = err;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1449 qc->error_reason = reason;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1450 qc->error_app = 1;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1451 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1452
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1453 ngx_quic_close_connection(c, NGX_ERROR);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1454 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1455
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1456
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1457 static void
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1458 ngx_quic_close_timer_handler(ngx_event_t *ev)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1459 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1460 ngx_connection_t *c;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1461
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1462 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic close timer");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1463
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1464 c = ev->data;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1465 ngx_quic_close_connection(c, NGX_DONE);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1466 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1467
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1468
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1469 static ngx_int_t
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1470 ngx_quic_close_streams(ngx_connection_t c, ngx_quic_connection_t qc)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1471 {
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1472 ngx_event_t rev, wev;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1473 ngx_rbtree_t *tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1474 ngx_rbtree_node_t *node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1475 ngx_quic_stream_t *qs;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1476
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1477 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1478 ngx_uint_t ns;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1479 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1480
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1481 tree = &qc->streams.tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1482
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1483 if (tree->root == tree->sentinel) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1484 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1485 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1486
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1487 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1488 ns = 0;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1489 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1490
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1491 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1492 node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1493 node = ngx_rbtree_next(tree, node))
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1494 {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1495 qs = (ngx_quic_stream_t *) node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1496
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1497 rev = qs->c->read;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1498 rev->error = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1499 rev->ready = 1;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1500
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1501 wev = qs->c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1502 wev->error = 1;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1503 wev->ready = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1504
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1505 ngx_post_event(rev, &ngx_posted_events);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1506
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1507 if (rev->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1508 ngx_del_timer(rev);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1509 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1510
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1511 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1512 ns++;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1513 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1514 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1515
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1516 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1517 "quic connection has %ui active streams", ns);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1518
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1519 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1520 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1521
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1522
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1523 static ngx_int_t
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1524 ngx_quic_input(ngx_connection_t c, ngx_buf_t b)
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1525 {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1526 u_char *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1527 ngx_int_t rc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1528 ngx_quic_header_t pkt;
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1529
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1530 p = b->pos;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1531
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1532 while (p < b->last) {
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1533 c->log->action = "processing quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1534
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1535 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1536 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1537 pkt.data = p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1538 pkt.len = b->last - p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1539 pkt.log = c->log;
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1540 pkt.flags = p[0];
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1541
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1542 if (c->quic->in_retry) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1543 return ngx_quic_retry_input(c, &pkt);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1544 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1545
8371 9d9531431c8c Removed outdated/incorrect comments and fixed style. Vladimir Homutov <vl@nginx.com> parents: 8370 diff changeset	1546 /* TODO: check current state */
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1547 if (ngx_quic_long_pkt(pkt.flags)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1548
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1549 if (ngx_quic_pkt_in(pkt.flags)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1550 rc = ngx_quic_initial_input(c, &pkt);
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1551
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1552 } else if (ngx_quic_pkt_hs(pkt.flags)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1553 rc = ngx_quic_handshake_input(c, &pkt);
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1554
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1555 } else if (ngx_quic_pkt_zrtt(pkt.flags)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1556 rc = ngx_quic_early_input(c, &pkt);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1557
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1558 } else {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1559 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1560 "quic unknown long packet type");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1561 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1562 }
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1563
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1564 } else {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1565 rc = ngx_quic_app_input(c, &pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1566 }
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1567
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1568 if (rc == NGX_ERROR) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1569 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1570 }
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1571
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1572 /* NGX_OK \|\| NGX_DECLINED */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1573
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1574 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1575 * we get NGX_DECLINED when there are no keys [yet] available
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1576 * to decrypt packet.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1577 * Instead of queueing it, we ignore it and rely on the sender's
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1578 * retransmission:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1579 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1580 * 12.2. Coalescing Packets:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1581 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1582 * For example, if decryption fails (because the keys are
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1583 * not available or any other reason), the receiver MAY either
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1584 * discard or buffer the packet for later processing and MUST
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1585 * attempt to process the remaining packets.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1586 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1587
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1588 /* b->pos is at header end, adjust by actual packet length */
8377 2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1589 b->pos += pkt.len;
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1590 p = ngx_quic_skip_zero_padding(b);
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1591 }
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1592
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1593 return NGX_OK;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1594 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1595
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1596
8377 2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1597 /* firefox workaround: skip zero padding at the end of quic packet */
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1598 static ngx_inline u_char *
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1599 ngx_quic_skip_zero_padding(ngx_buf_t *b)
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1600 {
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1601 while (b->pos < b->last && *(b->pos) == 0) {
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1602 b->pos++;
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1603 }
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1604
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1605 return b->pos;
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1606 }
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1607
2a94aaa70b33 Cleaned up firefox workaround. Vladimir Homutov <vl@nginx.com> parents: 8371 diff changeset	1608
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1609 static ngx_int_t
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1610 ngx_quic_retry_input(ngx_connection_t c, ngx_quic_header_t pkt)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1611 {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1612 ngx_int_t rc;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1613 ngx_quic_secrets_t *keys;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1614 ngx_quic_send_ctx_t *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1615 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1616 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1617
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1618 c->log->action = "retrying quic connection";
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1619
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1620 if (ngx_buf_size(pkt->raw) < NGX_QUIC_MIN_INITIAL_SIZE) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1621 ngx_log_error(NGX_LOG_INFO, c->log, 0,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1622 "quic UDP datagram is too small for initial packet");
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1623 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1624 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1625
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1626 rc = ngx_quic_parse_long_header(pkt);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1627 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1628 return rc;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1629 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1630
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1631 if (ngx_quic_pkt_zrtt(pkt->flags)) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1632 ngx_log_error(NGX_LOG_INFO, c->log, 0,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1633 "quic discard inflight 0-RTT packet");
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1634 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1635 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1636
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1637 if (!ngx_quic_pkt_in(pkt->flags)) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1638 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	1639 "quic invalid initial packet: 0x%xd", pkt->flags);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1640 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1641 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1642
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1643 if (ngx_quic_parse_initial_header(pkt) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1644 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1645 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1646
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1647 if (ngx_quic_new_dcid(c, &pkt->dcid) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1648 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1649 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1650
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1651 qc = c->quic;
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	1652 qc->tp.initial_scid = c->quic->dcid;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1653
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1654 keys = &c->quic->keys[ssl_encryption_initial];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1655
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1656 if (ngx_quic_set_initial_secret(c->pool, &keys->client, &keys->server,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1657 &qc->odcid)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1658 != NGX_OK)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1659 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1660 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1661 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1662
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1663 c->quic->in_retry = 0;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1664
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1665 if (ngx_quic_validate_token(c, pkt) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1666 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic invalid token");
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1667 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1668 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1669
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1670 qc->validated = 1;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1671
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1672 pkt->secret = &keys->client;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1673 pkt->level = ssl_encryption_initial;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1674 pkt->plaintext = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1675
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1676 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1677
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1678 if (ngx_quic_decrypt(pkt, NULL, &ctx->largest_pn) != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1679 qc->error = pkt->error;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1680 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1681 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1682
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1683 if (ngx_quic_init_connection(c) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1684 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1685 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1686
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1687 if (ngx_quic_payload_handler(c, pkt) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1688 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1689 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1690
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1691 /* pos is at header end, adjust by actual packet length */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1692 pkt->raw->pos += pkt->len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1693
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1694 (void) ngx_quic_skip_zero_padding(pkt->raw);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1695
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1696 return ngx_quic_input(c, pkt->raw);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1697 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1698
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1699
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1700 static ngx_int_t
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1701 ngx_quic_initial_input(ngx_connection_t c, ngx_quic_header_t pkt)
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1702 {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1703 ngx_int_t rc;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1704 ngx_ssl_conn_t *ssl_conn;
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1705 ngx_quic_secrets_t *keys;
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1706 ngx_quic_send_ctx_t *ctx;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1707 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1708
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1709 c->log->action = "processing initial quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1710
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1711 ssl_conn = c->ssl->connection;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1712
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1713 rc = ngx_quic_parse_long_header(pkt);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1714 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1715 return rc;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1716 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1717
8224 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 8223 diff changeset	1718 if (ngx_quic_parse_initial_header(pkt) != NGX_OK) {
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1719 return NGX_ERROR;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1720 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1721
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1722 keys = &c->quic->keys[ssl_encryption_initial];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1723
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1724 pkt->secret = &keys->client;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1725 pkt->level = ssl_encryption_initial;
8288 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 8286 diff changeset	1726 pkt->plaintext = buf;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1727
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1728 ctx = ngx_quic_get_send_ctx(c->quic, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1729
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1730 if (ngx_quic_decrypt(pkt, ssl_conn, &ctx->largest_pn) != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1731 c->quic->error = pkt->error;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1732 return NGX_ERROR;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1733 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1734
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1735 return ngx_quic_payload_handler(c, pkt);
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1736 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1737
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1738
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1739 static ngx_int_t
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1740 ngx_quic_handshake_input(ngx_connection_t c, ngx_quic_header_t pkt)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1741 {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1742 ngx_int_t rc;
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1743 ngx_queue_t *q;
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1744 ngx_quic_frame_t *f;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1745 ngx_quic_secrets_t *keys;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1746 ngx_quic_send_ctx_t *ctx;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1747 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1748 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1749
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1750 c->log->action = "processing handshake quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1751
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1752 qc = c->quic;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1753
8321 e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1754 keys = &c->quic->keys[ssl_encryption_handshake];
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1755
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1756 if (keys->client.key.len == 0) {
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1757 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1758 "quic no read keys yet, packet ignored");
8321 e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1759 return NGX_DECLINED;
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1760 }
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 8320 diff changeset	1761
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1762 /* extract cleartext data into pkt */
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1763 rc = ngx_quic_parse_long_header(pkt);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1764 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1765 return rc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1766 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1767
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1768 if (ngx_quic_check_peer(qc, pkt) != NGX_OK) {
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1769 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1770 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1771
8224 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 8223 diff changeset	1772 if (ngx_quic_parse_handshake_header(pkt) != NGX_OK) {
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1773 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1774 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1775
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1776 pkt->secret = &keys->client;
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1777 pkt->level = ssl_encryption_handshake;
8288 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 8286 diff changeset	1778 pkt->plaintext = buf;
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1779
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1780 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1781
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1782 if (ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn) != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1783 qc->error = pkt->error;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1784 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1785 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1786
8393 e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1787 /*
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1788 * 4.10.1. The successful use of Handshake packets indicates
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1789 * that no more Initial packets need to be exchanged
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1790 */
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1791 ctx = ngx_quic_get_send_ctx(c->quic, ssl_encryption_initial);
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1792
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1793 while (!ngx_queue_empty(&ctx->sent)) {
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1794 q = ngx_queue_head(&ctx->sent);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1795 ngx_queue_remove(q);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1796
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1797 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1798 ngx_quic_congestion_ack(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1799 ngx_quic_free_frame(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1800 }
8393 e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	1801
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1802 qc->validated = 1;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1803 qc->pto_count = 0;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1804
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1805 return ngx_quic_payload_handler(c, pkt);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1806 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1807
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1808
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1809 static ngx_int_t
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1810 ngx_quic_early_input(ngx_connection_t c, ngx_quic_header_t pkt)
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1811 {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1812 ngx_int_t rc;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1813 ngx_quic_secrets_t *keys;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1814 ngx_quic_send_ctx_t *ctx;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1815 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1816 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1817
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1818 c->log->action = "processing early data quic packet";
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1819
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1820 qc = c->quic;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1821
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1822 /* extract cleartext data into pkt */
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1823 rc = ngx_quic_parse_long_header(pkt);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1824 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1825 return rc;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1826 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1827
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1828 if (ngx_quic_check_peer(qc, pkt) != NGX_OK) {
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1829 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1830 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1831
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1832 if (ngx_quic_parse_handshake_header(pkt) != NGX_OK) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1833 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1834 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1835
8439 cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1836 keys = &c->quic->keys[ssl_encryption_early_data];
cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1837
cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1838 if (keys->client.key.len == 0) {
cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1839 ngx_log_error(NGX_LOG_INFO, c->log, 0,
cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1840 "quic no 0-RTT keys yet, packet ignored");
cef417a24755 QUIC: cleaned up quic encryption state tracking. Vladimir Homutov <vl@nginx.com> parents: 8438 diff changeset	1841 return NGX_DECLINED;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1842 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1843
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1844
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1845 pkt->secret = &keys->client;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1846 pkt->level = ssl_encryption_early_data;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1847 pkt->plaintext = buf;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1848
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1849 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1850
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1851 if (ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn) != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1852 qc->error = pkt->error;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1853 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1854 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1855
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1856 return ngx_quic_payload_handler(c, pkt);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1857 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1858
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1859
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1860 static ngx_int_t
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1861 ngx_quic_check_peer(ngx_quic_connection_t qc, ngx_quic_header_t pkt)
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1862 {
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1863 ngx_str_t *dcid;
6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1864
6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1865 dcid = ngx_quic_pkt_zrtt(pkt->flags) ? &qc->odcid : &qc->dcid;
6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1866
6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1867 if (pkt->dcid.len != dcid->len) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1868 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic dcidl");
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1869 return NGX_ERROR;
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1870 }
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1871
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1872 if (ngx_memcmp(pkt->dcid.data, dcid->data, dcid->len) != 0) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1873 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic dcid");
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1874 return NGX_ERROR;
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1875 }
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1876
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1877 if (pkt->scid.len != qc->scid.len) {
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1878 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic scidl");
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1879 return NGX_ERROR;
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1880 }
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1881
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1882 if (ngx_memcmp(pkt->scid.data, qc->scid.data, qc->scid.len) != 0) {
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1883 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic scid");
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1884 return NGX_ERROR;
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1885 }
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1886
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1887 return NGX_OK;
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1888 }
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1889
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1890
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1891 static ngx_int_t
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1892 ngx_quic_app_input(ngx_connection_t c, ngx_quic_header_t pkt)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1893 {
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1894 ngx_int_t rc;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1895 ngx_quic_secrets_t keys, next, tmp;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1896 ngx_quic_send_ctx_t *ctx;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1897 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1898 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1899
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1900 c->log->action = "processing application data quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1901
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1902 qc = c->quic;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1903
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1904 keys = &c->quic->keys[ssl_encryption_application];
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1905 next = &c->quic->next_key;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1906
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1907 if (keys->client.key.len == 0) {
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1908 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1909 "quic no read keys yet, packet ignored");
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1910 return NGX_DECLINED;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1911 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1912
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1913 rc = ngx_quic_parse_short_header(pkt, &qc->dcid);
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1914 if (rc != NGX_OK) {
81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1915 return rc;
8185 6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 8184 diff changeset	1916 }
6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 8184 diff changeset	1917
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	1918 pkt->secret = &keys->client;
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1919 pkt->next = &next->client;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1920 pkt->key_phase = c->quic->key_phase;
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1921 pkt->level = ssl_encryption_application;
8288 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 8286 diff changeset	1922 pkt->plaintext = buf;
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1923
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1924 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1925
8446 df29219988bc Discard short packets which could not be decrypted. Sergey Kandaurov <pluknet@nginx.com> parents: 8443 diff changeset	1926 rc = ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn);
df29219988bc Discard short packets which could not be decrypted. Sergey Kandaurov <pluknet@nginx.com> parents: 8443 diff changeset	1927
df29219988bc Discard short packets which could not be decrypted. Sergey Kandaurov <pluknet@nginx.com> parents: 8443 diff changeset	1928 if (rc != NGX_OK) {
8386 81f85c479d7e Discard packets without fixed bit or reserved bits set. Vladimir Homutov <vl@nginx.com> parents: 8385 diff changeset	1929 qc->error = pkt->error;
8446 df29219988bc Discard short packets which could not be decrypted. Sergey Kandaurov <pluknet@nginx.com> parents: 8443 diff changeset	1930 return rc;
8185 6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 8184 diff changeset	1931 }
6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 8184 diff changeset	1932
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	1933 ngx_gettimeofday(&pkt->received);
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	1934
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1935 /* switch keys on Key Phase change */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1936
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1937 if (pkt->key_update) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1938 c->quic->key_phase ^= 1;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1939
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1940 tmp = *keys;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1941 keys = next;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1942 *next = tmp;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1943 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1944
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1945 rc = ngx_quic_payload_handler(c, pkt);
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1946
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1947 if (rc == NGX_ERROR) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1948 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1949 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1950
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1951 /* generate next keys */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1952
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1953 if (pkt->key_update) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1954 if (ngx_quic_key_update(c, keys, next) != NGX_OK) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1955 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1956 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1957 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1958
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	1959 return rc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1960 }
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1961
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1962
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1963 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1964 ngx_quic_payload_handler(ngx_connection_t c, ngx_quic_header_t pkt)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1965 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1966 u_char end, p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1967 ssize_t len;
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1968 ngx_uint_t ack_sent, do_close;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1969 ngx_quic_frame_t frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1970 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1971
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1972 qc = c->quic;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1973
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1974 if (qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1975 /*
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1976 * 10.1 Closing and Draining Connection States
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1977 * ... delayed or reordered packets are properly discarded.
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1978 *
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1979 * An endpoint retains only enough information to generate
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1980 * a packet containing a CONNECTION_CLOSE frame and to identify
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1981 * packets as belonging to the connection.
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1982 */
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1983
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1984 qc->error_level = pkt->level;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1985 qc->error = NGX_QUIC_ERR_NO_ERROR;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1986 qc->error_reason = "connection is closing, packet discarded";
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1987 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1988 qc->error_app = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1989
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1990 return ngx_quic_send_cc(c);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1991 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1992
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1993 p = pkt->payload.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1994 end = p + pkt->payload.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1995
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1996 ack_sent = 0;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1997 do_close = 0;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1998
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1999 while (p < end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2000
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2001 c->log->action = "parsing frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2002
8240 1f002206a59b Added boundaries checks into frame parser. Vladimir Homutov <vl@nginx.com> parents: 8239 diff changeset	2003 len = ngx_quic_parse_frame(pkt, p, end, &frame);
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	2004
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2005 if (len < 0) {
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2006 qc->error = pkt->error;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2007 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2008 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2009
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2010 c->log->action = "handling frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2011
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2012 p += len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2013
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2014 switch (frame.type) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2015
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2016 case NGX_QUIC_FT_ACK:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2017 if (ngx_quic_handle_ack_frame(c, pkt, &frame.u.ack) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2018 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2019 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2020
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2021 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2022
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2023 case NGX_QUIC_FT_PADDING:
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2024 /* no action required */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2025 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2026
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2027 case NGX_QUIC_FT_CONNECTION_CLOSE:
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2028 case NGX_QUIC_FT_CONNECTION_CLOSE_APP:
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2029 do_close = 1;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2030 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2031 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2032
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2033 /* got there with ack-eliciting packet */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2034
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2035 if (!ack_sent) {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2036 if (ngx_quic_send_ack(c, pkt) != NGX_OK) {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2037 return NGX_ERROR;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2038 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2039
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2040 ack_sent = 1;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2041 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2042
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2043 switch (frame.type) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2044
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2045 case NGX_QUIC_FT_CRYPTO:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2046
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2047 if (ngx_quic_handle_crypto_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2048 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2049 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2050
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2051 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2052
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2053 case NGX_QUIC_FT_PING:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2054 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2055
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2056 case NGX_QUIC_FT_STREAM0:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2057 case NGX_QUIC_FT_STREAM1:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2058 case NGX_QUIC_FT_STREAM2:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2059 case NGX_QUIC_FT_STREAM3:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2060 case NGX_QUIC_FT_STREAM4:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2061 case NGX_QUIC_FT_STREAM5:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2062 case NGX_QUIC_FT_STREAM6:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2063 case NGX_QUIC_FT_STREAM7:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2064
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2065 if (ngx_quic_handle_stream_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2066 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2067 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2068
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2069 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2070
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2071 case NGX_QUIC_FT_MAX_DATA:
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2072
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2073 if (ngx_quic_handle_max_data_frame(c, &frame.u.max_data) != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2074 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2075 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2076 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2077
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2078 break;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2079
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2080 case NGX_QUIC_FT_STREAMS_BLOCKED:
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2081 case NGX_QUIC_FT_STREAMS_BLOCKED2:
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2082
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2083 if (ngx_quic_handle_streams_blocked_frame(c, pkt,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2084 &frame.u.streams_blocked)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2085 != NGX_OK)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2086 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2087 return NGX_ERROR;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2088 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2089
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2090 break;
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2091
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2092 case NGX_QUIC_FT_STREAM_DATA_BLOCKED:
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2093
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2094 if (ngx_quic_handle_stream_data_blocked_frame(c, pkt,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2095 &frame.u.stream_data_blocked)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2096 != NGX_OK)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2097 {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2098 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2099 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2100
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2101 break;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2102
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2103 case NGX_QUIC_FT_MAX_STREAM_DATA:
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2104
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2105 if (ngx_quic_handle_max_stream_data_frame(c, pkt,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2106 &frame.u.max_stream_data)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2107 != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2108 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2109 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2110 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2111
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2112 break;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2113
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2114 case NGX_QUIC_FT_RESET_STREAM:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2115
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2116 if (ngx_quic_handle_reset_stream_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2117 &frame.u.reset_stream)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2118 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2119 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2120 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2121 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2122
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2123 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2124
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2125 case NGX_QUIC_FT_STOP_SENDING:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2126
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2127 if (ngx_quic_handle_stop_sending_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2128 &frame.u.stop_sending)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2129 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2130 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2131 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2132 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2133
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2134 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2135
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2136 case NGX_QUIC_FT_MAX_STREAMS:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2137 case NGX_QUIC_FT_MAX_STREAMS2:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2138
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2139 if (ngx_quic_handle_max_streams_frame(c, pkt, &frame.u.max_streams)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2140 != NGX_OK)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2141 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2142 return NGX_ERROR;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2143 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2144
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2145 break;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2146
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2147 case NGX_QUIC_FT_NEW_CONNECTION_ID:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2148 case NGX_QUIC_FT_RETIRE_CONNECTION_ID:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2149 case NGX_QUIC_FT_PATH_CHALLENGE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2150 case NGX_QUIC_FT_PATH_RESPONSE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2151
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2152 /* TODO: handle */
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2153 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2154 "quic frame handler not implemented");
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2155 break;
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2156
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2157 default:
8346 4e4485793418 Added MAX_STREAM_DATA stub handler. Vladimir Homutov <vl@nginx.com> parents: 8345 diff changeset	2158 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2159 "quic missing frame handler");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2160 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2161 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2162 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2163
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2164 if (p != end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2165 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2166 "quic trailing garbage in payload: %ui bytes", end - p);
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2167
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2168 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2169 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2170 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2171
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2172 if (do_close) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2173 qc->draining = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2174 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2175 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2176
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2177 return NGX_OK;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2178 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2179
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2180
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2181 static ngx_int_t
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2182 ngx_quic_send_ack(ngx_connection_t c, ngx_quic_header_t pkt)
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2183 {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2184 ngx_quic_frame_t *frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2185
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2186 c->log->action = "generating acknowledgment";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2187
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2188 /* every ACK-eliciting packet is acknowledged, TODO ACK Ranges */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2189
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2190 frame = ngx_quic_alloc_frame(c, 0);
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2191 if (frame == NULL) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2192 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2193 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2194
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2195 frame->level = (pkt->level == ssl_encryption_early_data)
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2196 ? ssl_encryption_application
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2197 : pkt->level;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2198
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2199 frame->type = NGX_QUIC_FT_ACK;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2200 frame->u.ack.largest = pkt->pn;
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2201 frame->u.ack.delay = ngx_quic_ack_delay(c, &pkt->received, frame->level);
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2202
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2203 ngx_sprintf(frame->info, "ACK for PN=%uL from frame handler level=%d",
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2204 pkt->pn, frame->level);
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2205 ngx_quic_queue_frame(c->quic, frame);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2206
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	2207 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2208 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2209
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2210
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2211 static ngx_int_t
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2212 ngx_quic_ack_delay(ngx_connection_t c, struct timeval received,
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2213 enum ssl_encryption_level_t level)
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2214 {
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2215 ngx_int_t ack_delay;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2216 struct timeval tv;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2217
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2218 ack_delay = 0;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2219
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2220 if (level == ssl_encryption_application) {
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2221 ngx_gettimeofday(&tv);
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2222 ack_delay = (tv.tv_sec - received->tv_sec) * 1000000
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2223 + tv.tv_usec - received->tv_usec;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2224 ack_delay >>= c->quic->ctp.ack_delay_exponent;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2225 }
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2226
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2227 return ack_delay;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2228 }
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2229
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2230
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2231 static ngx_int_t
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2232 ngx_quic_send_cc(ngx_connection_t *c)
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2233 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2234 ngx_quic_frame_t *frame;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2235 ngx_quic_connection_t *qc;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2236
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2237 qc = c->quic;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2238
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2239 if (qc->draining) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2240 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2241 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2242
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2243 if (qc->closing
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2244 && ngx_current_msec - qc->last_cc < NGX_QUIC_CC_MIN_INTERVAL)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2245 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2246 /* dot not send CC too often */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2247 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2248 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2249
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2250 frame = ngx_quic_alloc_frame(c, 0);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2251 if (frame == NULL) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2252 return NGX_ERROR;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2253 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2254
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2255 frame->level = qc->error_level;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2256 frame->type = NGX_QUIC_FT_CONNECTION_CLOSE;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2257 frame->u.close.error_code = qc->error;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2258 frame->u.close.frame_type = qc->error_ftype;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2259 frame->u.close.app = qc->error_app;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2260
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2261 if (qc->error_reason) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2262 frame->u.close.reason.len = ngx_strlen(qc->error_reason);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2263 frame->u.close.reason.data = (u_char *) qc->error_reason;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2264 }
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2265
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2266 ngx_snprintf(frame->info, sizeof(frame->info) - 1,
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2267 "CONNECTION_CLOSE%s err:%ui level:%d ft:%ui reason:\"%s\"",
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2268 qc->error_app ? "_APP" : "", qc->error, qc->error_level,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2269 qc->error_ftype, qc->error_reason ? qc->error_reason : "-");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2270
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2271 ngx_quic_queue_frame(c->quic, frame);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2272
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2273 qc->last_cc = ngx_current_msec;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2274
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2275 return ngx_quic_output(c);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2276 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2277
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2278
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2279 static ngx_int_t
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2280 ngx_quic_send_new_token(ngx_connection_t *c)
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2281 {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2282 ngx_str_t token;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2283 ngx_quic_frame_t *frame;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2284
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	2285 if (!c->quic->conf->retry) {
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2286 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2287 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2288
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2289 if (ngx_quic_new_token(c, &token) != NGX_OK) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2290 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2291 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2292
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2293 frame = ngx_quic_alloc_frame(c, 0);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2294 if (frame == NULL) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2295 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2296 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2297
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2298 frame->level = ssl_encryption_application;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2299 frame->type = NGX_QUIC_FT_NEW_TOKEN;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2300 frame->u.token.length = token.len;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2301 frame->u.token.data = token.data;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2302 ngx_sprintf(frame->info, "NEW_TOKEN");
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2303 ngx_quic_queue_frame(c->quic, frame);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2304
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2305 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2306 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2307
8450 a62849b6463c Style. Vladimir Homutov <vl@nginx.com> parents: 8447 diff changeset	2308
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2309 static ngx_int_t
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2310 ngx_quic_handle_ack_frame(ngx_connection_t c, ngx_quic_header_t pkt,
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2311 ngx_quic_ack_frame_t *ack)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2312 {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2313 ssize_t n;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2314 u_char pos, end;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2315 uint64_t min, max, gap, range;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2316 ngx_msec_t send_time;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2317 ngx_uint_t i;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2318 ngx_quic_send_ctx_t *ctx;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2319 ngx_quic_connection_t *qc;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2320
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2321 qc = c->quic;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2322
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2323 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2324
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2325 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2326 "quic ngx_quic_handle_ack_frame level %d", pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2327
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2328 /*
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2329 * If any computed packet number is negative, an endpoint MUST
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2330 * generate a connection error of type FRAME_ENCODING_ERROR.
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2331 * (19.3.1)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2332 */
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2333
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2334 if (ack->first_range > ack->largest) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2335 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2336 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2337 "quic invalid first range in ack frame");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2338 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2339 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2340
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2341 min = ack->largest - ack->first_range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2342 max = ack->largest;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2343
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2344 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2345 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2346 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2347 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2348 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2349
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2350 /* 13.2.3. Receiver Tracking of ACK Frames */
8512 6e1c88f82280 QUIC: changed ctx->largest_ack initial value to type maximum. Sergey Kandaurov <pluknet@nginx.com> parents: 8509 diff changeset	2351 if (ctx->largest_ack < max \|\| ctx->largest_ack == (uint64_t) -1) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2352 ctx->largest_ack = max;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2353 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2354 "quic updated largest received ack: %uL", max);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2355
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2356 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2357 * An endpoint generates an RTT sample on receiving an
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2358 * ACK frame that meets the following two conditions:
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2359 *
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2360 * - the largest acknowledged packet number is newly acknowledged
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2361 * - at least one of the newly acknowledged packets was ack-eliciting.
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2362 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2363
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2364 if (send_time != NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2365 ngx_quic_rtt_sample(c, ack, pkt->level, send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2366 }
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2367 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2368
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2369 pos = ack->ranges_start;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2370 end = ack->ranges_end;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2371
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2372 for (i = 0; i < ack->range_count; i++) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2373
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2374 n = ngx_quic_parse_ack_range(pkt, pos, end, &gap, &range);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2375 if (n == NGX_ERROR) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2376 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2377 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2378 pos += n;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2379
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2380 if (gap + 2 > min) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2381 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2382 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2383 "quic invalid range %ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2384 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2385 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2386
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2387 max = min - gap - 2;
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2388
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2389 if (range > max) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2390 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2391 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2392 "quic invalid range %ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2393 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2394 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2395
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2396 min = max - range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2397
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2398 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2399 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2400 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2401 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2402 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2403 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2404
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	2405 return ngx_quic_detect_lost(c);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2406 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2407
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2408
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2409 static ngx_int_t
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2410 ngx_quic_handle_ack_frame_range(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2411 uint64_t min, uint64_t max, ngx_msec_t *send_time)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2412 {
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2413 uint64_t found_num;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2414 ngx_uint_t found;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2415 ngx_queue_t *q;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2416 ngx_quic_frame_t *f;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2417 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2418
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2419 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2420 "quic handle ack range: min:%uL max:%uL", min, max);
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2421
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2422 qc = c->quic;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2423
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2424 *send_time = NGX_TIMER_INFINITE;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2425 found = 0;
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2426 found_num = 0;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2427
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2428 q = ngx_queue_last(&ctx->sent);
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2429
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2430 while (q != ngx_queue_sentinel(&ctx->sent)) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2431
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2432 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2433 q = ngx_queue_prev(q);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2434
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2435 if (f->pnum >= min && f->pnum <= max) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2436 ngx_quic_congestion_ack(c, f);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2437
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2438 ngx_quic_handle_stream_ack(c, f);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2439
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2440 if (f->pnum > found_num \|\| !found) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2441 *send_time = f->last;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2442 found_num = f->pnum;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2443 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2444
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2445 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2446 ngx_quic_free_frame(c, f);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2447 found = 1;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2448 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2449 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2450
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2451 if (!found) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2452
8437 4e75267865de QUIC: fixed off-by-one in frame range handler. Vladimir Homutov <vl@nginx.com> parents: 8436 diff changeset	2453 if (max < ctx->pnum) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2454 /* duplicate ACK or ACK for non-ack-eliciting frame */
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2455 return NGX_OK;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2456 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2457
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2458 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	2459 "quic ACK for the packet not sent");
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2460
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2461 qc->error = NGX_QUIC_ERR_PROTOCOL_VIOLATION;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2462 qc->error_ftype = NGX_QUIC_FT_ACK;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2463 qc->error_reason = "unknown packet number";
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2464
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2465 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2466 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2467
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2468 if (!qc->push.timer_set) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2469 ngx_post_event(&qc->push, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2470 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2471
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2472 qc->pto_count = 0;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2473
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2474 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2475 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2476
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2477
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2478 static void
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2479 ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2480 enum ssl_encryption_level_t level, ngx_msec_t send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2481 {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2482 ngx_msec_t latest_rtt, ack_delay, adjusted_rtt, rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2483 ngx_quic_connection_t *qc;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2484
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2485 qc = c->quic;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2486
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2487 latest_rtt = ngx_current_msec - send_time;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2488 qc->latest_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2489
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2490 if (qc->min_rtt == NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2491 qc->min_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2492 qc->avg_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2493 qc->rttvar = latest_rtt / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2494
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2495 } else {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2496 qc->min_rtt = ngx_min(qc->min_rtt, latest_rtt);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2497
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2498
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2499 if (level == ssl_encryption_application) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2500 ack_delay = ack->delay * (1 << qc->ctp.ack_delay_exponent) / 1000;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2501 ack_delay = ngx_min(ack_delay, qc->ctp.max_ack_delay);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2502
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2503 } else {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2504 ack_delay = 0;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2505 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2506
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2507 adjusted_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2508
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2509 if (qc->min_rtt + ack_delay < latest_rtt) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2510 adjusted_rtt -= ack_delay;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2511 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2512
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2513 qc->avg_rtt = 0.875 * qc->avg_rtt + 0.125 * adjusted_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2514 rttvar_sample = ngx_abs((ngx_msec_int_t) (qc->avg_rtt - adjusted_rtt));
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2515 qc->rttvar = 0.75 * qc->rttvar + 0.25 * rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2516 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2517
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2518 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2519 "quic rtt sample: latest %M, min %M, avg %M, var %M",
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2520 latest_rtt, qc->min_rtt, qc->avg_rtt, qc->rttvar);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2521 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2522
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2523
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2524 static ngx_inline ngx_msec_t
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2525 ngx_quic_pto(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2526 {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2527 ngx_msec_t duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2528 ngx_quic_connection_t *qc;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2529
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2530 qc = c->quic;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2531
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2532 /* PTO calculation: quic-recovery, Appendix 8 */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2533 duration = qc->avg_rtt;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2534
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2535 duration += ngx_max(4 * qc->rttvar, NGX_QUIC_TIME_GRANULARITY);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2536 duration <<= qc->pto_count;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2537
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2538 if (qc->congestion.in_flight == 0) { /* no in-flight packets */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2539 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2540 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2541
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2542 if (ctx == &qc->send_ctx[2] && c->ssl->handshaked) {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2543 /* application send space */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2544
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2545 duration += qc->tp.max_ack_delay << qc->pto_count;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2546 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2547
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2548 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2549 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2550
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2551
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2552 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2553 ngx_quic_handle_stream_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2554 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2555 uint64_t sent, unacked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2556 ngx_event_t *wev;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2557 ngx_quic_stream_t *sn;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2558 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2559
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2560 if (f->type < NGX_QUIC_FT_STREAM0 \|\| f->type > NGX_QUIC_FT_STREAM7) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2561 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2562 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2563
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2564 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2565
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2566 sn = ngx_quic_find_stream(&qc->streams.tree, f->u.stream.stream_id);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2567 if (sn == NULL) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2568 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2569 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2570
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2571 wev = sn->c->write;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2572 sent = sn->c->sent;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2573 unacked = sent - sn->acked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2574
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2575 if (unacked >= NGX_QUIC_STREAM_BUFSIZE && wev->active) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2576 wev->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2577 ngx_post_event(wev, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2578 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2579
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2580 sn->acked += f->u.stream.length;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2581
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2582 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, sn->c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2583 "quic stream ack %uL acked:%uL, unacked:%uL",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2584 f->u.stream.length, sn->acked, sent - sn->acked);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2585 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2586
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2587
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2588 static ngx_int_t
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2589 ngx_quic_handle_ordered_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2590 ngx_quic_frame_t frame, ngx_quic_frame_handler_pt handler, void data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2591 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2592 size_t full_len;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2593 ngx_int_t rc;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2594 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2595 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2596
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2597 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2598
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2599 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2600 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2601 "quic out-of-order frame: expecting %uL got %uL",
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2602 fs->received, f->offset);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2603
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2604 return ngx_quic_buffer_frame(c, fs, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2605 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2606
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2607 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2608
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2609 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2610 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2611 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2612 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2613 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2614 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2615
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2616 /* intersecting data range, frame modified */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2617 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2618
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2619 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2620
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2621 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2622 if (rc == NGX_ERROR) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2623 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2624
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2625 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2626 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2627 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2628 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2629
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2630 /* rc == NGX_OK */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2631
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2632 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2633
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2634 /* now check the queue if we can continue with buffered frames */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2635
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2636 do {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2637 q = ngx_queue_head(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2638 if (q == ngx_queue_sentinel(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2639 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2640 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2641
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2642 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2643 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2644
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2645 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2646 /* gap found, nothing more to do */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2647 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2648 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2649
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2650 full_len = f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2651
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2652 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2653
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2654 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2655 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2656 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2657 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2658 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2659 fs->total -= f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2660
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2661 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2662 "quic skipped buffered frame, total %ui",
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2663 fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2664 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2665 continue;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2666 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2667
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2668 /* frame was adjusted, proceed to input */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2669 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2670
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2671 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2672
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2673 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2674
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2675 if (rc == NGX_ERROR) {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2676 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2677
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2678 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2679 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2680 return NGX_OK;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2681 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2682
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2683 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2684 fs->total -= full_len;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2685
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2686 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2687
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2688 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2689 "quic consumed buffered frame, total %ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2690
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2691 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2692
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2693 } while (1);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2694
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2695 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2696 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2697
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2698
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2699 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2700 ngx_quic_adjust_frame_offset(ngx_connection_t c, ngx_quic_frame_t frame,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2701 uint64_t offset_in)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2702 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2703 size_t tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2704 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2705
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2706 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2707
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2708 tail = offset_in - f->offset;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2709
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2710 if (tail >= f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2711 /* range preceeding already received data or duplicate, ignore */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2712
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2713 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2714 "quic old or duplicate data in ordered frame, ignored");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2715 return NGX_DONE;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2716 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2717
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2718 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2719 "quic adjusted ordered frame data start to expected offset");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2720
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2721 /* intersecting range: adjust data size */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2722
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2723 f->offset += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2724 f->data += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2725 f->length -= tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2726
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2727 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2728 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2729
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2730
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2731 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2732 ngx_quic_buffer_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2733 ngx_quic_frame_t *frame)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2734 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2735 u_char *data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2736 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2737 ngx_quic_frame_t dst, item;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2738 ngx_quic_ordered_frame_t f, df;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2739
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2740 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2741 "quic ngx_quic_buffer_frame");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2742
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2743 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2744
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2745 /* frame start offset is in the future, buffer it */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2746
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2747 /* check limit on total size used by all buffered frames, not actual data */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2748 if (NGX_QUIC_MAX_BUFFERED - fs->total < f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2749 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2750 "quic ordered input buffer limit exceeded");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2751 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2752 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2753
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2754 dst = ngx_quic_alloc_frame(c, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2755 if (dst == NULL) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2756 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2757 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2758
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2759 data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2760 ngx_memcpy(dst, frame, sizeof(ngx_quic_frame_t));
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2761 dst->data = data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2762
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2763 ngx_memcpy(dst->data, f->data, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2764
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2765 df = &dst->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2766 df->data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2767
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2768 fs->total += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2769
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2770 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2771 "quic ordered frame with unexpected offset:"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2772 " buffered, total %ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2773
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2774 /* TODO: do we need some timeout for this queue ? */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2775
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2776 if (ngx_queue_empty(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2777 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2778 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2779 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2780
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2781 for (q = ngx_queue_last(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2782 q != ngx_queue_sentinel(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2783 q = ngx_queue_prev(q))
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2784 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2785 item = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2786 f = &item->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2787
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2788 if (f->offset < df->offset) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2789 ngx_queue_insert_after(q, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2790 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2791 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2792 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2793
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2794 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2795
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2796 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2797 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2798
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2799
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2800 static ngx_int_t
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2801 ngx_quic_handle_crypto_frame(ngx_connection_t c, ngx_quic_header_t pkt,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2802 ngx_quic_frame_t *frame)
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2803 {
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2804 ngx_quic_connection_t *qc;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2805 ngx_quic_frames_stream_t *fs;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2806
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2807 qc = c->quic;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2808 fs = &qc->crypto[pkt->level];
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2809
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2810 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_crypto_input,
81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2811 NULL);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2812 }
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2813
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2814
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2815 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2816 ngx_quic_crypto_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2817 {
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2818 int n, sslerr;
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2819 ngx_queue_t *q;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2820 ngx_ssl_conn_t *ssl_conn;
8393 e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2821 ngx_quic_send_ctx_t *ctx;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2822 ngx_quic_crypto_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2823
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2824 f = &frame->u.crypto;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2825
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2826 ssl_conn = c->ssl->connection;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2827
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2828 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2829 "quic SSL_quic_read_level: %d, SSL_quic_write_level: %d",
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2830 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2831 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2832
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2833 if (!SSL_provide_quic_data(ssl_conn, SSL_quic_read_level(ssl_conn),
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2834 f->data, f->length))
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2835 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2836 ngx_ssl_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2837 "SSL_provide_quic_data() failed");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2838 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2839 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2840
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2841 n = SSL_do_handshake(ssl_conn);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2842
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2843 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_do_handshake: %d", n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2844
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2845 if (n == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2846 sslerr = SSL_get_error(ssl_conn, n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2847
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2848 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_get_error: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2849 sslerr);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2850
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	2851 if (sslerr != SSL_ERROR_WANT_READ) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2852 ngx_ssl_error(NGX_LOG_ERR, c->log, 0, "SSL_do_handshake() failed");
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	2853 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2854 }
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2855
8302 76818c9cdd6f Sending HANDSHAKE_DONE just once with BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8301 diff changeset	2856 } else if (n == 1 && !SSL_in_init(ssl_conn)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2857
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2858 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8299 4ad7d4272cd5 Style. Sergey Kandaurov <pluknet@nginx.com> parents: 8294 diff changeset	2859 "quic ssl cipher: %s", SSL_get_cipher(ssl_conn));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2860
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2861 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2862 "quic handshake completed successfully");
8273 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2863
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2864 c->ssl->handshaked = 1;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2865
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	2866 frame = ngx_quic_alloc_frame(c, 0);
8273 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2867 if (frame == NULL) {
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2868 return NGX_ERROR;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2869 }
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2870
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2871 /* 12.4 Frames and frame types, figure 8 */
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2872 frame->level = ssl_encryption_application;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2873 frame->type = NGX_QUIC_FT_HANDSHAKE_DONE;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2874 ngx_sprintf(frame->info, "HANDSHAKE DONE on handshake completed");
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2875 ngx_quic_queue_frame(c->quic, frame);
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2876
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2877 if (ngx_quic_send_new_token(c) != NGX_OK) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2878 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2879 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2880
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2881 /*
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2882 * Generating next keys before a key update is received.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2883 * See quic-tls 9.4 Header Protection Timing Side-Channels.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2884 */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2885
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2886 if (ngx_quic_key_update(c, &c->quic->keys[ssl_encryption_application],
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2887 &c->quic->next_key)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2888 != NGX_OK)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2889 {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2890 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2891 }
8393 e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2892
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2893 /*
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2894 * 4.10.2 An endpoint MUST discard its handshake keys
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2895 * when the TLS handshake is confirmed
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2896 */
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2897 ctx = ngx_quic_get_send_ctx(c->quic, ssl_encryption_handshake);
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2898
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2899 while (!ngx_queue_empty(&ctx->sent)) {
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2900 q = ngx_queue_head(&ctx->sent);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2901 ngx_queue_remove(q);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2902
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2903 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2904 ngx_quic_congestion_ack(c, frame);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2905 ngx_quic_free_frame(c, frame);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2906 }
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2907
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2908 c->quic->pto_count = 0;
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2909 }
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2910
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2911 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2912 "quic SSL_quic_read_level: %d, SSL_quic_write_level: %d",
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2913 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2914 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2915
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2916 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2917 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2918
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2919
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2920 static ngx_int_t
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2921 ngx_quic_handle_stream_frame(ngx_connection_t c, ngx_quic_header_t pkt,
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2922 ngx_quic_frame_t *frame)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2923 {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2924 ngx_pool_t *pool;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2925 ngx_connection_t *sc;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2926 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2927 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2928 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2929 ngx_quic_frames_stream_t *fs;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2930
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2931 qc = c->quic;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2932 f = &frame->u.stream;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2933
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2934 if ((f->stream_id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2935 && (f->stream_id & NGX_QUIC_STREAM_SERVER_INITIATED))
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2936 {
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2937 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2938 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2939 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2940
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2941 sn = ngx_quic_find_stream(&qc->streams.tree, f->stream_id);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2942
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2943 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2944 sn = ngx_quic_create_client_stream(c, f->stream_id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2945
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2946 if (sn == NULL) {
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2947 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2948 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2949
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2950 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2951 return NGX_OK;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	2952 }
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2953
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2954 sc = sn->c;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2955 fs = &sn->fs;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2956
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2957 if (ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2958 sn)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2959 != NGX_OK)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2960 {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2961 pool = sc->pool;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2962
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2963 ngx_close_connection(sc);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2964 ngx_destroy_pool(pool);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2965
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2966 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2967 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2968
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2969 sc->listening->handler(sc);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2970
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2971 return NGX_OK;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2972 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2973
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2974 fs = &sn->fs;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2975
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2976 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2977 sn);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2978 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2979
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2980
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2981 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2982 ngx_quic_stream_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2983 {
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	2984 uint64_t id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2985 ngx_buf_t *b;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2986 ngx_event_t *rev;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2987 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2988 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2989 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2990
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2991 qc = c->quic;
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2992 sn = data;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2993
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2994 f = &frame->u.stream;
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	2995 id = f->stream_id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2996
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2997 b = sn->b;
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2998
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2999 if ((size_t) ((b->pos - b->start) + (b->end - b->last)) < f->length) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	3000 ngx_log_error(NGX_LOG_INFO, c->log, 0,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	3001 "quic no space in stream buffer");
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3002 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3003 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3004
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3005 if ((size_t) (b->end - b->last) < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3006 b->last = ngx_movemem(b->start, b->pos, b->last - b->pos);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3007 b->pos = b->start;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3008 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3009
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	3010 b->last = ngx_cpymem(b->last, f->data, f->length);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3011
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3012 rev = sn->c->read;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3013 rev->ready = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3014
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3015 if (f->fin) {
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3016 rev->pending_eof = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	3017 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3018
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3019 if (rev->active) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3020 rev->handler(rev);
8314 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	3021 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	3022
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	3023 /* check if stream was destroyed by handler */
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	3024 if (ngx_quic_find_stream(&qc->streams.tree, id) == NULL) {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3025 return NGX_DONE;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3026 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3027
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3028 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3029 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3030
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3031
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3032 static ngx_int_t
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3033 ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3034 ngx_quic_max_data_frame_t *f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3035 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3036 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3037 ngx_rbtree_t *tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3038 ngx_rbtree_node_t *node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3039 ngx_quic_stream_t *qs;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3040 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3041
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3042 qc = c->quic;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3043 tree = &qc->streams.tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3044
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3045 if (f->max_data <= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3046 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3047 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3048
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3049 if (qc->streams.sent >= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3050
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3051 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3052 node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3053 node = ngx_rbtree_next(tree, node))
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3054 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3055 qs = (ngx_quic_stream_t *) node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3056 wev = qs->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3057
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3058 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3059 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3060 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3061 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3062 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3063 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3064
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3065 qc->streams.send_max_data = f->max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3066
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3067 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3068 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3069
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3070
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3071 static ngx_int_t
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3072 ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3073 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3074 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3075 return NGX_OK;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3076 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3077
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3078
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3079 static ngx_int_t
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3080 ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3081 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3082 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3083 size_t n;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3084 ngx_buf_t *b;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3085 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3086 ngx_quic_stream_t *sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3087 ngx_quic_connection_t *qc;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3088
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3089 qc = c->quic;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3090
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3091 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3092 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3093 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3094 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3095 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3096 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3097
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3098 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3099
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3100 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3101 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3102
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3103 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3104 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3105 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3106
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3107 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3108 return NGX_OK;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3109 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3110
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3111 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3112 n = b->end - b->last;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3113
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3114 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3115
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3116 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3117 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3118 n = sn->fs.received + (b->pos - b->start) + (b->end - b->last);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3119 }
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3120
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	3121 frame = ngx_quic_alloc_frame(c, 0);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3122 if (frame == NULL) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3123 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3124 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3125
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3126 frame->level = pkt->level;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3127 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3128 frame->u.max_stream_data.id = f->id;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3129 frame->u.max_stream_data.limit = n;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3130
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3131 ngx_sprintf(frame->info, "MAX_STREAM_DATA id:0x%xL limit:%uL level=%d",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3132 frame->u.max_stream_data.id,
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3133 frame->u.max_stream_data.limit,
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3134 frame->level);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3135
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3136 ngx_quic_queue_frame(c->quic, frame);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3137
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3138 return NGX_OK;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3139 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3140
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3141
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3142 static ngx_int_t
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3143 ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3144 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3145 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3146 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3147 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3148 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3149 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3150
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3151 qc = c->quic;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3152
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3153 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3154 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3155 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3156 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3157 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3158 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3159
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3160 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3161
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3162 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3163 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3164
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3165 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3166 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3167 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3168
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3169 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3170 return NGX_OK;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3171 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3172
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3173 if (f->limit > sn->send_max_data) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3174 sn->send_max_data = f->limit;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3175 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3176
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3177 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3178
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3179 return NGX_OK;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3180 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3181
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3182 if (f->limit <= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3183 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3184 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3185
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3186 sent = sn->c->sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3187
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3188 if (sent >= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3189 wev = sn->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3190
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3191 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3192 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3193 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3194 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3195 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3196
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3197 sn->send_max_data = f->limit;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3198
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3199 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3200 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3201
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3202
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3203 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3204 ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3205 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3206 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3207 ngx_event_t *rev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3208 ngx_connection_t *sc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3209 ngx_quic_stream_t *sn;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3210 ngx_quic_connection_t *qc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3211
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3212 qc = c->quic;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3213
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3214 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3215 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3216 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3217 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3218 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3219 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3220
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3221 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3222
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3223 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3224 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3225
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3226 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3227 return NGX_ERROR;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3228 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3229
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3230 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3231 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3232 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3233
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3234 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3235
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3236 rev = sc->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3237 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3238 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3239
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3240 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3241
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3242 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3243 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3244
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3245 rev = sn->c->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3246 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3247 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3248
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3249 if (rev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3250 rev->handler(rev);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3251 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3252
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3253 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3254 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3255
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3256
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3257 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3258 ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3259 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3260 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3261 ngx_event_t *wev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3262 ngx_connection_t *sc;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3263 ngx_quic_stream_t *sn;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3264 ngx_quic_connection_t *qc;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3265
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3266 qc = c->quic;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3267
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3268 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3269 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3270 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3271 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3272 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3273 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3274
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3275 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3276
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3277 if (sn == NULL) {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3278 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3279
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3280 if (sn == NULL) {
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3281 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3282 }
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3283
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3284 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3285 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3286 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3287
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3288 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3289
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3290 wev = sc->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3291 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3292 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3293
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3294 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3295
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3296 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3297 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3298
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3299 wev = sn->c->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3300 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3301 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3302
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3303 if (wev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3304 wev->handler(wev);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3305 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3306
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3307 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3308 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3309
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3310
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3311 static ngx_int_t
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3312 ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3313 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3314 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3315 ngx_quic_connection_t *qc;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3316
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3317 qc = c->quic;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3318
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3319 if (f->bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3320 if (qc->streams.server_max_streams_bidi < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3321 qc->streams.server_max_streams_bidi = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3322
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3323 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3324 "quic max_streams_bidi:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3325 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3326
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3327 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3328 if (qc->streams.server_max_streams_uni < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3329 qc->streams.server_max_streams_uni = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3330
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3331 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3332 "quic max_streams_uni:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3333 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3334 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3335
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3336 return NGX_OK;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3337 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3338
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3339
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3340 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3341 ngx_quic_queue_frame(ngx_quic_connection_t qc, ngx_quic_frame_t frame)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3342 {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3343 ngx_quic_send_ctx_t *ctx;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3344
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3345 ctx = ngx_quic_get_send_ctx(qc, frame->level);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3346
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3347 ngx_queue_insert_tail(&ctx->frames, &frame->queue);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3348
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3349 frame->len = ngx_quic_create_frame(NULL, frame);
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3350 /* always succeeds */
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3351
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3352 if (qc->closing) {
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3353 return;
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3354 }
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3355
8517 924882f42dea QUIC: do not artificially delay sending queued frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8516 diff changeset	3356 ngx_post_event(&qc->push, &ngx_posted_events);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3357 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3358
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3359
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3360 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3361 ngx_quic_output(ngx_connection_t *c)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3362 {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3363 ngx_uint_t i;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3364 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3365
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	3366 c->log->action = "sending frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	3367
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3368 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3369
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3370 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3371 if (ngx_quic_output_frames(c, &qc->send_ctx[i]) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3372 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3373 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3374 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3375
8322 d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 8321 diff changeset	3376 if (!qc->send_timer_set && !qc->closing) {
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3377 qc->send_timer_set = 1;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3378 ngx_add_timer(c->read, qc->tp.max_idle_timeout);
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3379 }
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3380
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3381 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3382 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3383
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3384
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3385 static ngx_int_t
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3386 ngx_quic_output_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3387 {
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3388 size_t len, hlen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3389 ngx_uint_t need_ack;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3390 ngx_queue_t *q, range;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3391 ngx_quic_frame_t *f;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3392 ngx_quic_congestion_t *cg;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3393 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3394
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3395 qc = c->quic;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3396 cg = &qc->congestion;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3397
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3398 if (ngx_queue_empty(&ctx->frames)) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3399 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3400 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3401
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3402 q = ngx_queue_head(&ctx->frames);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3403 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3404
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3405 /* all frames in same send_ctx share same level */
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3406 hlen = (f->level == ssl_encryption_application) ? NGX_QUIC_MAX_SHORT_HEADER
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3407 : NGX_QUIC_MAX_LONG_HEADER;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3408 hlen += EVP_GCM_TLS_TAG_LEN;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3409
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3410 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3411 len = 0;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3412 need_ack = 0;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3413 ngx_queue_init(&range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3414
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3415 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3416 /* process group of frames that fits into packet */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3417 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3418
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3419 if (len && hlen + len + f->len > qc->ctp.max_udp_payload_size) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3420 break;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3421 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3422
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3423 if (f->need_ack) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3424 need_ack = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3425 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3426
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3427 if (need_ack && cg->in_flight + len + f->len > cg->window) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3428 break;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3429 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3430
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3431 if (!qc->validated) {
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3432 /*
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3433 * Prior to validation, endpoints are limited in what they
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3434 * are able to send. During the handshake, a server cannot
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3435 * send more than three times the data it receives;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3436 */
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3437
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3438 if (((c->sent + len + f->len) / 3) > qc->received) {
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3439 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3440 "quic hit amplification limit"
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3441 " received %uz sent %O",
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3442 qc->received, c->sent);
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3443 break;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3444 }
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3445 }
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3446
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3447 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3448
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3449 f->first = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3450
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3451 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3452 ngx_queue_insert_tail(&range, &f->queue);
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3453
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3454 len += f->len;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3455
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3456 } while (q != ngx_queue_sentinel(&ctx->frames));
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3457
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3458 if (ngx_queue_empty(&range)) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3459 break;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3460 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3461
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3462 if (ngx_quic_send_frames(c, ctx, &range) != NGX_OK) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3463 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3464 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3465
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3466 } while (q != ngx_queue_sentinel(&ctx->frames));
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3467
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3468 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3469 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3470
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3471
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3472 static void
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3473 ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3474 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3475 ngx_queue_t *q;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3476 ngx_quic_frame_t *f;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3477
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3478 do {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3479 q = ngx_queue_head(frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3480
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3481 if (q == ngx_queue_sentinel(frames)) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3482 break;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3483 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3484
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3485 ngx_queue_remove(q);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3486
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3487 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3488
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3489 ngx_quic_free_frame(c, f);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3490 } while (1);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3491 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3492
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3493
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3494 static ngx_int_t
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3495 ngx_quic_send_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3496 ngx_queue_t *frames)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3497 {
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3498 ssize_t len;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3499 u_char *p;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3500 ngx_msec_t now;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3501 ngx_str_t out, res;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3502 ngx_queue_t *q;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3503 ngx_ssl_conn_t *ssl_conn;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3504 ngx_quic_frame_t f, start;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3505 ngx_quic_header_t pkt;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3506 ngx_quic_secrets_t *keys;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3507 ngx_quic_connection_t *qc;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3508 static ngx_str_t initial_token = ngx_null_string;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	3509 static u_char src[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	3510 static u_char dst[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3511
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3512 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3513 "quic ngx_quic_send_frames");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3514
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3515 ssl_conn = c->ssl ? c->ssl->connection : NULL;
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3516
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3517 q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3518 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3519
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3520 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3521
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3522 now = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3523
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3524 p = src;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3525 out.data = src;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3526
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3527 for (q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3528 q != ngx_queue_sentinel(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3529 q = ngx_queue_next(q))
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3530 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3531 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3532
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3533 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3534 "quic frame out: %s", f->info);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3535
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3536 len = ngx_quic_create_frame(p, f);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3537 if (len == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3538 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3539 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3540
8312 053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3541 if (f->need_ack) {
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3542 pkt.need_ack = 1;
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3543 }
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3544
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3545 p += len;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3546 f->pnum = ctx->pnum;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3547 f->last = now;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3548 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3549
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3550 out.len = p - out.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3551
8301 c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3552 while (out.len < 4) {
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3553 *p++ = NGX_QUIC_FT_PADDING;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3554 out.len++;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3555 }
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3556
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3557 qc = c->quic;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3558
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3559 keys = &c->quic->keys[start->level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3560
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3561 pkt.secret = &keys->server;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3562
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3563 pkt.flags = NGX_QUIC_PKT_FIXED_BIT;
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3564
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3565 if (start->level == ssl_encryption_initial) {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3566 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_INITIAL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3567 pkt.token = initial_token;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3568
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3569 } else if (start->level == ssl_encryption_handshake) {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3570 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_HANDSHAKE;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3571
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3572 } else {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3573 if (c->quic->key_phase) {
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3574 pkt.flags \|= NGX_QUIC_PKT_KPHASE;
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3575 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3576 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3577
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3578 ngx_quic_set_packet_number(&pkt, ctx);
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3579
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3580 pkt.log = c->log;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3581 pkt.level = start->level;
8344 e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 8343 diff changeset	3582 pkt.dcid = qc->scid;
e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 8343 diff changeset	3583 pkt.scid = qc->dcid;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3584 pkt.payload = out;
8285 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 8284 diff changeset	3585
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3586 res.data = dst;
8285 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 8284 diff changeset	3587
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3588 ngx_log_debug6(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3589 "quic packet ready: %ui bytes at level %d"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3590 " need_ack: %d number: %L encoded %d:0x%xD",
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3591 out.len, start->level, pkt.need_ack, pkt.number,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3592 pkt.num_len, pkt.trunc);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3593
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3594 if (ngx_quic_encrypt(&pkt, ssl_conn, &res) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3595 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3596 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3597
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3598 #ifdef NGX_QUIC_DEBUG_PACKETS
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	3599 ngx_quic_hexdump(c->log, "quic packet to send", res.data, res.len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3600 #endif
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3601
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3602 len = c->send(c, res.data, res.len);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3603 if (len == NGX_ERROR \|\| (size_t) len != res.len) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3604 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3605 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3606
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3607 /* len == NGX_OK \|\| NGX_AGAIN */
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3608 ctx->pnum++;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3609
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3610 if (pkt.need_ack) {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3611 /* move frames into the sent queue to wait for ack */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3612
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3613 if (qc->closing) {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3614 /* if we are closing, any ack will be discarded */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3615 ngx_quic_free_frames(c, frames);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3616
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3617 } else {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3618 ngx_queue_add(&ctx->sent, frames);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3619 if (qc->pto.timer_set) {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3620 ngx_del_timer(&qc->pto);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3621 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3622 ngx_add_timer(&qc->pto, ngx_quic_pto(c, ctx));
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3623
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3624 start->plen = len;
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3625 }
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3626
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3627 qc->congestion.in_flight += len;
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3628
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3629 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3630 "quic congestion send if:%uz",
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3631 qc->congestion.in_flight);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3632 } else {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3633 /* no ack is expected for this frames, so we can free them */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3634 ngx_quic_free_frames(c, frames);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3635 }
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3636
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3637 return NGX_OK;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3638 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3639
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3640
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3641 static void
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3642 ngx_quic_set_packet_number(ngx_quic_header_t pkt, ngx_quic_send_ctx_t ctx)
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3643 {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3644 uint64_t delta;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3645
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3646 delta = ctx->pnum - ctx->largest_ack;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3647 pkt->number = ctx->pnum;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3648
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3649 if (delta <= 0x7F) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3650 pkt->num_len = 1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3651 pkt->trunc = ctx->pnum & 0xff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3652
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3653 } else if (delta <= 0x7FFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3654 pkt->num_len = 2;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3655 pkt->flags \|= 0x1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3656 pkt->trunc = ctx->pnum & 0xffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3657
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3658 } else if (delta <= 0x7FFFFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3659 pkt->num_len = 3;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3660 pkt->flags \|= 0x2;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3661 pkt->trunc = ctx->pnum & 0xffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3662
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3663 } else {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3664 pkt->num_len = 4;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3665 pkt->flags \|= 0x3;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3666 pkt->trunc = ctx->pnum & 0xffffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3667 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3668 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3669
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3670
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3671 static void
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	3672 ngx_quic_pto_handler(ngx_event_t *ev)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3673 {
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3674 ngx_uint_t i;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3675 ngx_queue_t *q;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3676 ngx_connection_t *c;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3677 ngx_quic_frame_t *start;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3678 ngx_quic_send_ctx_t *ctx;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3679 ngx_quic_connection_t *qc;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3680
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	3681 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic pto timer");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3682
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3683 c = ev->data;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3684 qc = c->quic;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3685
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3686 qc->pto_count++;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3687
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3688 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3689
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3690 ctx = &qc->send_ctx[i];
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3691
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3692 if (ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3693 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3694 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3695
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3696 q = ngx_queue_head(&ctx->sent);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3697 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3698
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3699 if (start->pnum <= ctx->largest_ack
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3700 && ctx->largest_ack != (uint64_t) -1)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3701 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3702 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3703 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3704
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3705 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8519 de7d6d943f68 QUIC: fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8518 diff changeset	3706 "quic pto pnum:%uL pto_count:%ui level:%d",
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3707 start->pnum, c->quic->pto_count, start->level);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3708
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3709 if (ngx_quic_resend_frames(c, ctx, start) != NGX_OK) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3710 ngx_quic_close_connection(c, NGX_ERROR);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3711 return;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3712 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3713 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3714 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3715
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3716
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3717 static void
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3718 ngx_quic_push_handler(ngx_event_t *ev)
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3719 {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3720 ngx_connection_t *c;
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3721
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3722 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic push timer");
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3723
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3724 c = ev->data;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3725
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3726 if (ngx_quic_output(c) != NGX_OK) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3727 ngx_quic_close_connection(c, NGX_ERROR);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3728 return;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3729 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3730 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3731
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3732
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3733 static
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3734 void ngx_quic_lost_handler(ngx_event_t *ev)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3735 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3736 ngx_connection_t *c;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3737
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3738 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic lost timer");
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3739
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3740 c = ev->data;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3741
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3742 if (ngx_quic_detect_lost(c) != NGX_OK) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3743 ngx_quic_close_connection(c, NGX_ERROR);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3744 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3745 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3746
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3747
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3748 static ngx_int_t
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3749 ngx_quic_detect_lost(ngx_connection_t *c)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3750 {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3751 ngx_uint_t i;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3752 ngx_msec_t now, wait, min_wait, thr;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3753 ngx_queue_t *q;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3754 ngx_quic_frame_t *start;
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3755 ngx_quic_send_ctx_t *ctx;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3756 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3757
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3758 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3759 now = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3760
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3761 min_wait = 0;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3762
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3763 thr = NGX_QUIC_TIME_THR * ngx_max(qc->latest_rtt, qc->avg_rtt);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3764 thr = ngx_max(thr, NGX_QUIC_TIME_GRANULARITY);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3765
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3766 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3767
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3768 ctx = &qc->send_ctx[i];
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3769
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3770 if (ctx->largest_ack == (uint64_t) -1) {
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3771 continue;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3772 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3773
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3774 while (!ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3775
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3776 q = ngx_queue_head(&ctx->sent);
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3777 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3778
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3779 if (start->pnum > ctx->largest_ack) {
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3780 break;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3781 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3782
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3783 wait = start->last + thr - now;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3784
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3785 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8519 de7d6d943f68 QUIC: fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8518 diff changeset	3786 "quic detect_lost pnum:%uL thr:%M wait:%i level:%d",
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3787 start->pnum, thr, (ngx_int_t) wait, start->level);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3788
8516 355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3789 if ((ngx_msec_int_t) wait > 0
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3790 && ctx->largest_ack - start->pnum < NGX_QUIC_PKT_THR)
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3791 {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3792
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3793 if (min_wait == 0 \|\| wait < min_wait) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3794 min_wait = wait;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3795 }
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3796
8516 355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3797 break;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3798 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3799
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3800 if (ngx_quic_resend_frames(c, ctx, start) != NGX_OK) {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3801 return NGX_ERROR;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3802 }
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3803 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3804 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3805
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3806 /* no more preceeding packets */
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3807
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3808 if (min_wait == 0) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3809 qc->pto.handler = ngx_quic_pto_handler;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3810 return NGX_OK;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3811 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3812
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3813 qc->pto.handler = ngx_quic_lost_handler;
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3814
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3815 if (qc->pto.timer_set) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3816 ngx_del_timer(&qc->pto);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3817 }
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3818
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3819 ngx_add_timer(&qc->pto, min_wait);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3820
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3821 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3822 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3823
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3824
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3825 static ngx_int_t
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3826 ngx_quic_resend_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3827 ngx_quic_frame_t *start)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3828 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3829 ngx_queue_t *q, range;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3830 ngx_quic_frame_t *f;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3831
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3832 ngx_queue_init(&range);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3833
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3834 /* send frames with same packet number to the wire */
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3835
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3836 q = ngx_queue_head(&ctx->sent);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3837
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3838 do {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3839 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3840
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3841 if (f->pnum != start->pnum) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3842 break;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3843 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3844
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3845 q = ngx_queue_next(q);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3846
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3847 ngx_queue_remove(&f->queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3848 ngx_queue_insert_tail(&range, &f->queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3849
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3850 } while (q != ngx_queue_sentinel(&ctx->sent));
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3851
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3852 ngx_quic_congestion_lost(c, start);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3853
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3854 return ngx_quic_send_frames(c, ctx, &range);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3855 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3856
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3857
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3858 ngx_connection_t *
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3859 ngx_quic_open_stream(ngx_connection_t *c, ngx_uint_t bidi)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3860 {
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3861 size_t rcvbuf_size;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3862 uint64_t id;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3863 ngx_quic_stream_t qs, sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3864 ngx_quic_connection_t *qc;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3865
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3866 qs = c->qs;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3867 qc = qs->parent->quic;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3868
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3869 if (bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3870 if (qc->streams.server_streams_bidi
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3871 >= qc->streams.server_max_streams_bidi)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3872 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3873 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3874 "quic too many server bidi streams: %uL",
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3875 qc->streams.server_streams_bidi);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3876 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3877 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3878
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3879 id = (qc->streams.server_streams_bidi << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3880 \| NGX_QUIC_STREAM_SERVER_INITIATED;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3881
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3882 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	3883 "quic creating server bidi stream %uL/%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3884 qc->streams.server_streams_bidi,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3885 qc->streams.server_max_streams_bidi, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3886
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3887 qc->streams.server_streams_bidi++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3888 rcvbuf_size = qc->tp.initial_max_stream_data_bidi_local;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3889
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3890 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3891 if (qc->streams.server_streams_uni
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3892 >= qc->streams.server_max_streams_uni)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3893 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3894 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3895 "quic too many server uni streams: %uL",
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3896 qc->streams.server_streams_uni);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3897 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3898 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3899
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3900 id = (qc->streams.server_streams_uni << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3901 \| NGX_QUIC_STREAM_SERVER_INITIATED
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3902 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3903
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3904 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	3905 "quic creating server uni stream %uL/%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3906 qc->streams.server_streams_uni,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3907 qc->streams.server_max_streams_uni, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3908
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3909 qc->streams.server_streams_uni++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3910 rcvbuf_size = 0;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3911 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3912
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3913 sn = ngx_quic_create_stream(qs->parent, id, rcvbuf_size);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3914 if (sn == NULL) {
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3915 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3916 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3917
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	3918 return sn->c;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3919 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3920
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3921
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3922 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3923 ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3924 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3925 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3926 ngx_rbtree_node_t **p;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3927 ngx_quic_stream_t qn, qnt;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3928
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3929 for ( ;; ) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3930 qn = (ngx_quic_stream_t *) node;
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3931 qnt = (ngx_quic_stream_t *) temp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3932
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3933 p = (qn->id < qnt->id) ? &temp->left : &temp->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3934
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3935 if (*p == sentinel) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3936 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3937 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3938
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3939 temp = *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3940 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3941
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3942 *p = node;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3943 node->parent = temp;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3944 node->left = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3945 node->right = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3946 ngx_rbt_red(node);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3947 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3948
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3949
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3950 static ngx_quic_stream_t *
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3951 ngx_quic_find_stream(ngx_rbtree_t *rbtree, uint64_t id)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3952 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3953 ngx_rbtree_node_t node, sentinel;
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3954 ngx_quic_stream_t *qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3955
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3956 node = rbtree->root;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3957 sentinel = rbtree->sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3958
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3959 while (node != sentinel) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3960 qn = (ngx_quic_stream_t *) node;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3961
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3962 if (id == qn->id) {
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3963 return qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3964 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3965
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	3966 node = (id < qn->id) ? node->left : node->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3967 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3968
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3969 return NULL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3970 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3971
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3972
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3973 static ngx_quic_stream_t *
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3974 ngx_quic_create_client_stream(ngx_connection_t *c, uint64_t id)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3975 {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3976 size_t n;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3977 uint64_t min_id;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3978 ngx_quic_stream_t *sn;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3979 ngx_quic_connection_t *qc;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3980
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3981 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3982 "quic stream id 0x%xL is new", id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3983
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3984 qc = c->quic;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3985
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3986 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3987
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3988 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3989 if ((id >> 2) < qc->streams.server_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3990 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3991 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3992
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3993 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3994 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3995 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3996
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3997 if ((id >> 2) < qc->streams.client_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3998 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3999 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4000
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4001 if ((id >> 2) >= qc->streams.client_max_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4002 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4003 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4004 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4005
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4006 min_id = (qc->streams.client_streams_uni << 2)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4007 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4008 qc->streams.client_streams_uni = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4009 n = qc->tp.initial_max_stream_data_uni;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4010
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4011 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4012
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4013 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4014 if ((id >> 2) < qc->streams.server_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4015 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4016 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4017
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4018 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4019 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4020 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4021
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4022 if ((id >> 2) < qc->streams.client_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4023 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4024 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4025
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4026 if ((id >> 2) >= qc->streams.client_max_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4027 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4028 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4029 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4030
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4031 min_id = (qc->streams.client_streams_bidi << 2);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4032 qc->streams.client_streams_bidi = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4033 n = qc->tp.initial_max_stream_data_bidi_remote;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4034 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4035
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4036 if (n < NGX_QUIC_STREAM_BUFSIZE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4037 n = NGX_QUIC_STREAM_BUFSIZE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4038 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4039
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4040 /*
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4041 * 2.1. Stream Types and Identifiers
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4042 *
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4043 * Within each type, streams are created with numerically increasing
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4044 * stream IDs. A stream ID that is used out of order results in all
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4045 * streams of that type with lower-numbered stream IDs also being
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4046 * opened.
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4047 */
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4048
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4049 for ( /* void */ ; min_id < id; min_id += 0x04) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4050
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4051 sn = ngx_quic_create_stream(c, min_id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4052 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4053 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4054 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4055
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4056 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4057 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4058
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4059 return ngx_quic_create_stream(c, id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4060 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4061
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4062
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4063 static ngx_quic_stream_t *
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4064 ngx_quic_create_stream(ngx_connection_t *c, uint64_t id, size_t rcvbuf_size)
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4065 {
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4066 ngx_log_t *log;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4067 ngx_pool_t *pool;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4068 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4069 ngx_pool_cleanup_t *cln;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4070 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4071
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4072 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4073 "quic stream id 0x%xL create", id);
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4074
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4075 qc = c->quic;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4076
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4077 pool = ngx_create_pool(NGX_DEFAULT_POOL_SIZE, c->log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4078 if (pool == NULL) {
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4079 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4080 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4081
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4082 sn = ngx_pcalloc(pool, sizeof(ngx_quic_stream_t));
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4083 if (sn == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4084 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4085 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4086 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4087
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4088 sn->node.key = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4089 sn->parent = c;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4090 sn->id = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4091
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4092 sn->b = ngx_create_temp_buf(pool, rcvbuf_size);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4093 if (sn->b == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4094 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4095 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4096 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4097
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4098 ngx_queue_init(&sn->fs.frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4099
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4100 log = ngx_palloc(pool, sizeof(ngx_log_t));
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4101 if (log == NULL) {
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4102 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4103 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4104 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4105
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4106 log = c->log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4107 pool->log = log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4108
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4109 sn->c = ngx_get_connection(-1, log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4110 if (sn->c == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4111 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4112 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4113 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4114
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4115 sn->c->qs = sn;
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	4116 sn->c->type = SOCK_STREAM;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4117 sn->c->pool = pool;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4118 sn->c->ssl = c->ssl;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4119 sn->c->sockaddr = c->sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4120 sn->c->listening = c->listening;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4121 sn->c->addr_text = c->addr_text;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4122 sn->c->local_sockaddr = c->local_sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4123 sn->c->number = ngx_atomic_fetch_add(ngx_connection_counter, 1);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4124
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4125 sn->c->recv = ngx_quic_stream_recv;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4126 sn->c->send = ngx_quic_stream_send;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4127 sn->c->send_chain = ngx_quic_stream_send_chain;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4128
8479 b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	4129 sn->c->read->log = log;
b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	4130 sn->c->write->log = log;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4131
8362 44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	4132 log->connection = sn->c->number;
44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	4133
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4134 if ((id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4135 \|\| (id & NGX_QUIC_STREAM_SERVER_INITIATED))
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4136 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4137 sn->c->write->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4138 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4139
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4140 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4141 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4142 sn->send_max_data = qc->ctp.initial_max_stream_data_uni;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4143 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4144
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4145 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4146 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4147 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_remote;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4148 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4149 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_local;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4150 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4151 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4152
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4153 cln = ngx_pool_cleanup_add(pool, 0);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4154 if (cln == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4155 ngx_close_connection(sn->c);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4156 ngx_destroy_pool(pool);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4157 return NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4158 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4159
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4160 cln->handler = ngx_quic_stream_cleanup_handler;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4161 cln->data = sn->c;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4162
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4163 ngx_rbtree_insert(&c->quic->streams.tree, &sn->node);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4164
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4165 return sn;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4166 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4167
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4168
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4169 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4170 ngx_quic_stream_recv(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4171 {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4172 ssize_t len;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4173 ngx_buf_t *b;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4174 ngx_event_t *rev;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4175 ngx_connection_t *pc;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4176 ngx_quic_frame_t *frame;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4177 ngx_quic_stream_t *qs;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4178 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4179
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4180 qs = c->qs;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4181 b = qs->b;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4182 pc = qs->parent;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4183 qc = pc->quic;
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4184 rev = c->read;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4185
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4186 if (rev->error) {
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4187 return NGX_ERROR;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4188 }
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4189
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4190 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4191 "quic stream id 0x%xL recv: eof:%d, avail:%z",
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4192 qs->id, rev->pending_eof, b->last - b->pos);
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4193
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4194 if (b->pos == b->last) {
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4195 rev->ready = 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4196
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4197 if (rev->pending_eof) {
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4198 rev->eof = 1;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4199 return 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4200 }
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4201
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4202 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4203 "quic stream id 0x%xL recv() not ready", qs->id);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4204 return NGX_AGAIN;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4205 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4206
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4207 len = ngx_min(b->last - b->pos, (ssize_t) size);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4208
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4209 ngx_memcpy(buf, b->pos, len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4210
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4211 b->pos += len;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4212 qc->streams.received += len;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4213
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4214 if (b->pos == b->last) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4215 b->pos = b->start;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4216 b->last = b->start;
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4217 rev->ready = rev->pending_eof;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4218 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4219
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4220 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4221 "quic stream id 0x%xL recv: %z of %uz", qs->id, len, size);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4222
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4223 if (!rev->pending_eof) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4224 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4225 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4226 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4227 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4228
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4229 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4230 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4231 frame->u.max_stream_data.id = qs->id;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4232 frame->u.max_stream_data.limit = qs->fs.received + (b->pos - b->start)
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4233 + (b->end - b->last);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4234
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4235 ngx_sprintf(frame->info,
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4236 "MAX_STREAM_DATA id:0x%xL limit:%uL l=%d on recv",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4237 frame->u.max_stream_data.id,
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4238 frame->u.max_stream_data.limit,
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4239 frame->level);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4240
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4241 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4242 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4243
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4244 if ((qc->streams.recv_max_data / 2) < qc->streams.received) {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4245
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4246 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4247
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4248 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4249 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4250 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4251
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4252 qc->streams.recv_max_data *= 2;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4253
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4254 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4255 frame->type = NGX_QUIC_FT_MAX_DATA;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4256 frame->u.max_data.max_data = qc->streams.recv_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4257
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4258 ngx_sprintf(frame->info, "MAX_DATA max_data:%uL level=%d on recv",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4259 frame->u.max_data.max_data, frame->level);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4260
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4261 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4262
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4263 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4264 "quic stream id 0x%xL recv: increased max data: %uL",
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4265 qs->id, qc->streams.recv_max_data);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4266 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4267
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4268 return len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4269 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4270
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4271
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4272 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4273 ngx_quic_stream_send(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4274 {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4275 ngx_buf_t b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4276 ngx_chain_t cl;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4277
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4278 ngx_memzero(&b, sizeof(ngx_buf_t));
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4279
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4280 b.memory = 1;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4281 b.pos = buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4282 b.last = buf + size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4283
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4284 cl.buf = &b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4285 cl.next = NULL;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4286
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4287 if (ngx_quic_stream_send_chain(c, &cl, 0) == NGX_CHAIN_ERROR) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4288 return NGX_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4289 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4290
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4291 if (b.pos == buf) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4292 return NGX_AGAIN;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4293 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4294
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4295 return b.pos - buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4296 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4297
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4298
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4299 static ngx_chain_t *
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4300 ngx_quic_stream_send_chain(ngx_connection_t c, ngx_chain_t in, off_t limit)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4301 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4302 u_char *p;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4303 size_t n, max, max_frame, max_flow, max_limit, len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4304 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4305 size_t sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4306 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4307 ngx_buf_t *b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4308 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4309 ngx_uint_t nframes;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4310 #endif
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4311 ngx_event_t *wev;
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4312 ngx_chain_t *cl;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4313 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4314 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4315 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4316 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4317
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4318 qs = c->qs;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4319 pc = qs->parent;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4320 qc = pc->quic;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4321 wev = c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4322
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4323 if (wev->error) {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4324 return NGX_CHAIN_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4325 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4326
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4327 max_frame = ngx_quic_max_stream_frame(qc);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4328 max_flow = ngx_quic_max_stream_flow(c);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4329 max_limit = limit;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4330
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4331 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4332 sent = 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4333 nframes = 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4334 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4335
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4336 for ( ;; ) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4337 max = ngx_min(max_frame, max_flow);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4338
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4339 if (limit) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4340 max = ngx_min(max, max_limit);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4341 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4342
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4343 for (cl = in, n = 0; in; in = in->next) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4344
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4345 if (!ngx_buf_in_memory(in->buf)) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4346 continue;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4347 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4348
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4349 n += ngx_buf_size(in->buf);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4350
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4351 if (n > max) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4352 n = max;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4353 break;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4354 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4355 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4356
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4357 if (n == 0) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4358 wev->ready = (max_flow ? 1 : 0);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4359 break;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4360 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4361
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4362 frame = ngx_quic_alloc_frame(pc, n);
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4363 if (frame == NULL) {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4364 return NGX_CHAIN_ERROR;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4365 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4366
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4367 frame->level = ssl_encryption_application;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4368 frame->type = NGX_QUIC_FT_STREAM6; /* OFF=1 LEN=1 FIN=0 */
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4369 frame->u.stream.off = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4370 frame->u.stream.len = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4371 frame->u.stream.fin = 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4372
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4373 frame->u.stream.type = frame->type;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4374 frame->u.stream.stream_id = qs->id;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4375 frame->u.stream.offset = c->sent;
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4376 frame->u.stream.length = n;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4377 frame->u.stream.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4378
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4379 ngx_sprintf(frame->info, "STREAM id:0x%xL len:%uz level:%d",
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4380 qs->id, n, frame->level);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4381
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4382 c->sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4383 qc->streams.sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4384 max_flow -= n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4385
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4386 if (limit) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4387 max_limit -= n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4388 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4389
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4390 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4391 sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4392 nframes++;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4393 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4394
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4395 for (p = frame->data; n > 0; cl = cl->next) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4396 b = cl->buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4397
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4398 if (!ngx_buf_in_memory(b)) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4399 continue;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4400 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4401
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4402 len = ngx_min(n, (size_t) (b->last - b->pos));
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4403 p = ngx_cpymem(p, b->pos, len);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4404
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4405 b->pos += len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4406 n -= len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4407 }
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4408
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4409 ngx_quic_queue_frame(qc, frame);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4410 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4411
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4412 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4413 "quic send_chain sent:%uz, frames:%ui", sent, nframes);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4414
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4415 return in;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4416 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4417
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4418
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4419 static size_t
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4420 ngx_quic_max_stream_frame(ngx_quic_connection_t *qc)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4421 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4422 /*
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4423 * we need to fit at least 1 frame into a packet, thus account head/tail;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4424 * 25 = 1 + 8x3 is max header for STREAM frame, with 1 byte for frame type
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4425 */
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4426
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4427 return qc->ctp.max_udp_payload_size - NGX_QUIC_MAX_SHORT_HEADER - 25
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4428 - EVP_GCM_TLS_TAG_LEN;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4429 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4430
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4431
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4432 static size_t
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4433 ngx_quic_max_stream_flow(ngx_connection_t *c)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4434 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4435 size_t size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4436 uint64_t sent, unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4437 ngx_quic_stream_t *qs;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4438 ngx_quic_connection_t *qc;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4439
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4440 qs = c->qs;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4441 qc = qs->parent->quic;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4442
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4443 size = NGX_QUIC_STREAM_BUFSIZE;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4444 sent = c->sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4445 unacked = sent - qs->acked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4446
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4447 if (qc->streams.send_max_data == 0) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4448 qc->streams.send_max_data = qc->ctp.initial_max_data;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4449 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4450
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4451 if (unacked >= NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4452 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4453 "quic send flow hit buffer size");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4454 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4455 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4456
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4457 if (unacked + size > NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4458 size = NGX_QUIC_STREAM_BUFSIZE - unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4459 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4460
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4461 if (qc->streams.sent >= qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4462 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4463 "quic send flow hit MAX_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4464 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4465 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4466
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4467 if (qc->streams.sent + size > qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4468 size = qc->streams.send_max_data - qc->streams.sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4469 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4470
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4471 if (sent >= qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4472 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4473 "quic send flow hit MAX_STREAM_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4474 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4475 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4476
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4477 if (sent + size > qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4478 size = qs->send_max_data - sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4479 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4480
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4481 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4482 "quic send flow: %uz", size);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4483
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4484 return size;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4485 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4486
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4487
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4488 static void
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4489 ngx_quic_stream_cleanup_handler(void *data)
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4490 {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4491 ngx_connection_t *c = data;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4492
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4493 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4494 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4495 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4496 ngx_quic_connection_t *qc;
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4497
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4498 qs = c->qs;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4499 pc = qs->parent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4500 qc = pc->quic;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4501
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4502 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4503 "quic stream id 0x%xL cleanup", qs->id);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4504
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4505 ngx_rbtree_delete(&qc->streams.tree, &qs->node);
8348 d42b50d239f4 Fixed memory leak with reordered stream frames. Vladimir Homutov <vl@nginx.com> parents: 8346 diff changeset	4506 ngx_quic_free_frames(pc, &qs->fs.frames);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4507
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4508 if (qc->closing) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	4509 /* schedule handler call to continue ngx_quic_close_connection() */
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4510 ngx_post_event(pc->read, &ngx_posted_events);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4511 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4512 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4513
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4514 if ((qs->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4515 frame = ngx_quic_alloc_frame(pc, 0);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4516 if (frame == NULL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4517 return;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4518 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4519
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4520 frame->level = ssl_encryption_application;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4521 frame->type = NGX_QUIC_FT_MAX_STREAMS;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4522
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4523 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4524 frame->u.max_streams.limit = ++qc->streams.client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4525 frame->u.max_streams.bidi = 0;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4526
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4527 } else {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4528 frame->u.max_streams.limit = ++qc->streams.client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4529 frame->u.max_streams.bidi = 1;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4530 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4531
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4532 ngx_sprintf(frame->info, "MAX_STREAMS limit:%uL bidi:%ui level=%d",
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4533 frame->u.max_streams.limit,
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4534 frame->u.max_streams.bidi,
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4535 (int) frame->level);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4536
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4537 ngx_quic_queue_frame(qc, frame);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4538
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4539 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4540 /* do not send fin for client unidirectional streams */
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4541 return;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4542 }
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4543 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4544
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4545 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4546 "quic stream id 0x%xL send fin", qs->id);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4547
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4548 frame = ngx_quic_alloc_frame(pc, 0);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4549 if (frame == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4550 return;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4551 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4552
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4553 frame->level = ssl_encryption_application;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4554 frame->type = NGX_QUIC_FT_STREAM7; /* OFF=1 LEN=1 FIN=1 */
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4555 frame->u.stream.off = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4556 frame->u.stream.len = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4557 frame->u.stream.fin = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4558
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4559 frame->u.stream.type = frame->type;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4560 frame->u.stream.stream_id = qs->id;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4561 frame->u.stream.offset = c->sent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4562 frame->u.stream.length = 0;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4563 frame->u.stream.data = NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4564
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4565 ngx_sprintf(frame->info, "stream 0x%xL fin=1 level=%d",
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4566 qs->id, frame->level);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4567
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4568 ngx_quic_queue_frame(qc, frame);
8293 1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	4569
1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	4570 (void) ngx_quic_output(pc);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4571 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4572
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4573
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4574 static ngx_quic_frame_t *
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4575 ngx_quic_alloc_frame(ngx_connection_t *c, size_t size)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4576 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4577 u_char *p;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4578 ngx_queue_t *q;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4579 ngx_quic_frame_t *frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4580 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4581
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4582 if (size) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4583 p = ngx_alloc(size, c->log);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4584 if (p == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4585 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4586 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4587
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4588 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4589 p = NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4590 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4591
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4592 qc = c->quic;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4593
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4594 if (!ngx_queue_empty(&qc->free_frames)) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4595
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4596 q = ngx_queue_head(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4597 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4598
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4599 ngx_queue_remove(&frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4600
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4601 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4602 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4603 "quic reuse frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4604 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4605
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4606 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4607 frame = ngx_pcalloc(c->pool, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4608 if (frame == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4609 ngx_free(p);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4610 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4611 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4612
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4613 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4614 ++qc->nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4615 #endif
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4616
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4617 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4618 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4619 "quic alloc frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4620 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4621 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4622
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4623 ngx_memzero(frame, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4624
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4625 frame->data = p;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4626
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4627 return frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4628 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4629
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4630
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4631 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4632 ngx_quic_congestion_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4633 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4634 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4635 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4636 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4637
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4638 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4639 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4640 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4641
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4642 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4643 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4644
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4645 cg->in_flight -= f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4646
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4647 timer = f->last - cg->recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4648
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4649 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4650 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4651 "quic congestion ack recovery win:%uz, ss:%uz, if:%uz",
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4652 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4653
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4654 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4655 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4656
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4657 if (cg->window < cg->ssthresh) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4658 cg->window += f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4659
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4660 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4661 "quic congestion slow start win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4662 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4663
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4664 } else {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4665 cg->window += qc->tp.max_udp_payload_size * f->plen / cg->window;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4666
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4667 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4668 "quic congestion avoidance win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4669 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4670 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4671
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4672 /* prevent recovery_start from wrapping */
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4673
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4674 timer = cg->recovery_start - ngx_current_msec + qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4675
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4676 if ((ngx_msec_int_t) timer < 0) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4677 cg->recovery_start = ngx_current_msec - qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4678 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4679 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4680
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4681
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4682 static void
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4683 ngx_quic_congestion_lost(ngx_connection_t c, ngx_quic_frame_t f)
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4684 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4685 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4686 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4687 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4688
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4689 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4690 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4691 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4692
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4693 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4694 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4695
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4696 cg->in_flight -= f->plen;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4697
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4698 timer = f->last - cg->recovery_start;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4699
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4700 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4701 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4702 "quic congestion lost recovery win:%uz, ss:%uz, if:%uz",
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4703 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4704
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4705 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4706 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4707
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4708 cg->recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4709 cg->window /= 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4710
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	4711 if (cg->window < qc->tp.max_udp_payload_size * 2) {
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	4712 cg->window = qc->tp.max_udp_payload_size * 2;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4713 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4714
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4715 cg->ssthresh = cg->window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4716
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4717 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4718 "quic congestion lost win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4719 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4720 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4721
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4722
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4723 static void
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4724 ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4725 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4726 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4727
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4728 qc = c->quic;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4729
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4730 if (frame->data) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4731 ngx_free(frame->data);
8394 df18ae7161b8 Assorted fixes. Sergey Kandaurov <pluknet@nginx.com> parents: 8393 diff changeset	4732 frame->data = NULL;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4733 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4734
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4735 ngx_queue_insert_head(&qc->free_frames, &frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4736
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4737 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4738 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4739 "quic free frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4740 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4741 }

Mercurial > hg > nginx

annotate src/event/ngx_event_quic.c @ 8520:357b8afe915e quic