nginx: src/event/ngx_event

annotate src/event/ngx_event_quic.c @ 8561:b4ef79ef1c23 quic

QUIC: refined the "c->quic->initialized" flag usage. The flag is tied to the initial secret creation. The presence of c->quic pointer is sufficient to enable execution of ngx_quic_close_quic(). The ngx_quic_new_connection() function now returns the allocated quic connection object and the c->quic pointer is set by the caller. If an early error occurs before secrets initialization (i.e. in cases of invalid retry token or nginx exiting), it is still possible to generate an error response by trying to initialize secrets directly in the ngx_quic_send_cc() function. Before the change such early errors failed to send proper connection close message and logged an error. An auxilliary ngx_quic_init_secrets() function is introduced to avoid verbose call to ngx_quic_set_initial_secret() requiring local variable.

author	Vladimir Homutov <vl@nginx.com>
date	Wed, 30 Sep 2020 21:27:52 +0300
parents	d0d3fc0697a0
children	b31c02454539

rev	line source
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2 /*
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	3 * Copyright (C) Nginx, Inc.
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	4 */
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	5
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	6
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	7 #include <ngx_config.h>
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	8 #include <ngx_core.h>
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	9 #include <ngx_event.h>
8486 d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	10 #include <ngx_event_quic_transport.h>
d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	11 #include <ngx_event_quic_protection.h>
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	12
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	13
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	14 /* 0-RTT and 1-RTT data exist in the same packet number space,
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	15 * so we have 3 packet number spaces:
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	16 *
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	17 * 0 - Initial
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	18 * 1 - Handshake
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	19 * 2 - 0-RTT and 1-RTT
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	20 */
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	21 #define ngx_quic_get_send_ctx(qc, level) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	22 ((level) == ssl_encryption_initial) ? &((qc)->send_ctx[0]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	23 : (((level) == ssl_encryption_handshake) ? &((qc)->send_ctx[1]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	24 : &((qc)->send_ctx[2]))
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	25
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	26 #define NGX_QUIC_SEND_CTX_LAST (NGX_QUIC_ENCRYPTION_LAST - 1)
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	27
8314 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	28 #define NGX_QUIC_STREAMS_INC 16
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	29 #define NGX_QUIC_STREAMS_LIMIT (1ULL < 60)
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	30
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	31 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	32 * 7.4. Cryptographic Message Buffering
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	33 * Implementations MUST support buffering at least 4096 bytes of data
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	34 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	35 #define NGX_QUIC_MAX_BUFFERED 65535
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	36
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	37 #define NGX_QUIC_STREAM_GONE (void *) -1
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	38
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	39
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	40 typedef struct {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	41 ngx_rbtree_t tree;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	42 ngx_rbtree_node_t sentinel;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	43
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	44 uint64_t received;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	45 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	46 uint64_t recv_max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	47 uint64_t send_max_data;
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	48
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	49 uint64_t server_max_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	50 uint64_t server_max_streams_bidi;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	51 uint64_t server_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	52 uint64_t server_streams_bidi;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	53
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	54 uint64_t client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	55 uint64_t client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	56 uint64_t client_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	57 uint64_t client_streams_bidi;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	58 } ngx_quic_streams_t;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	59
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	60
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	61 typedef struct {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	62 size_t in_flight;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	63 size_t window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	64 size_t ssthresh;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	65 ngx_msec_t recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	66 } ngx_quic_congestion_t;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	67
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	68
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	69 /*
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	70 * 12.3. Packet Numbers
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	71 *
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	72 * Conceptually, a packet number space is the context in which a packet
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	73 * can be processed and acknowledged. Initial packets can only be sent
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	74 * with Initial packet protection keys and acknowledged in packets which
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	75 * are also Initial packets.
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	76 */
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	77 typedef struct {
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	78 ngx_quic_secret_t client_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	79 ngx_quic_secret_t server_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	80
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	81 uint64_t pnum; /* to be sent */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	82 uint64_t largest_ack; /* received from peer */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	83 uint64_t largest_pn; /* received from peer */
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	84
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	85 ngx_queue_t frames;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	86 ngx_queue_t sent;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	87 } ngx_quic_send_ctx_t;
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	88
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	89
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	90 struct ngx_quic_connection_s {
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	91 ngx_str_t scid; /* initial client ID */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	92 ngx_str_t dcid; /* server (our own) ID */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	93 ngx_str_t odcid; /* original server ID */
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	94 ngx_str_t token;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	95
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	96 ngx_queue_t client_ids;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	97 ngx_queue_t free_client_ids;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	98 ngx_uint_t nclient_ids;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	99 uint64_t max_retired_seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	100 uint64_t curr_seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	101
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	102 ngx_uint_t client_tp_done;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	103 ngx_quic_tp_t tp;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	104 ngx_quic_tp_t ctp;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	105
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	106 ngx_quic_send_ctx_t send_ctx[NGX_QUIC_SEND_CTX_LAST];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	107 ngx_quic_secrets_t keys[NGX_QUIC_ENCRYPTION_LAST];
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	108 ngx_quic_secrets_t next_key;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	109 ngx_quic_frames_stream_t crypto[NGX_QUIC_ENCRYPTION_LAST];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	110
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	111 ngx_quic_conf_t *conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	112
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	113 ngx_ssl_t *ssl;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	114
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	115 ngx_event_t push;
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	116 ngx_event_t pto;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	117 ngx_event_t close;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	118 ngx_queue_t free_frames;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	119 ngx_msec_t last_cc;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	120
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	121 ngx_msec_t latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	122 ngx_msec_t avg_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	123 ngx_msec_t min_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	124 ngx_msec_t rttvar;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	125
8518 f9b1a4e52597 QUIC: changed c->quic->pto_count type to ngx_uint_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8517 diff changeset	126 ngx_uint_t pto_count;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	127
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	128 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	129 ngx_uint_t nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	130 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	131
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	132 ngx_quic_streams_t streams;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	133 ngx_quic_congestion_t congestion;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	134 size_t received;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	135
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	136 ngx_uint_t error;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	137 enum ssl_encryption_level_t error_level;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	138 ngx_uint_t error_ftype;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	139 const char *error_reason;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	140
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	141 unsigned error_app:1;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	142 unsigned send_timer_set:1;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	143 unsigned closing:1;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	144 unsigned draining:1;
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	145 unsigned key_phase:1;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	146 unsigned in_retry:1;
8397 1245e274b9ba Avoided excessive definitions for connection state. Vladimir Homutov <vl@nginx.com> parents: 8394 diff changeset	147 unsigned initialized:1;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	148 unsigned validated:1;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	149 };
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	150
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	151
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	152 typedef struct {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	153 ngx_queue_t queue;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	154 uint64_t seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	155 size_t len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	156 u_char id[NGX_QUIC_CID_LEN_MAX];
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	157 u_char sr_token[NGX_QUIC_SRT_LEN];
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	158 } ngx_quic_client_id_t;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	159
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	160
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	161 typedef ngx_int_t (ngx_quic_frame_handler_pt)(ngx_connection_t c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	162 ngx_quic_frame_t frame, void data);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	163
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	164
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	165 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	166 static int ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	167 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	168 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	169 static int ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	170 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	171 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	172 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	173 static int ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	174 enum ssl_encryption_level_t level, const uint8_t *read_secret,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	175 const uint8_t *write_secret, size_t secret_len);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	176 #endif
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	177
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	178 static int ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	179 enum ssl_encryption_level_t level, const uint8_t *data, size_t len);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	180 static int ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	181 static int ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	182 enum ssl_encryption_level_t level, uint8_t alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	183
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	184
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	185 static ngx_quic_connection_t ngx_quic_new_connection(ngx_connection_t c,
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	186 ngx_ssl_t ssl, ngx_quic_conf_t conf, ngx_quic_header_t *pkt);
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	187 static ngx_int_t ngx_quic_negotiate_version(ngx_connection_t *c,
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	188 ngx_quic_header_t *inpkt);
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	189 static ngx_int_t ngx_quic_new_dcid(ngx_connection_t *c,
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	190 ngx_quic_connection_t qc, ngx_str_t odcid);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	191 static ngx_int_t ngx_quic_send_retry(ngx_connection_t *c);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	192 static ngx_int_t ngx_quic_new_token(ngx_connection_t c, ngx_str_t token);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	193 static ngx_int_t ngx_quic_validate_token(ngx_connection_t *c,
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	194 ngx_quic_header_t *pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	195 static ngx_int_t ngx_quic_init_connection(ngx_connection_t *c);
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	196 static ngx_inline size_t ngx_quic_max_udp_payload(ngx_connection_t *c);
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	197 static void ngx_quic_input_handler(ngx_event_t *rev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	198
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	199 static void ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	200 static ngx_int_t ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	201 static void ngx_quic_close_timer_handler(ngx_event_t *ev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	202 static ngx_int_t ngx_quic_close_streams(ngx_connection_t *c,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	203 ngx_quic_connection_t *qc);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	204
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	205 static ngx_int_t ngx_quic_input(ngx_connection_t c, ngx_buf_t b,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	206 ngx_ssl_t ssl, ngx_quic_conf_t conf);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	207 static ngx_int_t ngx_quic_process_packet(ngx_connection_t c, ngx_ssl_t ssl,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	208 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	209 static ngx_int_t ngx_quic_init_secrets(ngx_connection_t *c);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	210 static void ngx_quic_discard_ctx(ngx_connection_t *c,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	211 enum ssl_encryption_level_t level);
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	212 static ngx_int_t ngx_quic_check_peer(ngx_quic_connection_t *qc,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	213 ngx_quic_header_t *pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	214 static ngx_int_t ngx_quic_payload_handler(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	215 ngx_quic_header_t *pkt);
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	216 static ngx_int_t ngx_quic_send_ack(ngx_connection_t c, ngx_quic_header_t pkt);
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	217 static ngx_int_t ngx_quic_ack_delay(ngx_connection_t *c,
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	218 struct timeval *received, enum ssl_encryption_level_t level);
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	219 static ngx_int_t ngx_quic_send_cc(ngx_connection_t *c);
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	220 static ngx_int_t ngx_quic_send_new_token(ngx_connection_t *c);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	221
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	222 static ngx_int_t ngx_quic_handle_ack_frame(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	223 ngx_quic_header_t pkt, ngx_quic_ack_frame_t f);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	224 static ngx_int_t ngx_quic_handle_ack_frame_range(ngx_connection_t *c,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	225 ngx_quic_send_ctx_t *ctx, uint64_t min, uint64_t max,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	226 ngx_msec_t *send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	227 static void ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	228 enum ssl_encryption_level_t level, ngx_msec_t send_time);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	229 static ngx_inline ngx_msec_t ngx_quic_pto(ngx_connection_t *c,
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	230 ngx_quic_send_ctx_t *ctx);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	231 static void ngx_quic_handle_stream_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	232 ngx_quic_frame_t *f);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	233
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	234 static ngx_int_t ngx_quic_handle_ordered_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	235 ngx_quic_frames_stream_t fs, ngx_quic_frame_t frame,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	236 ngx_quic_frame_handler_pt handler, void *data);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	237 static ngx_int_t ngx_quic_adjust_frame_offset(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	238 ngx_quic_frame_t *f, uint64_t offset_in);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	239 static ngx_int_t ngx_quic_buffer_frame(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	240 ngx_quic_frames_stream_t stream, ngx_quic_frame_t f);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	241
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	242 static ngx_int_t ngx_quic_handle_crypto_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	243 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	244 static ngx_int_t ngx_quic_crypto_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	245 ngx_quic_frame_t frame, void data);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	246 static ngx_int_t ngx_quic_handle_stream_frame(ngx_connection_t *c,
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	247 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	248 static ngx_int_t ngx_quic_stream_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	249 ngx_quic_frame_t frame, void data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	250
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	251 static ngx_int_t ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	252 ngx_quic_max_data_frame_t *f);
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	253 static ngx_int_t ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	254 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	255 static ngx_int_t ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	256 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f);
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	257 static ngx_int_t ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	258 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	259 static ngx_int_t ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	260 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	261 static ngx_int_t ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	262 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f);
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	263 static ngx_int_t ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	264 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f);
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	265 static ngx_int_t ngx_quic_handle_path_challenge_frame(ngx_connection_t *c,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	266 ngx_quic_header_t pkt, ngx_quic_path_challenge_frame_t f);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	267 static ngx_int_t ngx_quic_handle_new_connection_id_frame(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	268 ngx_quic_header_t pkt, ngx_quic_new_conn_id_frame_t f);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	269 static ngx_int_t ngx_quic_retire_connection_id(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	270 enum ssl_encryption_level_t level, uint64_t seqnum);
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	271 static ngx_quic_client_id_t ngx_quic_alloc_connection_id(ngx_connection_t c,
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	272 ngx_quic_connection_t *qc);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	273
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	274 static void ngx_quic_queue_frame(ngx_quic_connection_t *qc,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	275 ngx_quic_frame_t *frame);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	276
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	277 static ngx_int_t ngx_quic_output(ngx_connection_t *c);
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	278 static ngx_int_t ngx_quic_output_frames(ngx_connection_t *c,
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	279 ngx_quic_send_ctx_t *ctx);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	280 static void ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames);
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	281 static ngx_int_t ngx_quic_send_frames(ngx_connection_t *c,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	282 ngx_quic_send_ctx_t ctx, ngx_queue_t frames);
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	283
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	284 static void ngx_quic_set_packet_number(ngx_quic_header_t *pkt,
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	285 ngx_quic_send_ctx_t *ctx);
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	286 static void ngx_quic_pto_handler(ngx_event_t *ev);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	287 static void ngx_quic_lost_handler(ngx_event_t *ev);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	288 static ngx_int_t ngx_quic_detect_lost(ngx_connection_t *c);
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	289 static void ngx_quic_resend_frames(ngx_connection_t *c,
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	290 ngx_quic_send_ctx_t *ctx);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	291 static void ngx_quic_push_handler(ngx_event_t *ev);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	292
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	293 static void ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	294 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	295 static ngx_quic_stream_t ngx_quic_find_stream(ngx_rbtree_t rbtree,
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	296 uint64_t id);
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	297 static ngx_quic_stream_t ngx_quic_create_client_stream(ngx_connection_t c,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	298 uint64_t id);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	299 static ngx_quic_stream_t ngx_quic_create_stream(ngx_connection_t c,
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	300 uint64_t id, size_t rcvbuf_size);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	301 static ssize_t ngx_quic_stream_recv(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	302 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	303 static ssize_t ngx_quic_stream_send(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	304 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	305 static ngx_chain_t ngx_quic_stream_send_chain(ngx_connection_t c,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	306 ngx_chain_t *in, off_t limit);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	307 static size_t ngx_quic_max_stream_frame(ngx_quic_connection_t *qc);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	308 static size_t ngx_quic_max_stream_flow(ngx_connection_t *c);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	309 static void ngx_quic_stream_cleanup_handler(void *data);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	310 static ngx_quic_frame_t ngx_quic_alloc_frame(ngx_connection_t c, size_t size);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	311 static void ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	312
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	313 static void ngx_quic_congestion_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	314 ngx_quic_frame_t *frame);
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	315 static void ngx_quic_congestion_lost(ngx_connection_t *c,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	316 ngx_quic_frame_t *frame);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	317
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	318
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	319 static SSL_QUIC_METHOD quic_method = {
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	320 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	321 ngx_quic_set_read_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	322 ngx_quic_set_write_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	323 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	324 ngx_quic_set_encryption_secrets,
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	325 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	326 ngx_quic_add_handshake_data,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	327 ngx_quic_flush_flight,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	328 ngx_quic_send_alert,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	329 };
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	330
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	331
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	332 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	333
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	334 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	335 ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	336 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	337 const uint8_t *rsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	338 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	339 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	340 ngx_quic_secrets_t *keys;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	341
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	342 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	343
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	344 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	345 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	346 "quic ngx_quic_set_read_secret() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	347 ngx_quic_hexdump(c->log, "quic read secret", rsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	348 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	349
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	350 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	351
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	352 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	353 rsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	354 &keys->client);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	355 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	356
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	357
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	358 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	359 ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	360 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	361 const uint8_t *wsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	362 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	363 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	364 ngx_quic_secrets_t *keys;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	365
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	366 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	367
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	368 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	369 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	370 "quic ngx_quic_set_write_secret() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	371 ngx_quic_hexdump(c->log, "quic write secret", wsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	372 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	373
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	374 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	375
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	376 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	377 wsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	378 &keys->server);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	379 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	380
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	381 #else
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	382
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	383 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	384 ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	385 enum ssl_encryption_level_t level, const uint8_t *rsecret,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	386 const uint8_t *wsecret, size_t secret_len)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	387 {
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	388 ngx_int_t rc;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	389 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	390 ngx_quic_secrets_t *keys;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	391
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	392 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	393
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	394 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	395 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	396 "quic ngx_quic_set_encryption_secrets() level:%d", level);
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	397 ngx_quic_hexdump(c->log, "quic read", rsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	398 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	399
8327 0ae50d90658a Fixed build with OpenSSL using old callbacks API. Sergey Kandaurov <pluknet@nginx.com> parents: 8326 diff changeset	400 keys = &c->quic->keys[level];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	401
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	402 rc = ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	403 rsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	404 &keys->client);
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	405 if (rc != 1) {
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	406 return rc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	407 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	408
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	409 if (level == ssl_encryption_early_data) {
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	410 return 1;
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	411 }
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	412
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	413 #ifdef NGX_QUIC_DEBUG_CRYPTO
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	414 ngx_quic_hexdump(c->log, "quic write", wsecret, secret_len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	415 #endif
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	416
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	417 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	418 wsecret, secret_len,
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	419 &keys->server);
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	420 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	421
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	422 #endif
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	423
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	424
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	425 static int
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	426 ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	427 enum ssl_encryption_level_t level, const uint8_t *data, size_t len)
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	428 {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	429 u_char p, end;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	430 size_t client_params_len, fsize, limit;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	431 const uint8_t *client_params;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	432 ngx_quic_frame_t *frame;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	433 ngx_connection_t *c;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	434 ngx_quic_connection_t *qc;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	435 ngx_quic_frames_stream_t *fs;
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	436
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	437 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	438 qc = c->quic;
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	439
8186 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 8185 diff changeset	440 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	441 "quic ngx_quic_add_handshake_data");
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	442
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	443 if (!qc->client_tp_done) {
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	444 /*
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	445 * things to do once during handshake: check ALPN and transport
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	446 * parameters; we want to break handshake if something is wrong
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	447 * here;
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	448 */
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	449
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	450 #if defined(TLSEXT_TYPE_application_layer_protocol_negotiation)
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	451 if (qc->conf->require_alpn) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	452 unsigned int len;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	453 const unsigned char *data;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	454
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	455 SSL_get0_alpn_selected(c->ssl->connection, &data, &len);
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	456
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	457 if (len == 0) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	458 qc->error = 0x100 + SSL_AD_NO_APPLICATION_PROTOCOL;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	459 qc->error_reason = "unsupported protocol in ALPN extension";
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	460
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	461 ngx_log_error(NGX_LOG_INFO, c->log, 0,
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	462 "quic unsupported protocol in ALPN extension");
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	463 return 0;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	464 }
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	465 }
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	466 #endif
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	467
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	468 SSL_get_peer_quic_transport_params(ssl_conn, &client_params,
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	469 &client_params_len);
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	470
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	471 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	472 "quic SSL_get_peer_quic_transport_params():"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	473 " params_len %ui", client_params_len);
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	474
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	475 if (client_params_len == 0) {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	476 /* quic-tls 8.2 */
8447 97adb87f149b Get rid of hardcoded numbers used for quic handshake errors. Sergey Kandaurov <pluknet@nginx.com> parents: 8446 diff changeset	477 qc->error = NGX_QUIC_ERR_CRYPTO(SSL_AD_MISSING_EXTENSION);
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	478 qc->error_reason = "missing transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	479
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	480 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	481 "missing transport parameters");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	482 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	483 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	484
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	485 p = (u_char *) client_params;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	486 end = p + client_params_len;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	487
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	488 if (ngx_quic_parse_transport_params(p, end, &qc->ctp, c->log)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	489 != NGX_OK)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	490 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	491 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	492 qc->error_reason = "failed to process transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	493
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	494 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	495 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	496
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	497 if (qc->ctp.max_idle_timeout > 0
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	498 && qc->ctp.max_idle_timeout < qc->tp.max_idle_timeout)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	499 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	500 qc->tp.max_idle_timeout = qc->ctp.max_idle_timeout;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	501 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	502
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	503 if (qc->ctp.max_udp_payload_size < NGX_QUIC_MIN_INITIAL_SIZE
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	504 \|\| qc->ctp.max_udp_payload_size > NGX_QUIC_MAX_UDP_PAYLOAD_SIZE)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	505 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	506 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	507 qc->error_reason = "invalid maximum packet size";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	508
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	509 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	510 "quic maximum packet size is invalid");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	511 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	512 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	513
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	514 if (qc->ctp.max_udp_payload_size > ngx_quic_max_udp_payload(c)) {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	515 qc->ctp.max_udp_payload_size = ngx_quic_max_udp_payload(c);
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	516 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	517 "quic client maximum packet size truncated");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	518 }
8432 391d06a51bc0 Limited max udp payload size for outgoing packets. Vladimir Homutov <vl@nginx.com> parents: 8431 diff changeset	519
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	520 #if (NGX_QUIC_DRAFT_VERSION >= 28)
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	521 if (qc->scid.len != qc->ctp.initial_scid.len
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	522 \|\| ngx_memcmp(qc->scid.data, qc->ctp.initial_scid.data,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	523 qc->scid.len) != 0)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	524 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	525 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	526 "quic client initial_source_connection_id "
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	527 "mismatch");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	528 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	529 }
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	530 #endif
6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	531
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	532 qc->streams.server_max_streams_bidi = qc->ctp.initial_max_streams_bidi;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	533 qc->streams.server_max_streams_uni = qc->ctp.initial_max_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	534
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	535 qc->client_tp_done = 1;
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	536 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	537
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	538 /*
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	539 * we need to fit at least 1 frame into a packet, thus account head/tail;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	540 * 17 = 1 + 8x2 is max header for CRYPTO frame, with 1 byte for frame type
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	541 */
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	542 limit = qc->ctp.max_udp_payload_size - NGX_QUIC_MAX_LONG_HEADER - 17
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	543 - EVP_GCM_TLS_TAG_LEN;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	544
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	545 fs = &qc->crypto[level];
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	546
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	547 p = (u_char *) data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	548 end = (u_char *) data + len;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	549
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	550 while (p < end) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	551
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	552 fsize = ngx_min(limit, (size_t) (end - p));
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	553
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	554 frame = ngx_quic_alloc_frame(c, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	555 if (frame == NULL) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	556 return 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	557 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	558
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	559 ngx_memcpy(frame->data, p, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	560
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	561 frame->level = level;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	562 frame->type = NGX_QUIC_FT_CRYPTO;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	563 frame->u.crypto.offset = fs->sent;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	564 frame->u.crypto.length = fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	565 frame->u.crypto.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	566
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	567 fs->sent += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	568 p += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	569
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	570 ngx_sprintf(frame->info, "crypto, generated by SSL len=%ui level=%d",
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	571 fsize, level);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	572
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	573 ngx_quic_queue_frame(qc, frame);
8186 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 8185 diff changeset	574 }
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	575
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	576 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	577 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	578
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	579
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	580 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	581 ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	582 {
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	583 #if (NGX_DEBUG)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	584 ngx_connection_t *c;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	585
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	586 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	587
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	588 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	589 "quic ngx_quic_flush_flight()");
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	590 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	591 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	592 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	593
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	594
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	595 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	596 ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn, enum ssl_encryption_level_t level,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	597 uint8_t alert)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	598 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	599 ngx_connection_t *c;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	600 ngx_quic_connection_t *qc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	601
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	602 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	603
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	604 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	605 "quic ngx_quic_send_alert(), lvl=%d, alert=%d",
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	606 (int) level, (int) alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	607
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	608 qc = c->quic;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	609 if (qc == NULL) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	610 return 1;
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	611 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	612
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	613 qc->error_level = level;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	614 qc->error = NGX_QUIC_ERR_CRYPTO(alert);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	615 qc->error_reason = "TLS alert";
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	616 qc->error_app = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	617 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	618
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	619 if (ngx_quic_send_cc(c) != NGX_OK) {
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	620 return 0;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	621 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	622
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	623 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	624 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	625
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	626
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	627 void
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	628 ngx_quic_run(ngx_connection_t c, ngx_ssl_t ssl, ngx_quic_conf_t *conf)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	629 {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	630 ngx_int_t rc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	631
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	632 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic run");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	633
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	634 c->log->action = "QUIC initialization";
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	635
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	636 rc = ngx_quic_input(c, c->buffer, ssl, conf);
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	637 if (rc != NGX_OK) {
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	638 ngx_quic_close_connection(c, rc == NGX_DECLINED ? NGX_DONE : NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	639 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	640 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	641
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	642 ngx_add_timer(c->read, c->quic->in_retry ? NGX_QUIC_RETRY_TIMEOUT
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	643 : c->quic->tp.max_idle_timeout);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	644
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	645 c->read->handler = ngx_quic_input_handler;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	646
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	647 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	648 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	649
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	650
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	651 static ngx_quic_connection_t *
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	652 ngx_quic_new_connection(ngx_connection_t c, ngx_ssl_t ssl,
8483 2da9c4fddd44 QUIC: eliminated connection handler argument in ngx_quic_run(). Roman Arutyunyan <arut@nginx.com> parents: 8482 diff changeset	653 ngx_quic_conf_t conf, ngx_quic_header_t pkt)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	654 {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	655 ngx_uint_t i;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	656 ngx_quic_tp_t *ctp;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	657 ngx_quic_client_id_t *cid;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	658 ngx_quic_connection_t *qc;
8387 eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	659
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	660 c->log->action = "creating new quic connection";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	661
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	662 qc = ngx_pcalloc(c->pool, sizeof(ngx_quic_connection_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	663 if (qc == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	664 return NULL;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	665 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	666
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	667 ngx_rbtree_init(&qc->streams.tree, &qc->streams.sentinel,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	668 ngx_quic_rbtree_insert_stream);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	669
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	670 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	671 ngx_queue_init(&qc->send_ctx[i].frames);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	672 ngx_queue_init(&qc->send_ctx[i].sent);
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	673 qc->send_ctx[i].largest_pn = (uint64_t) -1;
8512 6e1c88f82280 QUIC: changed ctx->largest_ack initial value to type maximum. Sergey Kandaurov <pluknet@nginx.com> parents: 8509 diff changeset	674 qc->send_ctx[i].largest_ack = (uint64_t) -1;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	675 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	676
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	677 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	678 ngx_queue_init(&qc->crypto[i].frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	679 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	680
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	681 ngx_queue_init(&qc->free_frames);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	682 ngx_queue_init(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	683 ngx_queue_init(&qc->free_client_ids);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	684
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	685 qc->avg_rtt = NGX_QUIC_INITIAL_RTT;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	686 qc->rttvar = NGX_QUIC_INITIAL_RTT / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	687 qc->min_rtt = NGX_TIMER_INFINITE;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	688
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	689 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	690 * qc->latest_rtt = 0
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	691 * qc->nclient_ids = 0
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	692 * qc->max_retired_seqnum = 0
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	693 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	694
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	695 qc->received = pkt->raw->last - pkt->raw->start;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	696
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	697 qc->pto.log = c->log;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	698 qc->pto.data = c;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	699 qc->pto.handler = ngx_quic_pto_handler;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	700 qc->pto.cancelable = 1;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	701
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	702 qc->push.log = c->log;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	703 qc->push.data = c;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	704 qc->push.handler = ngx_quic_push_handler;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	705 qc->push.cancelable = 1;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	706
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	707 qc->ssl = ssl;
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	708 qc->conf = conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	709 qc->tp = conf->tp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	710
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	711 ctp = &qc->ctp;
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	712 ctp->max_udp_payload_size = ngx_quic_max_udp_payload(c);
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	713 ctp->ack_delay_exponent = NGX_QUIC_DEFAULT_ACK_DELAY_EXPONENT;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	714 ctp->max_ack_delay = NGX_QUIC_DEFAULT_MAX_ACK_DELAY;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	715
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	716 qc->streams.recv_max_data = qc->tp.initial_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	717
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	718 qc->streams.client_max_streams_uni = qc->tp.initial_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	719 qc->streams.client_max_streams_bidi = qc->tp.initial_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	720
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	721 qc->congestion.window = ngx_min(10 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	722 ngx_max(2 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	723 14720));
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	724 qc->congestion.ssthresh = NGX_MAX_SIZE_T_VALUE;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	725 qc->congestion.recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	726
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	727 if (ngx_quic_new_dcid(c, qc, &pkt->dcid) != NGX_OK) {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	728 return NULL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	729 }
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	730
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	731 #if (NGX_QUIC_DRAFT_VERSION >= 28)
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	732 qc->tp.original_dcid = qc->odcid;
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	733 #endif
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	734 qc->tp.initial_scid = qc->dcid;
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	735
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	736 qc->scid.len = pkt->scid.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	737 qc->scid.data = ngx_pnalloc(c->pool, qc->scid.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	738 if (qc->scid.data == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	739 return NULL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	740 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	741 ngx_memcpy(qc->scid.data, pkt->scid.data, qc->scid.len);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	742
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	743 cid = ngx_quic_alloc_connection_id(c, qc);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	744 if (cid == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	745 return NULL;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	746 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	747
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	748 cid->seqnum = 0;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	749 cid->len = pkt->scid.len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	750 ngx_memcpy(cid->id, pkt->scid.data, pkt->scid.len);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	751
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	752 ngx_queue_insert_tail(&qc->client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	753 qc->nclient_ids++;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	754 qc->curr_seqnum = 0;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	755
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	756 return qc;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	757 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	758
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	759
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	760 static ngx_int_t
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	761 ngx_quic_negotiate_version(ngx_connection_t c, ngx_quic_header_t inpkt)
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	762 {
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	763 size_t len;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	764 ngx_quic_header_t pkt;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	765
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	766 /* buffer size is calculated assuming a single supported version */
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	767 static u_char buf[NGX_QUIC_MAX_LONG_HEADER + sizeof(uint32_t)];
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	768
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	769 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	770 "sending version negotiation packet");
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	771
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	772 pkt.log = c->log;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	773 pkt.flags = NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_FIXED_BIT;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	774 pkt.dcid = inpkt->scid;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	775 pkt.scid = inpkt->dcid;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	776
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	777 len = ngx_quic_create_version_negotiation(&pkt, buf);
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	778
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	779 #ifdef NGX_QUIC_DEBUG_PACKETS
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	780 ngx_quic_hexdump(c->log, "quic vnego packet to send", buf, len);
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	781 #endif
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	782
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	783 (void) c->send(c, buf, len);
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	784
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	785 return NGX_ERROR;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	786 }
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	787
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	788
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	789 static ngx_int_t
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	790 ngx_quic_new_dcid(ngx_connection_t c, ngx_quic_connection_t qc,
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	791 ngx_str_t *odcid)
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	792 {
8557 2727d402e5a5 QUIC: switched to using fixed-length server connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8556 diff changeset	793 qc->dcid.len = NGX_QUIC_SERVER_CID_LEN;
2727d402e5a5 QUIC: switched to using fixed-length server connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8556 diff changeset	794 qc->dcid.data = ngx_pnalloc(c->pool, NGX_QUIC_SERVER_CID_LEN);
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	795 if (qc->dcid.data == NULL) {
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	796 return NGX_ERROR;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	797 }
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	798
8557 2727d402e5a5 QUIC: switched to using fixed-length server connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8556 diff changeset	799 if (RAND_bytes(qc->dcid.data, NGX_QUIC_SERVER_CID_LEN) != 1) {
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	800 return NGX_ERROR;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	801 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	802
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	803 #ifdef NGX_QUIC_DEBUG_PACKETS
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	804 ngx_quic_hexdump(c->log, "quic server CID", qc->dcid.data, qc->dcid.len);
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	805 #endif
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	806
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	807 qc->odcid.len = odcid->len;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	808 qc->odcid.data = ngx_pstrdup(c->pool, odcid);
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	809 if (qc->odcid.data == NULL) {
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	810 return NGX_ERROR;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	811 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	812
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	813 return NGX_OK;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	814 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	815
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	816
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	817 static ngx_int_t
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	818 ngx_quic_send_retry(ngx_connection_t *c)
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	819 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	820 ssize_t len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	821 ngx_str_t res, token;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	822 ngx_quic_header_t pkt;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	823 u_char buf[NGX_QUIC_RETRY_BUFFER_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	824
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	825 if (ngx_quic_new_token(c, &token) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	826 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	827 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	828
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	829 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	830 pkt.flags = NGX_QUIC_PKT_FIXED_BIT \| NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_RETRY;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	831 pkt.log = c->log;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	832 pkt.odcid = c->quic->odcid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	833 pkt.dcid = c->quic->scid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	834 pkt.scid = c->quic->dcid;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	835 pkt.token = token;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	836
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	837 res.data = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	838
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	839 if (ngx_quic_encrypt(&pkt, NULL, &res) != NGX_OK) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	840 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	841 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	842
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	843 #ifdef NGX_QUIC_DEBUG_PACKETS
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	844 ngx_quic_hexdump(c->log, "quic packet to send", res.data, res.len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	845 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	846
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	847 len = c->send(c, res.data, res.len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	848 if (len == NGX_ERROR \|\| (size_t) len != res.len) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	849 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	850 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	851
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	852 c->quic->token = token;
8421 c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	853 #if (NGX_QUIC_DRAFT_VERSION < 28)
c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	854 c->quic->tp.original_dcid = c->quic->odcid;
c206233d9c29 Fixed transport parameters on a new connection with a valid token. Sergey Kandaurov <pluknet@nginx.com> parents: 8417 diff changeset	855 #endif
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	856 c->quic->tp.retry_scid = c->quic->dcid;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	857 c->quic->in_retry = 1;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	858
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	859 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	860 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	861
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	862
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	863 static ngx_int_t
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	864 ngx_quic_new_token(ngx_connection_t c, ngx_str_t token)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	865 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	866 int len, iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	867 u_char data, p, key, iv;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	868 ngx_msec_t now;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	869 EVP_CIPHER_CTX *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	870 const EVP_CIPHER *cipher;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	871 struct sockaddr_in *sin;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	872 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	873 struct sockaddr_in6 *sin6;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	874 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	875 u_char in[NGX_QUIC_MAX_TOKEN_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	876
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	877 switch (c->sockaddr->sa_family) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	878
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	879 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	880 case AF_INET6:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	881 sin6 = (struct sockaddr_in6 *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	882
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	883 len = sizeof(struct in6_addr);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	884 data = sin6->sin6_addr.s6_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	885
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	886 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	887 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	888
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	889 #if (NGX_HAVE_UNIX_DOMAIN)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	890 case AF_UNIX:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	891
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	892 len = ngx_min(c->addr_text.len, NGX_QUIC_MAX_TOKEN_SIZE - sizeof(now));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	893 data = c->addr_text.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	894
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	895 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	896 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	897
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	898 default: /* AF_INET */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	899 sin = (struct sockaddr_in *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	900
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	901 len = sizeof(in_addr_t);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	902 data = (u_char *) &sin->sin_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	903
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	904 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	905 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	906
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	907 p = ngx_cpymem(in, data, len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	908
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	909 now = ngx_current_msec;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	910 len += sizeof(now);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	911 ngx_memcpy(p, &now, sizeof(now));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	912
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	913 cipher = EVP_aes_256_cbc();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	914 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	915
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	916 token->len = iv_len + len + EVP_CIPHER_block_size(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	917 token->data = ngx_pnalloc(c->pool, token->len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	918 if (token->data == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	919 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	920 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	921
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	922 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	923 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	924 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	925 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	926
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	927 key = c->quic->conf->token_key;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	928 iv = token->data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	929
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	930 if (RAND_bytes(iv, iv_len) <= 0
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	931 \|\| !EVP_EncryptInit_ex(ctx, cipher, NULL, key, iv))
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	932 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	933 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	934 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	935 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	936
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	937 token->len = iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	938
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	939 if (EVP_EncryptUpdate(ctx, token->data + token->len, &len, in, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	940 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	941 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	942 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	943
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	944 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	945
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	946 if (EVP_EncryptFinal_ex(ctx, token->data + token->len, &len) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	947 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	948 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	949 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	950
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	951 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	952
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	953 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	954
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	955 #ifdef NGX_QUIC_DEBUG_PACKETS
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	956 ngx_quic_hexdump(c->log, "quic new token", token->data, token->len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	957 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	958
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	959 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	960 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	961
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	962
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	963 static ngx_int_t
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	964 ngx_quic_validate_token(ngx_connection_t c, ngx_quic_header_t pkt)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	965 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	966 int len, tlen, iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	967 u_char key, iv, p, data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	968 ngx_msec_t msec;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	969 EVP_CIPHER_CTX *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	970 const EVP_CIPHER *cipher;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	971 struct sockaddr_in *sin;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	972 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	973 struct sockaddr_in6 *sin6;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	974 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	975 ngx_quic_connection_t *qc;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	976 u_char tdec[NGX_QUIC_MAX_TOKEN_SIZE];
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	977
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	978 qc = c->quic;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	979
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	980 /* Retry token */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	981
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	982 if (qc->token.len) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	983 if (pkt->token.len != qc->token.len) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	984 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	985 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	986
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	987 if (ngx_memcmp(pkt->token.data, qc->token.data, pkt->token.len) != 0) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	988 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	989 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	990
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	991 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	992 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	993
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	994 /* NEW_TOKEN in a previous connection */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	995
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	996 cipher = EVP_aes_256_cbc();
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	997 key = c->quic->conf->token_key;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	998 iv = pkt->token.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	999 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1000
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1001 /* sanity checks */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1002
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1003 if (pkt->token.len < (size_t) iv_len + EVP_CIPHER_block_size(cipher)) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1004 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1005 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1006
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1007 if (pkt->token.len > (size_t) iv_len + NGX_QUIC_MAX_TOKEN_SIZE) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1008 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1009 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1010
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1011 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1012 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1013 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1014 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1015
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1016 if (!EVP_DecryptInit_ex(ctx, cipher, NULL, key, iv)) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1017 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1018 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1019 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1020
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1021 p = pkt->token.data + iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1022 len = pkt->token.len - iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1023
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1024 if (EVP_DecryptUpdate(ctx, tdec, &len, p, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1025 EVP_CIPHER_CTX_free(ctx);
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1026 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1027 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1028
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1029 if (EVP_DecryptFinal_ex(ctx, tdec + len, &tlen) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1030 EVP_CIPHER_CTX_free(ctx);
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1031 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1032 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1033
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1034 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1035
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1036 switch (c->sockaddr->sa_family) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1037
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1038 #if (NGX_HAVE_INET6)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1039 case AF_INET6:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1040 sin6 = (struct sockaddr_in6 *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1041
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1042 len = sizeof(struct in6_addr);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1043 data = sin6->sin6_addr.s6_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1044
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1045 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1046 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1047
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1048 #if (NGX_HAVE_UNIX_DOMAIN)
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1049 case AF_UNIX:
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1050
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1051 len = ngx_min(c->addr_text.len, NGX_QUIC_MAX_TOKEN_SIZE - sizeof(msec));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1052 data = c->addr_text.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1053
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1054 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1055 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1056
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1057 default: /* AF_INET */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1058 sin = (struct sockaddr_in *) c->sockaddr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1059
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1060 len = sizeof(in_addr_t);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1061 data = (u_char *) &sin->sin_addr;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1062
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1063 break;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1064 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1065
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1066 if (ngx_memcmp(tdec, data, len) != 0) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1067 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1068 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1069
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1070 ngx_memcpy(&msec, tdec + len, sizeof(msec));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1071
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1072 if (ngx_current_msec - msec > NGX_QUIC_RETRY_LIFETIME) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1073 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic expired token");
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1074 return NGX_DECLINED;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1075 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1076
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1077 return NGX_OK;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1078
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1079 bad_token:
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1080
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1081 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic invalid token");
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1082
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1083 qc->error = NGX_QUIC_ERR_INVALID_TOKEN;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1084 qc->error_reason = "invalid_token";
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1085
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1086 return NGX_ERROR;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1087 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1088
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1089
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1090 static ngx_int_t
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	1091 ngx_quic_init_connection(ngx_connection_t *c)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1092 {
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1093 u_char *p;
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1094 size_t clen;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1095 ssize_t len;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1096 ngx_ssl_conn_t *ssl_conn;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1097 ngx_quic_connection_t *qc;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1098
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1099 qc = c->quic;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1100
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1101 if (ngx_ssl_create_connection(qc->ssl, c, NGX_SSL_BUFFER) != NGX_OK) {
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1102 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1103 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1104
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1105 ssl_conn = c->ssl->connection;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1106
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1107 if (SSL_set_quic_method(ssl_conn, &quic_method) == 0) {
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1108 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1109 "quic SSL_set_quic_method() failed");
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1110 return NGX_ERROR;
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1111 }
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1112
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1113 #ifdef SSL_READ_EARLY_DATA_SUCCESS
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1114 if (SSL_CTX_get_max_early_data(qc->ssl->ctx)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1115 SSL_set_quic_early_data_enabled(ssl_conn, 1);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1116 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1117 #endif
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1118
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1119 len = ngx_quic_create_transport_params(NULL, NULL, &qc->tp, &clen);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1120 /* always succeeds */
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1121
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1122 p = ngx_pnalloc(c->pool, len);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1123 if (p == NULL) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1124 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1125 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1126
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1127 len = ngx_quic_create_transport_params(p, p + len, &qc->tp, NULL);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1128 if (len < 0) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1129 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1130 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1131
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1132 #ifdef NGX_QUIC_DEBUG_PACKETS
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	1133 ngx_quic_hexdump(c->log, "quic transport parameters", p, len);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1134 #endif
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1135
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1136 if (SSL_set_quic_transport_params(ssl_conn, p, len) == 0) {
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1137 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1138 "quic SSL_set_quic_transport_params() failed");
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1139 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1140 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1141
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1142 #if NGX_OPENSSL_QUIC_ZRTT_CTX
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1143 if (SSL_set_quic_early_data_context(ssl_conn, p, clen) == 0) {
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1144 ngx_log_error(NGX_LOG_INFO, c->log, 0,
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1145 "quic SSL_set_quic_early_data_context() failed");
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1146 return NGX_ERROR;
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1147 }
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1148 #endif
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1149
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1150 return NGX_OK;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1151 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1152
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1153
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1154 static ngx_inline size_t
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1155 ngx_quic_max_udp_payload(ngx_connection_t *c)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1156 {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1157 /* TODO: path MTU discovery */
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1158
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1159 #if (NGX_HAVE_INET6)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1160 if (c->sockaddr->sa_family == AF_INET6) {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1161 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT6;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1162 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1163 #endif
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1164
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1165 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1166 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1167
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1168
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1169 static void
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1170 ngx_quic_input_handler(ngx_event_t *rev)
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1171 {
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1172 ssize_t n;
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1173 ngx_int_t rc;
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1174 ngx_buf_t b;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1175 ngx_connection_t *c;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1176 ngx_quic_connection_t *qc;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1177 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1178
8394 df18ae7161b8 Assorted fixes. Sergey Kandaurov <pluknet@nginx.com> parents: 8393 diff changeset	1179 ngx_memzero(&b, sizeof(ngx_buf_t));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1180 b.start = buf;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1181 b.end = buf + sizeof(buf);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1182 b.pos = b.last = b.start;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1183 b.memory = 1;
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1184
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1185 c = rev->data;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1186 qc = c->quic;
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1187
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1188 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, rev->log, 0, "quic input handler");
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1189
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1190 if (rev->timedout) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1191 ngx_log_error(NGX_LOG_INFO, c->log, NGX_ETIMEDOUT,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1192 "quic client timed out");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1193 ngx_quic_close_connection(c, NGX_DONE);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1194 return;
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1195 }
e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1196
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1197 if (c->close) {
8442 b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1198 qc->error_reason = "graceful shutdown";
b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1199 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1200 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1201 }
8220 7ada2feeac18 Added processing of CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8218 diff changeset	1202
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1203 n = c->recv(c, b.start, b.end - b.start);
8215 38c0898b6df7 HTTP/3. Roman Arutyunyan <arut@nginx.com> parents: 8214 diff changeset	1204
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1205 if (n == NGX_AGAIN) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1206 if (qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1207 ngx_quic_close_connection(c, NGX_OK);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1208 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1209 return;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1210 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1211
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1212 if (n == NGX_ERROR) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1213 c->read->eof = 1;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1214 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1215 return;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1216 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1217
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1218 b.last += n;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1219 qc->received += n;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1220
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1221 rc = ngx_quic_input(c, &b, NULL, NULL);
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1222
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1223 if (rc == NGX_ERROR) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1224 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1225 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1226 }
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1227
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1228 if (rc == NGX_DECLINED) {
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1229 return;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1230 }
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1231
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1232 /* rc == NGX_OK */
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1233
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1234 qc->send_timer_set = 0;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1235 ngx_add_timer(rev, qc->tp.max_idle_timeout);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1236 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1237
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1238
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1239 static void
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1240 ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc)
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1241 {
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1242 ngx_pool_t *pool;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1243
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1244 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1245 "quic ngx_quic_close_connection, rc: %i", rc);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1246
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1247 if (!c->quic) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1248 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1249 "quic close connection early error");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1250
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1251 } else if (ngx_quic_close_quic(c, rc) == NGX_AGAIN) {
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1252 return;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1253 }
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1254
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1255 if (c->ssl) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1256 (void) ngx_ssl_shutdown(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1257 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1258
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1259 if (c->read->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1260 ngx_del_timer(c->read);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1261 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1262
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1263 #if (NGX_STAT_STUB)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1264 (void) ngx_atomic_fetch_add(ngx_stat_active, -1);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1265 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1266
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1267 c->destroyed = 1;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1268
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1269 pool = c->pool;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1270
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1271 ngx_close_connection(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1272
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1273 ngx_destroy_pool(pool);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1274 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1275
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1276
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1277 static ngx_int_t
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1278 ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc)
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1279 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1280 ngx_uint_t i;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1281 ngx_quic_send_ctx_t *ctx;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1282 ngx_quic_connection_t *qc;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1283
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1284 qc = c->quic;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1285
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1286 if (!qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1287
8398 8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1288 /* drop packets from retransmit queues, no ack is expected */
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1289 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1290 ctx = ngx_quic_get_send_ctx(qc, i);
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1291 ngx_quic_free_frames(c, &ctx->sent);
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1292 }
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	1293
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1294 if (rc == NGX_DONE) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1295
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1296 /*
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1297 * 10.2. Idle Timeout
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1298 *
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1299 * If the idle timeout is enabled by either peer, a connection is
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1300 * silently closed and its state is discarded when it remains idle
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1301 */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1302
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1303 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1304 "quic closing %s connection",
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1305 qc->draining ? "drained" : "idle");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1306
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1307 } else {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1308
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1309 /*
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1310 * 10.3. Immediate Close
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1311 *
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1312 * An endpoint sends a CONNECTION_CLOSE frame (Section 19.19)
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1313 * to terminate the connection immediately.
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1314 */
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1315
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1316 qc->error_level = c->ssl ? SSL_quic_read_level(c->ssl->connection)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1317 : ssl_encryption_initial;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1318
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1319 if (rc == NGX_OK) {
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1320 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1321 "quic immediate close, drain = %d",
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1322 qc->draining);
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1323
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1324 qc->close.log = c->log;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1325 qc->close.data = c;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1326 qc->close.handler = ngx_quic_close_timer_handler;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1327 qc->close.cancelable = 1;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1328
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1329 ctx = ngx_quic_get_send_ctx(qc, qc->error_level);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1330
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	1331 ngx_add_timer(&qc->close, 3 * ngx_quic_pto(c, ctx));
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1332
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1333 qc->error = NGX_QUIC_ERR_NO_ERROR;
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1334
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1335 } else {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1336 if (qc->error == 0 && !qc->error_app) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1337 qc->error = NGX_QUIC_ERR_INTERNAL_ERROR;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1338 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1339
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1340 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1341 "quic immediate close due to %serror: %ui %s",
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1342 qc->error_app ? "app " : "", qc->error,
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1343 qc->error_reason ? qc->error_reason : "");
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1344 }
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1345
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1346 (void) ngx_quic_send_cc(c);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1347
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1348 if (qc->error_level == ssl_encryption_handshake) {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1349 /* for clients that might not have handshake keys */
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1350 qc->error_level = ssl_encryption_initial;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1351 (void) ngx_quic_send_cc(c);
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	1352 }
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1353 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1354
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1355 qc->closing = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1356 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1357
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1358 if (rc == NGX_ERROR && qc->close.timer_set) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1359 /* do not wait for timer in case of fatal error */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1360 ngx_del_timer(&qc->close);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1361 }
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1362
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1363 if (ngx_quic_close_streams(c, qc) == NGX_AGAIN) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1364 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1365 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1366
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1367 if (qc->push.timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1368 ngx_del_timer(&qc->push);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1369 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1370
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1371 if (qc->pto.timer_set) {
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1372 ngx_del_timer(&qc->pto);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1373 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1374
8434 ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1375 if (qc->push.posted) {
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1376 ngx_delete_posted_event(&qc->push);
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1377 }
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	1378
8553 dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1379 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1380 ngx_quic_free_frames(c, &qc->crypto[i].frames);
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1381 }
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1382
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1383 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1384 ngx_quic_free_frames(c, &qc->send_ctx[i].frames);
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1385 ngx_quic_free_frames(c, &qc->send_ctx[i].sent);
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1386 }
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1387
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1388 if (qc->close.timer_set) {
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1389 return NGX_AGAIN;
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1390 }
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	1391
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1392 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1393 "quic part of connection is terminated");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1394
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1395 /* may be tested from SSL callback during SSL shutdown */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1396 c->quic = NULL;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1397
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1398 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1399 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1400
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1401
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1402 void
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1403 ngx_quic_finalize_connection(ngx_connection_t *c, ngx_uint_t err,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1404 const char *reason)
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1405 {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1406 ngx_quic_connection_t *qc;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1407
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1408 qc = c->quic;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1409 qc->error = err;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1410 qc->error_reason = reason;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1411 qc->error_app = 1;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1412 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1413
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1414 ngx_quic_close_connection(c, NGX_ERROR);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1415 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1416
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1417
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1418 static void
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1419 ngx_quic_close_timer_handler(ngx_event_t *ev)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1420 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1421 ngx_connection_t *c;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1422
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1423 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic close timer");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1424
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1425 c = ev->data;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1426 ngx_quic_close_connection(c, NGX_DONE);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1427 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1428
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1429
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1430 static ngx_int_t
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1431 ngx_quic_close_streams(ngx_connection_t c, ngx_quic_connection_t qc)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1432 {
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1433 ngx_event_t rev, wev;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1434 ngx_rbtree_t *tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1435 ngx_rbtree_node_t *node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1436 ngx_quic_stream_t *qs;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1437
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1438 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1439 ngx_uint_t ns;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1440 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1441
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1442 tree = &qc->streams.tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1443
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1444 if (tree->root == tree->sentinel) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1445 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1446 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1447
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1448 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1449 ns = 0;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1450 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1451
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1452 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1453 node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1454 node = ngx_rbtree_next(tree, node))
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1455 {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1456 qs = (ngx_quic_stream_t *) node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1457
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1458 rev = qs->c->read;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1459 rev->error = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1460 rev->ready = 1;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1461
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1462 wev = qs->c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1463 wev->error = 1;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	1464 wev->ready = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1465
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1466 ngx_post_event(rev, &ngx_posted_events);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1467
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1468 if (rev->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1469 ngx_del_timer(rev);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1470 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1471
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1472 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1473 ns++;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1474 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1475 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1476
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1477 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1478 "quic connection has %ui active streams", ns);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1479
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1480 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1481 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1482
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1483
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1484 static ngx_int_t
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1485 ngx_quic_input(ngx_connection_t c, ngx_buf_t b, ngx_ssl_t *ssl,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1486 ngx_quic_conf_t *conf)
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1487 {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1488 u_char *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1489 ngx_int_t rc;
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1490 ngx_uint_t good;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1491 ngx_quic_header_t pkt;
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1492
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1493 good = 0;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1494
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1495 p = b->pos;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1496
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1497 while (p < b->last) {
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1498 c->log->action = "processing quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1499
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1500 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1501 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1502 pkt.data = p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1503 pkt.len = b->last - p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1504 pkt.log = c->log;
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1505 pkt.flags = p[0];
8559 a89a58c642ef QUIC: simplified packet header parsing. Vladimir Homutov <vl@nginx.com> parents: 8558 diff changeset	1506 pkt.raw->pos++;
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1507
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1508 rc = ngx_quic_process_packet(c, ssl, conf, &pkt);
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1509
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1510 if (rc == NGX_ERROR) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1511 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1512 }
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	1513
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1514 if (rc == NGX_OK) {
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1515 good = 1;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1516 }
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1517
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1518 /* NGX_OK \|\| NGX_DECLINED */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1519
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1520 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1521 * we get NGX_DECLINED when there are no keys [yet] available
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1522 * to decrypt packet.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1523 * Instead of queueing it, we ignore it and rely on the sender's
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1524 * retransmission:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1525 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1526 * 12.2. Coalescing Packets:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1527 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1528 * For example, if decryption fails (because the keys are
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1529 * not available or any other reason), the receiver MAY either
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1530 * discard or buffer the packet for later processing and MUST
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1531 * attempt to process the remaining packets.
8535 eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	1532 *
eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	1533 * We also skip packets that don't match connection state
eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	1534 * or cannot be parsed properly.
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1535 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1536
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1537 /* b->pos is at header end, adjust by actual packet length */
8558 0f37b4ef3cd9 QUIC: keep the entire packet size in pkt->len. Roman Arutyunyan <arut@nginx.com> parents: 8557 diff changeset	1538 b->pos = pkt.data + pkt.len;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1539
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1540 /* firefox workaround: skip zero padding at the end of quic packet */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1541 while (b->pos < b->last && *(b->pos) == 0) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1542 b->pos++;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1543 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1544
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1545 p = b->pos;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1546 }
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1547
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1548 return good ? NGX_OK : NGX_DECLINED;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1549 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1550
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1551
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1552 static ngx_int_t
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1553 ngx_quic_process_packet(ngx_connection_t c, ngx_ssl_t ssl,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1554 ngx_quic_conf_t conf, ngx_quic_header_t pkt)
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1555 {
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1556 ngx_int_t rc;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1557 ngx_ssl_conn_t *ssl_conn;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1558 ngx_quic_secrets_t keys, next, tmp;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1559 ngx_quic_send_ctx_t *ctx;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1560 ngx_quic_connection_t *qc;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1561
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1562 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1563
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1564 rc = ngx_quic_parse_packet(pkt);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1565
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1566 if (rc == NGX_DECLINED \|\| rc == NGX_ERROR) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1567 return rc;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1568 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1569
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1570 qc = c->quic;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1571
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1572 if (qc) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1573
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1574 if (rc == NGX_ABORT) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1575 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1576 "quic unsupported version: 0x%xD", pkt->version);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1577 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1578 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1579
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1580 if (ngx_quic_check_peer(qc, pkt) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1581 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1582 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1583
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1584 if (qc->in_retry) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1585
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1586 c->log->action = "retrying quic connection";
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1587
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1588 if (pkt->level != ssl_encryption_initial) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1589 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1590 "quic discard late retry packet");
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1591 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1592 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1593
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1594 if (!pkt->token.len) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1595 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1596 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1597
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1598 if (ngx_quic_new_dcid(c, qc, &pkt->dcid) != NGX_OK) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1599 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1600 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1601
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1602 qc->tp.initial_scid = qc->dcid;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1603 qc->in_retry = 0;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1604
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1605 if (ngx_quic_init_secrets(c) != NGX_OK) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1606 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1607 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1608
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1609 if (ngx_quic_validate_token(c, pkt) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1610 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1611 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1612
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1613 qc->validated = 1;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1614 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1615
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1616 } else {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1617
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1618 if (rc == NGX_ABORT) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1619 return ngx_quic_negotiate_version(c, pkt);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1620 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1621
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1622 if (pkt->level == ssl_encryption_initial) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1623
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1624 if (pkt->dcid.len < NGX_QUIC_CID_LEN_MIN) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1625 /* 7.2. Negotiating Connection IDs */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1626 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1627 "quic too short dcid in initial"
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1628 " packet: length %i", pkt->dcid.len);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1629 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1630 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1631
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1632 qc = ngx_quic_new_connection(c, ssl, conf, pkt);
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1633 if (qc == NULL) {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1634 return NGX_ERROR;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1635 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1636
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1637 c->quic = qc;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1638
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1639 if (ngx_terminate \|\| ngx_exiting) {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1640 qc->error = NGX_QUIC_ERR_CONNECTION_REFUSED;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1641 return NGX_ERROR;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1642 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1643
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1644 if (pkt->token.len) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1645 if (ngx_quic_validate_token(c, pkt) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1646 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1647 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1648
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1649 } else if (conf->retry) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1650 return ngx_quic_send_retry(c);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1651 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1652
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1653 if (ngx_quic_init_secrets(c) != NGX_OK) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1654 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1655 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1656
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1657 } else if (pkt->level == ssl_encryption_application) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1658 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1659
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1660 } else {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1661 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1662 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1663 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1664
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1665 keys = &qc->keys[pkt->level];
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1666
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1667 if (keys->client.key.len == 0) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1668 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1669 "quic no level %d keys yet, ignoring packet", pkt->level);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1670 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1671 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1672
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1673 next = &qc->next_key;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1674
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1675 pkt->secret = &keys->client;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1676 pkt->next = &next->client;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1677 pkt->key_phase = qc->key_phase;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1678 pkt->plaintext = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1679
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1680 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1681
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1682 ssl_conn = c->ssl ? c->ssl->connection : NULL;
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1683
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1684 rc = ngx_quic_decrypt(pkt, ssl_conn, &ctx->largest_pn);
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1685 if (rc != NGX_OK) {
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1686 qc->error = pkt->error;
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1687 qc->error_reason = "failed to decrypt packet";
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1688 return rc;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1689 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1690
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1691 if (c->ssl == NULL) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1692 if (ngx_quic_init_connection(c) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1693 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1694 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1695 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1696
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1697 if (pkt->level == ssl_encryption_handshake) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1698 /*
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1699 * 4.10.1. The successful use of Handshake packets indicates
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1700 * that no more Initial packets need to be exchanged
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1701 */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1702 ngx_quic_discard_ctx(c, ssl_encryption_initial);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1703 qc->validated = 1;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1704 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1705
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1706 if (pkt->level != ssl_encryption_application) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1707 return ngx_quic_payload_handler(c, pkt);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1708 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1709
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1710 ngx_gettimeofday(&pkt->received);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1711
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1712 /* switch keys on Key Phase change */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1713
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1714 if (pkt->key_update) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1715 qc->key_phase ^= 1;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1716
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1717 tmp = *keys;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1718 keys = next;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1719 *next = tmp;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1720 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1721
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1722 rc = ngx_quic_payload_handler(c, pkt);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1723 if (rc != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1724 return rc;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1725 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1726
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1727 /* generate next keys */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1728
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1729 if (pkt->key_update) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1730 if (ngx_quic_key_update(c, keys, next) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1731 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1732 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1733 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1734
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1735 return NGX_OK;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1736 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1737
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	1738
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1739 static ngx_int_t
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1740 ngx_quic_init_secrets(ngx_connection_t *c)
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1741 {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1742 ngx_quic_secrets_t *keys;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1743 ngx_quic_connection_t *qc;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1744
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1745 qc =c->quic;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1746 keys = &qc->keys[ssl_encryption_initial];
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1747
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1748 if (ngx_quic_set_initial_secret(c->pool, &keys->client, &keys->server,
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1749 &qc->odcid)
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1750 != NGX_OK)
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1751 {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1752 return NGX_ERROR;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1753 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1754
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1755 qc->initialized = 1;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1756
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1757 return NGX_OK;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1758 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1759
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1760
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1761 static void
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1762 ngx_quic_discard_ctx(ngx_connection_t *c, enum ssl_encryption_level_t level)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1763 {
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1764 ngx_queue_t *q;
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1765 ngx_quic_frame_t *f;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	1766 ngx_quic_send_ctx_t *ctx;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1767 ngx_quic_connection_t *qc;
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1768
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1769 qc = c->quic;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1770
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1771 if (qc->keys[level].client.key.len == 0) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1772 return;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1773 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1774
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1775 qc->keys[level].client.key.len = 0;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1776 qc->pto_count = 0;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1777
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1778 ctx = ngx_quic_get_send_ctx(qc, level);
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1779
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1780 while (!ngx_queue_empty(&ctx->sent)) {
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1781 q = ngx_queue_head(&ctx->sent);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1782 ngx_queue_remove(q);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1783
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1784 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1785 ngx_quic_congestion_ack(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1786 ngx_quic_free_frame(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	1787 }
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1788 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1789
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1790
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1791 static ngx_int_t
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1792 ngx_quic_check_peer(ngx_quic_connection_t qc, ngx_quic_header_t pkt)
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1793 {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1794 ngx_str_t *dcid;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1795 ngx_queue_t *q;
8546 eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1796 ngx_quic_send_ctx_t *ctx;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1797 ngx_quic_client_id_t *cid;
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	1798
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1799 dcid = (pkt->level == ssl_encryption_early_data) ? &qc->odcid : &qc->dcid;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1800
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1801 if (pkt->dcid.len == dcid->len
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1802 && ngx_memcmp(pkt->dcid.data, dcid->data, dcid->len) == 0)
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1803 {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1804 if (pkt->level == ssl_encryption_application) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1805 return NGX_OK;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1806 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1807
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1808 goto found;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1809 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1810
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1811 /*
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1812 * a packet sent in response to an initial client packet might be lost,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1813 * thus check also for old dcid
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1814 */
8546 eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1815 ctx = ngx_quic_get_send_ctx(qc, ssl_encryption_initial);
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1816
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1817 if (pkt->level == ssl_encryption_initial
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1818 && ctx->largest_ack == (uint64_t) -1)
8546 eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1819 {
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1820 if (pkt->dcid.len == qc->odcid.len
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1821 && ngx_memcmp(pkt->dcid.data, qc->odcid.data, qc->odcid.len) == 0)
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1822 {
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1823 goto found;
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1824 }
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1825 }
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1826
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1827 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic dcid");
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1828 return NGX_ERROR;
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1829
eece8e35e64d QUIC: allowed old DCID for initial packets until first ACK. Roman Arutyunyan <arut@nginx.com> parents: 8545 diff changeset	1830 found:
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1831
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1832 for (q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1833 q != ngx_queue_sentinel(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1834 q = ngx_queue_next(q))
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1835 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1836 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1837
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1838 if (pkt->scid.len == cid->len
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1839 && ngx_memcmp(pkt->scid.data, cid->id, cid->len) == 0)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1840 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1841 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1842 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1843 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1844
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1845 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic scid");
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1846 return NGX_ERROR;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1847 }
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1848
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1849
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1850 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1851 ngx_quic_payload_handler(ngx_connection_t c, ngx_quic_header_t pkt)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1852 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1853 u_char end, p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1854 ssize_t len;
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1855 ngx_uint_t ack_sent, do_close;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1856 ngx_quic_frame_t frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1857 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1858
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1859 qc = c->quic;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1860
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1861 if (qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1862 /*
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1863 * 10.1 Closing and Draining Connection States
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1864 * ... delayed or reordered packets are properly discarded.
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1865 *
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1866 * An endpoint retains only enough information to generate
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1867 * a packet containing a CONNECTION_CLOSE frame and to identify
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1868 * packets as belonging to the connection.
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1869 */
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1870
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1871 qc->error_level = pkt->level;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1872 qc->error = NGX_QUIC_ERR_NO_ERROR;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1873 qc->error_reason = "connection is closing, packet discarded";
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1874 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1875 qc->error_app = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1876
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1877 return ngx_quic_send_cc(c);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1878 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1879
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1880 p = pkt->payload.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1881 end = p + pkt->payload.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1882
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1883 ack_sent = 0;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1884 do_close = 0;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1885
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1886 while (p < end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1887
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	1888 c->log->action = "parsing frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	1889
8240 1f002206a59b Added boundaries checks into frame parser. Vladimir Homutov <vl@nginx.com> parents: 8239 diff changeset	1890 len = ngx_quic_parse_frame(pkt, p, end, &frame);
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	1891
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1892 if (len < 0) {
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	1893 qc->error = pkt->error;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1894 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1895 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1896
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	1897 c->log->action = "handling frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	1898
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1899 p += len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1900
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1901 switch (frame.type) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1902
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1903 case NGX_QUIC_FT_ACK:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1904 if (ngx_quic_handle_ack_frame(c, pkt, &frame.u.ack) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1905 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1906 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1907
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1908 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1909
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1910 case NGX_QUIC_FT_PADDING:
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1911 /* no action required */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1912 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1913
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1914 case NGX_QUIC_FT_CONNECTION_CLOSE:
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1915 case NGX_QUIC_FT_CONNECTION_CLOSE_APP:
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1916 do_close = 1;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1917 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1918 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1919
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1920 /* got there with ack-eliciting packet */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1921
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1922 if (!ack_sent) {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1923 if (ngx_quic_send_ack(c, pkt) != NGX_OK) {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1924 return NGX_ERROR;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1925 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1926
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1927 ack_sent = 1;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1928 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1929
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	1930 switch (frame.type) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1931
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1932 case NGX_QUIC_FT_CRYPTO:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1933
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1934 if (ngx_quic_handle_crypto_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1935 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1936 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1937
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1938 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1939
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1940 case NGX_QUIC_FT_PING:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1941 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1942
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1943 case NGX_QUIC_FT_STREAM0:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1944 case NGX_QUIC_FT_STREAM1:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1945 case NGX_QUIC_FT_STREAM2:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1946 case NGX_QUIC_FT_STREAM3:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1947 case NGX_QUIC_FT_STREAM4:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1948 case NGX_QUIC_FT_STREAM5:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1949 case NGX_QUIC_FT_STREAM6:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1950 case NGX_QUIC_FT_STREAM7:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1951
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	1952 if (ngx_quic_handle_stream_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1953 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1954 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1955
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1956 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1957
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	1958 case NGX_QUIC_FT_MAX_DATA:
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1959
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1960 if (ngx_quic_handle_max_data_frame(c, &frame.u.max_data) != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1961 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1962 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1963 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1964
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	1965 break;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	1966
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	1967 case NGX_QUIC_FT_STREAMS_BLOCKED:
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	1968 case NGX_QUIC_FT_STREAMS_BLOCKED2:
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1969
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1970 if (ngx_quic_handle_streams_blocked_frame(c, pkt,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1971 &frame.u.streams_blocked)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1972 != NGX_OK)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1973 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1974 return NGX_ERROR;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1975 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	1976
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	1977 break;
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	1978
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1979 case NGX_QUIC_FT_STREAM_DATA_BLOCKED:
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1980
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1981 if (ngx_quic_handle_stream_data_blocked_frame(c, pkt,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1982 &frame.u.stream_data_blocked)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1983 != NGX_OK)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1984 {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1985 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1986 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1987
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1988 break;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	1989
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1990 case NGX_QUIC_FT_MAX_STREAM_DATA:
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1991
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1992 if (ngx_quic_handle_max_stream_data_frame(c, pkt,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1993 &frame.u.max_stream_data)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1994 != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1995 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1996 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1997 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1998
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1999 break;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2000
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2001 case NGX_QUIC_FT_RESET_STREAM:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2002
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2003 if (ngx_quic_handle_reset_stream_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2004 &frame.u.reset_stream)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2005 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2006 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2007 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2008 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2009
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2010 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2011
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2012 case NGX_QUIC_FT_STOP_SENDING:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2013
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2014 if (ngx_quic_handle_stop_sending_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2015 &frame.u.stop_sending)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2016 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2017 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2018 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2019 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2020
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2021 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2022
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2023 case NGX_QUIC_FT_MAX_STREAMS:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2024 case NGX_QUIC_FT_MAX_STREAMS2:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2025
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2026 if (ngx_quic_handle_max_streams_frame(c, pkt, &frame.u.max_streams)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2027 != NGX_OK)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2028 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2029 return NGX_ERROR;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2030 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2031
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2032 break;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2033
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2034 case NGX_QUIC_FT_PATH_CHALLENGE:
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2035
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2036 if (ngx_quic_handle_path_challenge_frame(c, pkt,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2037 &frame.u.path_challenge)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2038 != NGX_OK)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2039 {
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2040 return NGX_ERROR;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2041 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2042
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2043 break;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2044
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2045 case NGX_QUIC_FT_NEW_CONNECTION_ID:
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2046
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2047 if (ngx_quic_handle_new_connection_id_frame(c, pkt, &frame.u.ncid)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2048 != NGX_OK)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2049 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2050 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2051 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2052
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2053 break;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2054
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2055 case NGX_QUIC_FT_RETIRE_CONNECTION_ID:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2056 case NGX_QUIC_FT_PATH_RESPONSE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2057
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2058 /* TODO: handle */
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2059 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2060 "quic frame handler not implemented");
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2061 break;
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2062
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2063 default:
8346 4e4485793418 Added MAX_STREAM_DATA stub handler. Vladimir Homutov <vl@nginx.com> parents: 8345 diff changeset	2064 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2065 "quic missing frame handler");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2066 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2067 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2068 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2069
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2070 if (p != end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2071 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2072 "quic trailing garbage in payload: %ui bytes", end - p);
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2073
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2074 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2075 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2076 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2077
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2078 if (do_close) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2079 qc->draining = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2080 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2081 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2082
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2083 return NGX_OK;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2084 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2085
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2086
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2087 static ngx_int_t
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2088 ngx_quic_send_ack(ngx_connection_t c, ngx_quic_header_t pkt)
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2089 {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2090 ngx_quic_frame_t *frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2091
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2092 c->log->action = "generating acknowledgment";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2093
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2094 /* every ACK-eliciting packet is acknowledged, TODO ACK Ranges */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2095
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2096 frame = ngx_quic_alloc_frame(c, 0);
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2097 if (frame == NULL) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2098 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2099 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2100
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2101 frame->level = (pkt->level == ssl_encryption_early_data)
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2102 ? ssl_encryption_application
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2103 : pkt->level;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2104
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2105 frame->type = NGX_QUIC_FT_ACK;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2106 frame->u.ack.largest = pkt->pn;
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2107 frame->u.ack.delay = ngx_quic_ack_delay(c, &pkt->received, frame->level);
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2108
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2109 ngx_sprintf(frame->info, "ACK for PN=%uL from frame handler level=%d",
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2110 pkt->pn, frame->level);
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2111 ngx_quic_queue_frame(c->quic, frame);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2112
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	2113 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2114 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2115
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2116
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2117 static ngx_int_t
8470 0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2118 ngx_quic_ack_delay(ngx_connection_t c, struct timeval received,
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2119 enum ssl_encryption_level_t level)
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2120 {
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2121 ngx_int_t ack_delay;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2122 struct timeval tv;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2123
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2124 ack_delay = 0;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2125
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2126 if (level == ssl_encryption_application) {
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2127 ngx_gettimeofday(&tv);
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2128 ack_delay = (tv.tv_sec - received->tv_sec) * 1000000
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2129 + tv.tv_usec - received->tv_usec;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2130 ack_delay >>= c->quic->ctp.ack_delay_exponent;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2131 }
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2132
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2133 return ack_delay;
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2134 }
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2135
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2136
0d1ad81dd65c QUIC: delay field of an ACK frame is now calculated. Vladimir Homutov <vl@nginx.com> parents: 8469 diff changeset	2137 static ngx_int_t
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2138 ngx_quic_send_cc(ngx_connection_t *c)
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2139 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2140 ngx_quic_frame_t *frame;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2141 ngx_quic_connection_t *qc;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2142
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2143 qc = c->quic;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2144
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2145 if (qc->draining) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2146 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2147 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2148
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2149 if (!qc->initialized) {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2150 /* try to initialize secrets to send an early error */
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2151 if (ngx_quic_init_secrets(c) != NGX_OK) {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2152 return NGX_OK;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2153 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2154 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2155
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2156 if (qc->closing
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2157 && ngx_current_msec - qc->last_cc < NGX_QUIC_CC_MIN_INTERVAL)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2158 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2159 /* dot not send CC too often */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2160 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2161 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2162
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2163 frame = ngx_quic_alloc_frame(c, 0);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2164 if (frame == NULL) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2165 return NGX_ERROR;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2166 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2167
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2168 frame->level = qc->error_level;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2169 frame->type = NGX_QUIC_FT_CONNECTION_CLOSE;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2170 frame->u.close.error_code = qc->error;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2171 frame->u.close.frame_type = qc->error_ftype;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2172 frame->u.close.app = qc->error_app;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2173
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2174 if (qc->error_reason) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2175 frame->u.close.reason.len = ngx_strlen(qc->error_reason);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2176 frame->u.close.reason.data = (u_char *) qc->error_reason;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2177 }
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2178
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2179 ngx_snprintf(frame->info, sizeof(frame->info) - 1,
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2180 "CONNECTION_CLOSE%s err:%ui level:%d ft:%ui reason:\"%s\"",
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2181 qc->error_app ? "_APP" : "", qc->error, qc->error_level,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2182 qc->error_ftype, qc->error_reason ? qc->error_reason : "-");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2183
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2184 ngx_quic_queue_frame(c->quic, frame);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2185
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2186 qc->last_cc = ngx_current_msec;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2187
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2188 return ngx_quic_output(c);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2189 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2190
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2191
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2192 static ngx_int_t
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2193 ngx_quic_send_new_token(ngx_connection_t *c)
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2194 {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2195 ngx_str_t token;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2196 ngx_quic_frame_t *frame;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2197
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	2198 if (!c->quic->conf->retry) {
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2199 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2200 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2201
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2202 if (ngx_quic_new_token(c, &token) != NGX_OK) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2203 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2204 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2205
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2206 frame = ngx_quic_alloc_frame(c, 0);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2207 if (frame == NULL) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2208 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2209 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2210
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2211 frame->level = ssl_encryption_application;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2212 frame->type = NGX_QUIC_FT_NEW_TOKEN;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2213 frame->u.token.length = token.len;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2214 frame->u.token.data = token.data;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2215 ngx_sprintf(frame->info, "NEW_TOKEN");
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2216 ngx_quic_queue_frame(c->quic, frame);
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2217
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2218 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2219 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2220
8450 a62849b6463c Style. Vladimir Homutov <vl@nginx.com> parents: 8447 diff changeset	2221
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2222 static ngx_int_t
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2223 ngx_quic_handle_ack_frame(ngx_connection_t c, ngx_quic_header_t pkt,
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2224 ngx_quic_ack_frame_t *ack)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2225 {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2226 ssize_t n;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2227 u_char pos, end;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2228 uint64_t min, max, gap, range;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2229 ngx_msec_t send_time;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2230 ngx_uint_t i;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2231 ngx_quic_send_ctx_t *ctx;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2232 ngx_quic_connection_t *qc;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2233
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2234 qc = c->quic;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2235
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2236 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2237
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2238 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2239 "quic ngx_quic_handle_ack_frame level %d", pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2240
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2241 /*
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2242 * If any computed packet number is negative, an endpoint MUST
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2243 * generate a connection error of type FRAME_ENCODING_ERROR.
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2244 * (19.3.1)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2245 */
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2246
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2247 if (ack->first_range > ack->largest) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2248 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2249 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2250 "quic invalid first range in ack frame");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2251 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2252 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2253
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2254 min = ack->largest - ack->first_range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2255 max = ack->largest;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2256
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2257 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2258 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2259 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2260 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2261 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2262
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2263 /* 13.2.3. Receiver Tracking of ACK Frames */
8512 6e1c88f82280 QUIC: changed ctx->largest_ack initial value to type maximum. Sergey Kandaurov <pluknet@nginx.com> parents: 8509 diff changeset	2264 if (ctx->largest_ack < max \|\| ctx->largest_ack == (uint64_t) -1) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2265 ctx->largest_ack = max;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2266 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2267 "quic updated largest received ack: %uL", max);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2268
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2269 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2270 * An endpoint generates an RTT sample on receiving an
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2271 * ACK frame that meets the following two conditions:
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2272 *
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2273 * - the largest acknowledged packet number is newly acknowledged
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2274 * - at least one of the newly acknowledged packets was ack-eliciting.
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2275 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2276
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2277 if (send_time != NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2278 ngx_quic_rtt_sample(c, ack, pkt->level, send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2279 }
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2280 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2281
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2282 pos = ack->ranges_start;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2283 end = ack->ranges_end;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2284
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2285 for (i = 0; i < ack->range_count; i++) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2286
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2287 n = ngx_quic_parse_ack_range(pkt, pos, end, &gap, &range);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2288 if (n == NGX_ERROR) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2289 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2290 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2291 pos += n;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2292
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2293 if (gap + 2 > min) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2294 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2295 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2296 "quic invalid range %ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2297 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2298 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2299
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2300 max = min - gap - 2;
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2301
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2302 if (range > max) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	2303 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2304 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2305 "quic invalid range %ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2306 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2307 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2308
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2309 min = max - range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2310
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2311 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2312 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2313 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2314 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2315 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2316 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2317
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	2318 return ngx_quic_detect_lost(c);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2319 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2320
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2321
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2322 static ngx_int_t
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2323 ngx_quic_handle_ack_frame_range(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2324 uint64_t min, uint64_t max, ngx_msec_t *send_time)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2325 {
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2326 uint64_t found_num;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2327 ngx_uint_t found;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2328 ngx_queue_t *q;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2329 ngx_quic_frame_t *f;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2330 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2331
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2332 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2333 "quic handle ack range: min:%uL max:%uL", min, max);
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	2334
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2335 qc = c->quic;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2336
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2337 *send_time = NGX_TIMER_INFINITE;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2338 found = 0;
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2339 found_num = 0;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2340
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2341 q = ngx_queue_last(&ctx->sent);
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2342
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	2343 while (q != ngx_queue_sentinel(&ctx->sent)) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2344
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2345 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2346 q = ngx_queue_prev(q);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2347
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2348 if (f->pnum >= min && f->pnum <= max) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2349 ngx_quic_congestion_ack(c, f);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2350
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2351 ngx_quic_handle_stream_ack(c, f);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2352
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2353 if (f->pnum > found_num \|\| !found) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2354 *send_time = f->last;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2355 found_num = f->pnum;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2356 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2357
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2358 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2359 ngx_quic_free_frame(c, f);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2360 found = 1;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2361 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2362 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2363
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2364 if (!found) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2365
8437 4e75267865de QUIC: fixed off-by-one in frame range handler. Vladimir Homutov <vl@nginx.com> parents: 8436 diff changeset	2366 if (max < ctx->pnum) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2367 /* duplicate ACK or ACK for non-ack-eliciting frame */
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	2368 return NGX_OK;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2369 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2370
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2371 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	2372 "quic ACK for the packet not sent");
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2373
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2374 qc->error = NGX_QUIC_ERR_PROTOCOL_VIOLATION;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2375 qc->error_ftype = NGX_QUIC_FT_ACK;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	2376 qc->error_reason = "unknown packet number";
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2377
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2378 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2379 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	2380
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2381 if (!qc->push.timer_set) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2382 ngx_post_event(&qc->push, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2383 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2384
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2385 qc->pto_count = 0;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2386
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2387 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2388 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2389
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2390
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2391 static void
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2392 ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2393 enum ssl_encryption_level_t level, ngx_msec_t send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2394 {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2395 ngx_msec_t latest_rtt, ack_delay, adjusted_rtt, rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2396 ngx_quic_connection_t *qc;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2397
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2398 qc = c->quic;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2399
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2400 latest_rtt = ngx_current_msec - send_time;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2401 qc->latest_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2402
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2403 if (qc->min_rtt == NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2404 qc->min_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2405 qc->avg_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2406 qc->rttvar = latest_rtt / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2407
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2408 } else {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2409 qc->min_rtt = ngx_min(qc->min_rtt, latest_rtt);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2410
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2411
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2412 if (level == ssl_encryption_application) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2413 ack_delay = ack->delay * (1 << qc->ctp.ack_delay_exponent) / 1000;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2414 ack_delay = ngx_min(ack_delay, qc->ctp.max_ack_delay);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2415
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2416 } else {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2417 ack_delay = 0;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2418 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2419
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2420 adjusted_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2421
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2422 if (qc->min_rtt + ack_delay < latest_rtt) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2423 adjusted_rtt -= ack_delay;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2424 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2425
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2426 qc->avg_rtt = 0.875 * qc->avg_rtt + 0.125 * adjusted_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2427 rttvar_sample = ngx_abs((ngx_msec_int_t) (qc->avg_rtt - adjusted_rtt));
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2428 qc->rttvar = 0.75 * qc->rttvar + 0.25 * rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2429 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2430
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2431 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2432 "quic rtt sample: latest %M, min %M, avg %M, var %M",
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2433 latest_rtt, qc->min_rtt, qc->avg_rtt, qc->rttvar);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2434 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2435
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2436
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2437 static ngx_inline ngx_msec_t
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2438 ngx_quic_pto(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2439 {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2440 ngx_msec_t duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2441 ngx_quic_connection_t *qc;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2442
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2443 qc = c->quic;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2444
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2445 /* PTO calculation: quic-recovery, Appendix 8 */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2446 duration = qc->avg_rtt;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2447
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2448 duration += ngx_max(4 * qc->rttvar, NGX_QUIC_TIME_GRANULARITY);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2449 duration <<= qc->pto_count;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2450
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2451 if (qc->congestion.in_flight == 0) { /* no in-flight packets */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2452 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2453 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2454
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2455 if (ctx == &qc->send_ctx[2] && c->ssl->handshaked) {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2456 /* application send space */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2457
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2458 duration += qc->tp.max_ack_delay << qc->pto_count;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2459 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2460
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2461 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2462 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2463
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2464
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	2465 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2466 ngx_quic_handle_stream_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2467 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2468 uint64_t sent, unacked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2469 ngx_event_t *wev;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2470 ngx_quic_stream_t *sn;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2471 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2472
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2473 if (f->type < NGX_QUIC_FT_STREAM0 \|\| f->type > NGX_QUIC_FT_STREAM7) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2474 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2475 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2476
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2477 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2478
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2479 sn = ngx_quic_find_stream(&qc->streams.tree, f->u.stream.stream_id);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2480 if (sn == NULL) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2481 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2482 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2483
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2484 wev = sn->c->write;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2485 sent = sn->c->sent;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2486 unacked = sent - sn->acked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2487
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2488 if (unacked >= NGX_QUIC_STREAM_BUFSIZE && wev->active) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2489 wev->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2490 ngx_post_event(wev, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2491 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2492
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2493 sn->acked += f->u.stream.length;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2494
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2495 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, sn->c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2496 "quic stream ack %uL acked:%uL, unacked:%uL",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2497 f->u.stream.length, sn->acked, sent - sn->acked);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2498 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2499
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	2500
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2501 static ngx_int_t
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2502 ngx_quic_handle_ordered_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2503 ngx_quic_frame_t frame, ngx_quic_frame_handler_pt handler, void data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2504 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2505 size_t full_len;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2506 ngx_int_t rc;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2507 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2508 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2509
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2510 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2511
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2512 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2513 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2514 "quic out-of-order frame: expecting %uL got %uL",
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2515 fs->received, f->offset);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2516
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2517 return ngx_quic_buffer_frame(c, fs, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2518 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2519
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2520 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2521
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2522 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2523 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2524 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2525 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2526 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2527 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2528
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2529 /* intersecting data range, frame modified */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2530 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2531
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2532 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2533
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2534 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2535 if (rc == NGX_ERROR) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2536 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2537
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2538 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2539 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2540 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2541 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2542
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2543 /* rc == NGX_OK */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2544
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2545 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2546
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2547 /* now check the queue if we can continue with buffered frames */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2548
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2549 do {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2550 q = ngx_queue_head(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2551 if (q == ngx_queue_sentinel(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2552 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2553 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2554
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2555 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2556 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2557
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2558 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2559 /* gap found, nothing more to do */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2560 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2561 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2562
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2563 full_len = f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2564
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2565 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2566
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2567 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2568 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2569 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2570 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2571 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2572 fs->total -= f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2573
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2574 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2575 "quic skipped buffered frame, total %ui",
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2576 fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2577 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2578 continue;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2579 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2580
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2581 /* frame was adjusted, proceed to input */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2582 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2583
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2584 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2585
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2586 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2587
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2588 if (rc == NGX_ERROR) {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2589 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2590
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2591 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2592 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2593 return NGX_OK;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2594 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2595
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2596 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2597 fs->total -= full_len;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2598
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2599 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2600
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2601 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2602 "quic consumed buffered frame, total %ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2603
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2604 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2605
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2606 } while (1);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2607
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2608 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2609 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2610
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2611
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2612 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2613 ngx_quic_adjust_frame_offset(ngx_connection_t c, ngx_quic_frame_t frame,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2614 uint64_t offset_in)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2615 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2616 size_t tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2617 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2618
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2619 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2620
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2621 tail = offset_in - f->offset;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2622
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2623 if (tail >= f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2624 /* range preceeding already received data or duplicate, ignore */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2625
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2626 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2627 "quic old or duplicate data in ordered frame, ignored");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2628 return NGX_DONE;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2629 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2630
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2631 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2632 "quic adjusted ordered frame data start to expected offset");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2633
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2634 /* intersecting range: adjust data size */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2635
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2636 f->offset += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2637 f->data += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2638 f->length -= tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2639
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2640 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2641 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2642
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2643
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2644 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2645 ngx_quic_buffer_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2646 ngx_quic_frame_t *frame)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2647 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2648 u_char *data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2649 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2650 ngx_quic_frame_t dst, item;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2651 ngx_quic_ordered_frame_t f, df;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2652
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2653 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2654 "quic ngx_quic_buffer_frame");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2655
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2656 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2657
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2658 /* frame start offset is in the future, buffer it */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2659
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2660 dst = ngx_quic_alloc_frame(c, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2661 if (dst == NULL) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2662 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2663 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2664
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2665 data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2666 ngx_memcpy(dst, frame, sizeof(ngx_quic_frame_t));
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2667 dst->data = data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2668
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2669 ngx_memcpy(dst->data, f->data, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2670
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2671 df = &dst->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2672 df->data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2673
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2674 fs->total += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2675
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2676 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2677 "quic ordered frame with unexpected offset:"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2678 " buffered, total %ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2679
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2680 if (ngx_queue_empty(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2681 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2682 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2683 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2684
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2685 for (q = ngx_queue_last(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2686 q != ngx_queue_sentinel(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2687 q = ngx_queue_prev(q))
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2688 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2689 item = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2690 f = &item->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2691
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2692 if (f->offset < df->offset) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2693 ngx_queue_insert_after(q, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2694 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2695 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2696 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2697
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2698 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2699
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2700 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2701 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2702
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2703
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2704 static ngx_int_t
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2705 ngx_quic_handle_crypto_frame(ngx_connection_t c, ngx_quic_header_t pkt,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2706 ngx_quic_frame_t *frame)
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2707 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2708 uint64_t last;
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2709 ngx_quic_connection_t *qc;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2710 ngx_quic_crypto_frame_t *f;
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2711 ngx_quic_frames_stream_t *fs;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2712
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2713 qc = c->quic;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2714 fs = &qc->crypto[pkt->level];
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2715 f = &frame->u.crypto;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2716
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2717 /* no overflow since both values are 62-bit */
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2718 last = f->offset + f->length;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2719
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2720 if (last > fs->received && last - fs->received > NGX_QUIC_MAX_BUFFERED) {
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2721 c->quic->error = NGX_QUIC_ERR_CRYPTO_BUFFER_EXCEEDED;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2722 return NGX_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2723 }
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2724
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2725 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_crypto_input,
81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2726 NULL);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2727 }
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2728
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2729
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	2730 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2731 ngx_quic_crypto_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2732 {
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	2733 int n, sslerr;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2734 ngx_ssl_conn_t *ssl_conn;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2735 ngx_quic_crypto_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2736
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2737 f = &frame->u.crypto;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2738
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2739 ssl_conn = c->ssl->connection;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2740
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2741 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2742 "quic SSL_quic_read_level: %d, SSL_quic_write_level: %d",
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2743 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2744 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2745
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2746 if (!SSL_provide_quic_data(ssl_conn, SSL_quic_read_level(ssl_conn),
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2747 f->data, f->length))
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2748 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2749 ngx_ssl_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2750 "SSL_provide_quic_data() failed");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2751 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2752 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2753
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2754 n = SSL_do_handshake(ssl_conn);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2755
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2756 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_do_handshake: %d", n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2757
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2758 if (n == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2759 sslerr = SSL_get_error(ssl_conn, n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2760
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2761 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_get_error: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2762 sslerr);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2763
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	2764 if (sslerr != SSL_ERROR_WANT_READ) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2765 ngx_ssl_error(NGX_LOG_ERR, c->log, 0, "SSL_do_handshake() failed");
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	2766 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2767 }
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2768
8302 76818c9cdd6f Sending HANDSHAKE_DONE just once with BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8301 diff changeset	2769 } else if (n == 1 && !SSL_in_init(ssl_conn)) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2770
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2771 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8299 4ad7d4272cd5 Style. Sergey Kandaurov <pluknet@nginx.com> parents: 8294 diff changeset	2772 "quic ssl cipher: %s", SSL_get_cipher(ssl_conn));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2773
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2774 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2775 "quic handshake completed successfully");
8273 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2776
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2777 c->ssl->handshaked = 1;
8526 11fc65261689 QUIC: disabled bidirectional SSL shutdown after 09fb2135a589. Sergey Kandaurov <pluknet@nginx.com> parents: 8525 diff changeset	2778 c->ssl->no_wait_shutdown = 1;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2779
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	2780 frame = ngx_quic_alloc_frame(c, 0);
8273 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2781 if (frame == NULL) {
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2782 return NGX_ERROR;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2783 }
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2784
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2785 /* 12.4 Frames and frame types, figure 8 */
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2786 frame->level = ssl_encryption_application;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2787 frame->type = NGX_QUIC_FT_HANDSHAKE_DONE;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2788 ngx_sprintf(frame->info, "HANDSHAKE DONE on handshake completed");
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 8272 diff changeset	2789 ngx_quic_queue_frame(c->quic, frame);
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2790
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2791 if (ngx_quic_send_new_token(c) != NGX_OK) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2792 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2793 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	2794
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2795 /*
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2796 * Generating next keys before a key update is received.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2797 * See quic-tls 9.4 Header Protection Timing Side-Channels.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2798 */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2799
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2800 if (ngx_quic_key_update(c, &c->quic->keys[ssl_encryption_application],
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2801 &c->quic->next_key)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2802 != NGX_OK)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2803 {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2804 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	2805 }
8393 e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2806
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2807 /*
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2808 * 4.10.2 An endpoint MUST discard its handshake keys
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2809 * when the TLS handshake is confirmed
e169cce912c7 Avoid retransmitting of packets with discarded keys. Vladimir Homutov <vl@nginx.com> parents: 8392 diff changeset	2810 */
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2811 ngx_quic_discard_ctx(c, ssl_encryption_handshake);
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2812 }
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2813
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2814 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2815 "quic SSL_quic_read_level: %d, SSL_quic_write_level: %d",
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2816 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2817 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2818
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2819 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2820 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2821
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2822
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2823 static ngx_int_t
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2824 ngx_quic_handle_stream_frame(ngx_connection_t c, ngx_quic_header_t pkt,
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2825 ngx_quic_frame_t *frame)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2826 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2827 size_t window;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2828 uint64_t last;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2829 ngx_buf_t *b;
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2830 ngx_pool_t *pool;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2831 ngx_connection_t *sc;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2832 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2833 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2834 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2835 ngx_quic_frames_stream_t *fs;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2836
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2837 qc = c->quic;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2838 f = &frame->u.stream;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2839
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2840 if ((f->stream_id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2841 && (f->stream_id & NGX_QUIC_STREAM_SERVER_INITIATED))
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2842 {
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2843 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2844 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2845 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2846
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2847 /* no overflow since both values are 62-bit */
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2848 last = f->offset + f->length;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2849
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2850 sn = ngx_quic_find_stream(&qc->streams.tree, f->stream_id);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2851
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2852 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2853 sn = ngx_quic_create_client_stream(c, f->stream_id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2854
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2855 if (sn == NULL) {
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2856 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2857 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	2858
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2859 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2860 return NGX_OK;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	2861 }
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2862
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2863 sc = sn->c;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2864 fs = &sn->fs;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2865 b = sn->b;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2866 window = b->end - b->last;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2867
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2868 if (last > window) {
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2869 c->quic->error = NGX_QUIC_ERR_FLOW_CONTROL_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2870 goto cleanup;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2871 }
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2872
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2873 if (ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2874 sn)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2875 != NGX_OK)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2876 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2877 goto cleanup;
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2878 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2879
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2880 sc->listening->handler(sc);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2881
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	2882 return NGX_OK;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2883 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2884
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2885 fs = &sn->fs;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2886 b = sn->b;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2887 window = (b->pos - b->start) + (b->end - b->last);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2888
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2889 if (last > fs->received && last - fs->received > window) {
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2890 c->quic->error = NGX_QUIC_ERR_FLOW_CONTROL_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2891 return NGX_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2892 }
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2893
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2894 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2895 sn);
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2896
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2897 cleanup:
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2898
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2899 pool = sc->pool;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2900
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2901 ngx_close_connection(sc);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2902 ngx_destroy_pool(pool);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2903
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	2904 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2905 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2906
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2907
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2908 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2909 ngx_quic_stream_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2910 {
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	2911 uint64_t id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2912 ngx_buf_t *b;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2913 ngx_event_t *rev;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2914 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2915 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2916 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2917
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2918 qc = c->quic;
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	2919 sn = data;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2920
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2921 f = &frame->u.stream;
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	2922 id = f->stream_id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2923
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2924 b = sn->b;
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2925
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2926 if ((size_t) ((b->pos - b->start) + (b->end - b->last)) < f->length) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2927 ngx_log_error(NGX_LOG_INFO, c->log, 0,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2928 "quic no space in stream buffer");
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2929 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2930 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2931
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2932 if ((size_t) (b->end - b->last) < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2933 b->last = ngx_movemem(b->start, b->pos, b->last - b->pos);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2934 b->pos = b->start;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2935 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2936
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	2937 b->last = ngx_cpymem(b->last, f->data, f->length);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2938
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2939 rev = sn->c->read;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2940 rev->ready = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2941
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2942 if (f->fin) {
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2943 rev->pending_eof = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	2944 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2945
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2946 if (rev->active) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2947 rev->handler(rev);
8314 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	2948 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	2949
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	2950 /* check if stream was destroyed by handler */
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	2951 if (ngx_quic_find_stream(&qc->streams.tree, id) == NULL) {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2952 return NGX_DONE;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2953 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2954
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2955 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2956 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2957
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2958
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2959 static ngx_int_t
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2960 ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2961 ngx_quic_max_data_frame_t *f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2962 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2963 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2964 ngx_rbtree_t *tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2965 ngx_rbtree_node_t *node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2966 ngx_quic_stream_t *qs;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2967 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2968
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2969 qc = c->quic;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2970 tree = &qc->streams.tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2971
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2972 if (f->max_data <= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2973 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2974 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2975
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2976 if (qc->streams.sent >= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2977
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2978 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2979 node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2980 node = ngx_rbtree_next(tree, node))
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2981 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2982 qs = (ngx_quic_stream_t *) node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2983 wev = qs->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2984
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2985 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2986 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2987 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2988 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2989 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2990 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2991
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2992 qc->streams.send_max_data = f->max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2993
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2994 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2995 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2996
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2997
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2998 static ngx_int_t
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2999 ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3000 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3001 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3002 return NGX_OK;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3003 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3004
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	3005
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3006 static ngx_int_t
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3007 ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3008 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3009 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3010 size_t n;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3011 ngx_buf_t *b;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3012 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3013 ngx_quic_stream_t *sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	3014 ngx_quic_connection_t *qc;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3015
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3016 qc = c->quic;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3017
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3018 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3019 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3020 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3021 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3022 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3023 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3024
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3025 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3026
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3027 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3028 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3029
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3030 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3031 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3032 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3033
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3034 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3035 return NGX_OK;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3036 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3037
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3038 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3039 n = b->end - b->last;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3040
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3041 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3042
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3043 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3044 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3045 n = sn->fs.received + (b->pos - b->start) + (b->end - b->last);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3046 }
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3047
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	3048 frame = ngx_quic_alloc_frame(c, 0);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3049 if (frame == NULL) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3050 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3051 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3052
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3053 frame->level = pkt->level;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3054 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3055 frame->u.max_stream_data.id = f->id;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3056 frame->u.max_stream_data.limit = n;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3057
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3058 ngx_sprintf(frame->info, "MAX_STREAM_DATA id:0x%xL limit:%uL level=%d",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3059 frame->u.max_stream_data.id,
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	3060 frame->u.max_stream_data.limit,
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3061 frame->level);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3062
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3063 ngx_quic_queue_frame(c->quic, frame);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3064
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3065 return NGX_OK;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3066 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3067
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	3068
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3069 static ngx_int_t
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3070 ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3071 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3072 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3073 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3074 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3075 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3076 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3077
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3078 qc = c->quic;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3079
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3080 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3081 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3082 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3083 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3084 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3085 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3086
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3087 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3088
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3089 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3090 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3091
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3092 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3093 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3094 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3095
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3096 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3097 return NGX_OK;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3098 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	3099
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3100 if (f->limit > sn->send_max_data) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3101 sn->send_max_data = f->limit;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3102 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3103
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3104 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3105
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	3106 return NGX_OK;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3107 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3108
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3109 if (f->limit <= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3110 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3111 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3112
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3113 sent = sn->c->sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3114
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3115 if (sent >= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3116 wev = sn->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3117
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3118 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3119 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3120 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3121 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3122 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3123
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3124 sn->send_max_data = f->limit;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3125
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3126 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3127 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3128
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	3129
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3130 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3131 ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3132 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3133 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3134 ngx_event_t *rev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3135 ngx_connection_t *sc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3136 ngx_quic_stream_t *sn;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3137 ngx_quic_connection_t *qc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3138
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3139 qc = c->quic;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3140
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3141 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3142 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3143 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3144 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3145 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3146 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3147
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3148 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3149
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3150 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3151 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3152
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3153 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3154 return NGX_ERROR;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3155 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3156
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3157 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3158 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3159 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3160
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3161 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3162
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3163 rev = sc->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3164 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3165 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3166
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3167 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3168
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3169 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3170 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3171
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3172 rev = sn->c->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3173 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3174 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3175
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3176 if (rev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3177 rev->handler(rev);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3178 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3179
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3180 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3181 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3182
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3183
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3184 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3185 ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3186 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3187 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3188 ngx_event_t *wev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3189 ngx_connection_t *sc;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3190 ngx_quic_stream_t *sn;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3191 ngx_quic_connection_t *qc;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3192
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3193 qc = c->quic;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3194
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3195 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3196 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3197 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3198 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3199 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3200 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3201
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3202 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3203
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3204 if (sn == NULL) {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3205 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3206
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3207 if (sn == NULL) {
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3208 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3209 }
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3210
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3211 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3212 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3213 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3214
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3215 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3216
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3217 wev = sc->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3218 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3219 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3220
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3221 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3222
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3223 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3224 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3225
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3226 wev = sn->c->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3227 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3228 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3229
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3230 if (wev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	3231 wev->handler(wev);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3232 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3233
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3234 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3235 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3236
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	3237
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3238 static ngx_int_t
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3239 ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3240 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3241 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3242 ngx_quic_connection_t *qc;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3243
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3244 qc = c->quic;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3245
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3246 if (f->bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3247 if (qc->streams.server_max_streams_bidi < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3248 qc->streams.server_max_streams_bidi = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3249
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3250 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3251 "quic max_streams_bidi:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3252 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3253
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3254 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3255 if (qc->streams.server_max_streams_uni < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3256 qc->streams.server_max_streams_uni = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3257
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3258 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3259 "quic max_streams_uni:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3260 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3261 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3262
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3263 return NGX_OK;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3264 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3265
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3266
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3267 static ngx_int_t
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3268 ngx_quic_handle_path_challenge_frame(ngx_connection_t *c,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3269 ngx_quic_header_t pkt, ngx_quic_path_challenge_frame_t f)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3270 {
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3271 ngx_quic_frame_t *frame;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3272
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3273 frame = ngx_quic_alloc_frame(c, 0);
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3274 if (frame == NULL) {
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3275 return NGX_ERROR;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3276 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3277
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3278 frame->level = pkt->level;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3279 frame->type = NGX_QUIC_FT_PATH_RESPONSE;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3280 frame->u.path_response = *f;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3281
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3282 ngx_sprintf(frame->info, "PATH_RESPONSE data:0x%xL level:%d",
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3283 (uint64_t ) &f->data, frame->level);
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3284
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3285 ngx_quic_queue_frame(c->quic, frame);
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3286
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3287 return NGX_OK;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3288 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3289
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	3290
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3291 static ngx_int_t
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3292 ngx_quic_handle_new_connection_id_frame(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3293 ngx_quic_header_t pkt, ngx_quic_new_conn_id_frame_t f)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3294 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3295 ngx_queue_t *q;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3296 ngx_quic_client_id_t cid, item;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3297 ngx_quic_connection_t *qc;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3298
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3299 qc = c->quic;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3300
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3301 if (f->seqnum < qc->max_retired_seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3302 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3303 * An endpoint that receives a NEW_CONNECTION_ID frame with
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3304 * a sequence number smaller than the Retire Prior To field
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3305 * of a previously received NEW_CONNECTION_ID frame MUST send
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3306 * a corresponding RETIRE_CONNECTION_ID frame that retires
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3307 * the newly received connection ID, unless it has already
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3308 * done so for that sequence number.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3309 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3310
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3311 if (ngx_quic_retire_connection_id(c, pkt->level, f->seqnum) != NGX_OK) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3312 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3313 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3314
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3315 goto retire;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3316 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3317
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3318 cid = NULL;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3319
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3320 for (q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3321 q != ngx_queue_sentinel(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3322 q = ngx_queue_next(q))
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3323 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3324 item = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3325
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3326 if (item->seqnum == f->seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3327 cid = item;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3328 break;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3329 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3330 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3331
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3332 if (cid) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3333 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3334 * Transmission errors, timeouts and retransmissions might cause the
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3335 * same NEW_CONNECTION_ID frame to be received multiple times
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3336 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3337
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3338 if (cid->len != f->len
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3339 \|\| ngx_strncmp(cid->id, f->cid, f->len) != 0
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3340 \|\| ngx_strncmp(cid->sr_token, f->srt, NGX_QUIC_SRT_LEN) != 0)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3341 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3342 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3343 * ..a sequence number is used for different connection IDs,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3344 * the endpoint MAY treat that receipt as a connection error
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3345 * of type PROTOCOL_VIOLATION.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3346 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3347 qc->error = NGX_QUIC_ERR_PROTOCOL_VIOLATION;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3348 qc->error_reason = "seqnum refers to different connection id/token";
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3349 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3350 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3351
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3352 } else {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3353
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	3354 cid = ngx_quic_alloc_connection_id(c, qc);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3355 if (cid == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3356 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3357 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3358
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3359 cid->seqnum = f->seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3360 cid->len = f->len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3361 ngx_memcpy(cid->id, f->cid, f->len);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3362
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3363 ngx_memcpy(cid->sr_token, f->srt, NGX_QUIC_SRT_LEN);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3364
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3365 ngx_queue_insert_tail(&qc->client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3366 qc->nclient_ids++;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3367
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3368 /* always use latest available connection id */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3369 if (f->seqnum > qc->curr_seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3370 qc->scid.len = cid->len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3371 qc->scid.data = cid->id;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3372 qc->curr_seqnum = f->seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3373 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3374 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3375
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3376 retire:
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3377
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3378 if (qc->max_retired_seqnum && f->retire <= qc->max_retired_seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3379 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3380 * Once a sender indicates a Retire Prior To value, smaller values sent
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3381 * in subsequent NEW_CONNECTION_ID frames have no effect. A receiver
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3382 * MUST ignore any Retire Prior To fields that do not increase the
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3383 * largest received Retire Prior To value.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3384 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3385 goto done;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3386 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3387
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3388 qc->max_retired_seqnum = f->retire;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3389
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3390 q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3391
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3392 while (q != ngx_queue_sentinel(&qc->client_ids)) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3393
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3394 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3395 q = ngx_queue_next(q);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3396
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3397 if (cid->seqnum >= f->retire) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3398 continue;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3399 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3400
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3401 /* this connection id must be retired */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3402
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3403 if (ngx_quic_retire_connection_id(c, pkt->level, cid->seqnum)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3404 != NGX_OK)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3405 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3406 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3407 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3408
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3409 ngx_queue_remove(&cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3410 ngx_queue_insert_head(&qc->free_client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3411 qc->nclient_ids--;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3412 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3413
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3414 done:
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3415
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3416 if (qc->nclient_ids > qc->tp.active_connection_id_limit) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3417 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3418 * After processing a NEW_CONNECTION_ID frame and
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3419 * adding and retiring active connection IDs, if the number of active
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3420 * connection IDs exceeds the value advertised in its
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3421 * active_connection_id_limit transport parameter, an endpoint MUST
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3422 * close the connection with an error of type CONNECTION_ID_LIMIT_ERROR.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3423 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3424 qc->error = NGX_QUIC_ERR_CONNECTION_ID_LIMIT_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3425 qc->error_reason = "too many connection ids received";
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3426 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3427 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3428
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3429 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3430 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3431
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3432
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3433 static ngx_int_t
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3434 ngx_quic_retire_connection_id(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3435 enum ssl_encryption_level_t level, uint64_t seqnum)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3436 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3437 ngx_quic_frame_t *frame;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3438
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3439 frame = ngx_quic_alloc_frame(c, 0);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3440 if (frame == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3441 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3442 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3443
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3444 frame->level = level;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3445 frame->type = NGX_QUIC_FT_RETIRE_CONNECTION_ID;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3446 frame->u.retire_cid.sequence_number = seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3447
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3448 ngx_sprintf(frame->info, "RETIRE_CONNECTION_ID seqnum=%uL level=%d",
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3449 seqnum, frame->level);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3450
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3451 ngx_quic_queue_frame(c->quic, frame);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3452
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3453 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3454 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3455
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3456
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3457 static ngx_quic_client_id_t *
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	3458 ngx_quic_alloc_connection_id(ngx_connection_t c, ngx_quic_connection_t qc)
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3459 {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	3460 ngx_queue_t *q;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	3461 ngx_quic_client_id_t *cid;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3462
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3463 if (!ngx_queue_empty(&qc->free_client_ids)) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3464
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3465 q = ngx_queue_head(&qc->free_client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3466 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3467
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3468 ngx_queue_remove(&cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3469
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3470 ngx_memzero(cid, sizeof(ngx_quic_client_id_t));
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3471
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3472 } else {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3473
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3474 cid = ngx_pcalloc(c->pool, sizeof(ngx_quic_client_id_t));
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3475 if (cid == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3476 return NULL;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3477 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3478 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3479
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3480 return cid;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3481 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3482
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	3483
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3484 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3485 ngx_quic_queue_frame(ngx_quic_connection_t qc, ngx_quic_frame_t frame)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3486 {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3487 ngx_quic_send_ctx_t *ctx;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3488
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3489 ctx = ngx_quic_get_send_ctx(qc, frame->level);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3490
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3491 ngx_queue_insert_tail(&ctx->frames, &frame->queue);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3492
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3493 frame->len = ngx_quic_create_frame(NULL, frame);
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3494 /* always succeeds */
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3495
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3496 if (qc->closing) {
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3497 return;
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3498 }
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3499
8517 924882f42dea QUIC: do not artificially delay sending queued frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8516 diff changeset	3500 ngx_post_event(&qc->push, &ngx_posted_events);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3501 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3502
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3503
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3504 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3505 ngx_quic_output(ngx_connection_t *c)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3506 {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3507 ngx_uint_t i;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3508 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3509
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	3510 c->log->action = "sending frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	3511
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3512 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3513
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3514 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3515 if (ngx_quic_output_frames(c, &qc->send_ctx[i]) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3516 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3517 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3518 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3519
8322 d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 8321 diff changeset	3520 if (!qc->send_timer_set && !qc->closing) {
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3521 qc->send_timer_set = 1;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3522 ngx_add_timer(c->read, qc->tp.max_idle_timeout);
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3523 }
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	3524
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3525 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3526 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3527
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3528
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3529 static ngx_int_t
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3530 ngx_quic_output_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3531 {
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3532 size_t len, hlen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3533 ngx_uint_t need_ack;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3534 ngx_queue_t *q, range;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3535 ngx_quic_frame_t *f;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3536 ngx_quic_congestion_t *cg;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3537 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3538
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3539 qc = c->quic;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3540 cg = &qc->congestion;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3541
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3542 if (ngx_queue_empty(&ctx->frames)) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3543 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3544 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3545
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3546 q = ngx_queue_head(&ctx->frames);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3547 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3548
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3549 /* all frames in same send_ctx share same level */
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3550 hlen = (f->level == ssl_encryption_application) ? NGX_QUIC_MAX_SHORT_HEADER
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	3551 : NGX_QUIC_MAX_LONG_HEADER;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3552 hlen += EVP_GCM_TLS_TAG_LEN;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3553
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3554 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3555 len = 0;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3556 need_ack = 0;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3557 ngx_queue_init(&range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3558
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3559 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3560 /* process group of frames that fits into packet */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3561 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3562
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3563 if (len && hlen + len + f->len > qc->ctp.max_udp_payload_size) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3564 break;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3565 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3566
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3567 if (f->need_ack) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3568 need_ack = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3569 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3570
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3571 if (need_ack && cg->in_flight + len + f->len > cg->window) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3572 break;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3573 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3574
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3575 if (!qc->validated) {
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3576 /*
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3577 * Prior to validation, endpoints are limited in what they
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3578 * are able to send. During the handshake, a server cannot
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3579 * send more than three times the data it receives;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3580 */
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3581
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3582 if (((c->sent + len + f->len) / 3) > qc->received) {
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3583 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3584 "quic hit amplification limit"
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3585 " received %uz sent %O",
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3586 qc->received, c->sent);
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3587 break;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3588 }
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3589 }
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	3590
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3591 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3592
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3593 f->first = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3594
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3595 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3596 ngx_queue_insert_tail(&range, &f->queue);
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3597
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	3598 len += f->len;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3599
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3600 } while (q != ngx_queue_sentinel(&ctx->frames));
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3601
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3602 if (ngx_queue_empty(&range)) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3603 break;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3604 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3605
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3606 if (ngx_quic_send_frames(c, ctx, &range) != NGX_OK) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3607 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3608 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3609
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3610 } while (q != ngx_queue_sentinel(&ctx->frames));
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3611
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3612 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3613 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3614
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3615
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3616 static void
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3617 ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3618 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3619 ngx_queue_t *q;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3620 ngx_quic_frame_t *f;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3621
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3622 do {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3623 q = ngx_queue_head(frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3624
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3625 if (q == ngx_queue_sentinel(frames)) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3626 break;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3627 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3628
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3629 ngx_queue_remove(q);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3630
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3631 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3632
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3633 ngx_quic_free_frame(c, f);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3634 } while (1);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3635 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3636
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3637
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3638 static ngx_int_t
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3639 ngx_quic_send_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3640 ngx_queue_t *frames)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3641 {
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3642 ssize_t len;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3643 u_char *p;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3644 ngx_msec_t now;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3645 ngx_str_t out, res;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3646 ngx_queue_t *q;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3647 ngx_ssl_conn_t *ssl_conn;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3648 ngx_quic_frame_t f, start;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3649 ngx_quic_header_t pkt;
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3650 ngx_quic_secrets_t *keys;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3651 ngx_quic_connection_t *qc;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3652 static ngx_str_t initial_token = ngx_null_string;
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	3653 static u_char src[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	3654 static u_char dst[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3655
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3656 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3657 "quic ngx_quic_send_frames");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3658
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3659 ssl_conn = c->ssl ? c->ssl->connection : NULL;
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3660
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3661 q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3662 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3663
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3664 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3665
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3666 now = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3667
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3668 p = src;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3669 out.data = src;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3670
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3671 for (q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3672 q != ngx_queue_sentinel(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3673 q = ngx_queue_next(q))
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3674 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3675 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3676
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3677 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3678 "quic frame out: %s", f->info);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3679
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3680 len = ngx_quic_create_frame(p, f);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3681 if (len == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3682 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3683 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3684
8312 053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3685 if (f->need_ack) {
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3686 pkt.need_ack = 1;
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3687 }
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 8311 diff changeset	3688
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3689 p += len;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3690 f->pnum = ctx->pnum;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3691 f->last = now;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3692 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3693
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3694 out.len = p - out.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3695
8301 c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3696 while (out.len < 4) {
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3697 *p++ = NGX_QUIC_FT_PADDING;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3698 out.len++;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3699 }
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 8300 diff changeset	3700
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3701 qc = c->quic;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3702
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3703 keys = &c->quic->keys[start->level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3704
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3705 pkt.secret = &keys->server;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	3706
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3707 pkt.flags = NGX_QUIC_PKT_FIXED_BIT;
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3708
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3709 if (start->level == ssl_encryption_initial) {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3710 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_INITIAL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3711 pkt.token = initial_token;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3712
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3713 } else if (start->level == ssl_encryption_handshake) {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3714 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_HANDSHAKE;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3715
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3716 } else {
8370 262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3717 if (c->quic->key_phase) {
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3718 pkt.flags \|= NGX_QUIC_PKT_KPHASE;
262396242352 Reworked macros for parsing/assembling packet types. Vladimir Homutov <vl@nginx.com> parents: 8369 diff changeset	3719 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3720 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3721
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3722 ngx_quic_set_packet_number(&pkt, ctx);
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3723
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3724 pkt.log = c->log;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3725 pkt.level = start->level;
8344 e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 8343 diff changeset	3726 pkt.dcid = qc->scid;
e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 8343 diff changeset	3727 pkt.scid = qc->dcid;
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3728 pkt.payload = out;
8285 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 8284 diff changeset	3729
8289 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 8288 diff changeset	3730 res.data = dst;
8285 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 8284 diff changeset	3731
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3732 ngx_log_debug6(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3733 "quic packet ready: %ui bytes at level %d"
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3734 " need_ack: %d number: %L encoded %d:0x%xD",
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3735 out.len, start->level, pkt.need_ack, pkt.number,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3736 pkt.num_len, pkt.trunc);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3737
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3738 if (ngx_quic_encrypt(&pkt, ssl_conn, &res) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3739 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3740 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3741
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3742 len = c->send(c, res.data, res.len);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3743 if (len == NGX_ERROR \|\| (size_t) len != res.len) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3744 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3745 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3746
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3747 /* len == NGX_OK \|\| NGX_AGAIN */
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3748 ctx->pnum++;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3749
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3750 if (pkt.need_ack) {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3751 /* move frames into the sent queue to wait for ack */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3752
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3753 if (qc->closing) {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3754 /* if we are closing, any ack will be discarded */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3755 ngx_quic_free_frames(c, frames);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3756
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3757 } else {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3758 ngx_queue_add(&ctx->sent, frames);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3759 if (qc->pto.timer_set) {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3760 ngx_del_timer(&qc->pto);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3761 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3762 ngx_add_timer(&qc->pto, ngx_quic_pto(c, ctx));
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3763
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3764 start->plen = len;
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3765 }
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3766
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	3767 qc->congestion.in_flight += len;
8473 1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3768
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3769 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3770 "quic congestion send if:%uz",
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3771 qc->congestion.in_flight);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3772 } else {
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3773 /* no ack is expected for this frames, so we can free them */
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3774 ngx_quic_free_frames(c, frames);
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3775 }
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3776
1b9db5c8c29b QUIC: reworked ngx_quic_send_frames() function. Vladimir Homutov <vl@nginx.com> parents: 8472 diff changeset	3777 return NGX_OK;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3778 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3779
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3780
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3781 static void
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3782 ngx_quic_set_packet_number(ngx_quic_header_t pkt, ngx_quic_send_ctx_t ctx)
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3783 {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3784 uint64_t delta;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3785
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3786 delta = ctx->pnum - ctx->largest_ack;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3787 pkt->number = ctx->pnum;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3788
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3789 if (delta <= 0x7F) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3790 pkt->num_len = 1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3791 pkt->trunc = ctx->pnum & 0xff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3792
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3793 } else if (delta <= 0x7FFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3794 pkt->num_len = 2;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3795 pkt->flags \|= 0x1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3796 pkt->trunc = ctx->pnum & 0xffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3797
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3798 } else if (delta <= 0x7FFFFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3799 pkt->num_len = 3;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3800 pkt->flags \|= 0x2;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3801 pkt->trunc = ctx->pnum & 0xffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3802
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3803 } else {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3804 pkt->num_len = 4;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3805 pkt->flags \|= 0x3;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3806 pkt->trunc = ctx->pnum & 0xffffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3807 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3808 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3809
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3810
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	3811 static void
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	3812 ngx_quic_pto_handler(ngx_event_t *ev)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3813 {
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3814 ngx_uint_t i;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3815 ngx_queue_t *q;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3816 ngx_connection_t *c;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3817 ngx_quic_frame_t *start;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3818 ngx_quic_send_ctx_t *ctx;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3819 ngx_quic_connection_t *qc;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3820
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	3821 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic pto timer");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3822
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3823 c = ev->data;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3824 qc = c->quic;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3825
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3826 qc->pto_count++;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3827
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3828 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3829
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3830 ctx = &qc->send_ctx[i];
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3831
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3832 if (ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3833 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3834 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3835
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3836 q = ngx_queue_head(&ctx->sent);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3837 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3838
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3839 if (start->pnum <= ctx->largest_ack
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3840 && ctx->largest_ack != (uint64_t) -1)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3841 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3842 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3843 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3844
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3845 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8519 de7d6d943f68 QUIC: fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8518 diff changeset	3846 "quic pto pnum:%uL pto_count:%ui level:%d",
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3847 start->pnum, c->quic->pto_count, start->level);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3848
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3849 ngx_quic_resend_frames(c, ctx);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3850 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3851 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3852
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3853
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3854 static void
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3855 ngx_quic_push_handler(ngx_event_t *ev)
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3856 {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3857 ngx_connection_t *c;
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3858
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3859 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic push timer");
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3860
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3861 c = ev->data;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3862
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3863 if (ngx_quic_output(c) != NGX_OK) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3864 ngx_quic_close_connection(c, NGX_ERROR);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3865 return;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3866 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3867 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3868
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3869
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3870 static
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3871 void ngx_quic_lost_handler(ngx_event_t *ev)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3872 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3873 ngx_connection_t *c;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3874
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3875 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic lost timer");
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3876
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3877 c = ev->data;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3878
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3879 if (ngx_quic_detect_lost(c) != NGX_OK) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3880 ngx_quic_close_connection(c, NGX_ERROR);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3881 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3882 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3883
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3884
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3885 static ngx_int_t
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3886 ngx_quic_detect_lost(ngx_connection_t *c)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3887 {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3888 ngx_uint_t i;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3889 ngx_msec_t now, wait, min_wait, thr;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3890 ngx_queue_t *q;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3891 ngx_quic_frame_t *start;
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3892 ngx_quic_send_ctx_t *ctx;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3893 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3894
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3895 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3896 now = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3897
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3898 min_wait = 0;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3899
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3900 thr = NGX_QUIC_TIME_THR * ngx_max(qc->latest_rtt, qc->avg_rtt);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3901 thr = ngx_max(thr, NGX_QUIC_TIME_GRANULARITY);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3902
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3903 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3904
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3905 ctx = &qc->send_ctx[i];
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3906
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3907 if (ctx->largest_ack == (uint64_t) -1) {
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3908 continue;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3909 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3910
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3911 while (!ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3912
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3913 q = ngx_queue_head(&ctx->sent);
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3914 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3915
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3916 if (start->pnum > ctx->largest_ack) {
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3917 break;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3918 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	3919
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3920 wait = start->last + thr - now;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3921
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3922 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8519 de7d6d943f68 QUIC: fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8518 diff changeset	3923 "quic detect_lost pnum:%uL thr:%M wait:%i level:%d",
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3924 start->pnum, thr, (ngx_int_t) wait, start->level);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3925
8516 355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3926 if ((ngx_msec_int_t) wait > 0
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3927 && ctx->largest_ack - start->pnum < NGX_QUIC_PKT_THR)
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3928 {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3929
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3930 if (min_wait == 0 \|\| wait < min_wait) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3931 min_wait = wait;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3932 }
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3933
8516 355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	3934 break;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3935 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3936
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3937 ngx_quic_resend_frames(c, ctx);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3938 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3939 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3940
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3941 /* no more preceeding packets */
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3942
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3943 if (min_wait == 0) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3944 qc->pto.handler = ngx_quic_pto_handler;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3945 return NGX_OK;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3946 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3947
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3948 qc->pto.handler = ngx_quic_lost_handler;
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3949
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3950 if (qc->pto.timer_set) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3951 ngx_del_timer(&qc->pto);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3952 }
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	3953
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3954 ngx_add_timer(&qc->pto, min_wait);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3955
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3956 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3957 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3958
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3959
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3960 static void
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3961 ngx_quic_resend_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3962 {
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3963 ngx_queue_t *q;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3964 ngx_quic_frame_t f, start;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3965 ngx_quic_connection_t *qc;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3966
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3967 qc = c->quic;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3968 q = ngx_queue_head(&ctx->sent);
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3969 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3970
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3971 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3972 "quic resend packet pnum:%uL", start->pnum);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3973
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3974 do {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3975 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3976
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3977 if (f->pnum != start->pnum) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3978 break;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3979 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3980
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3981 q = ngx_queue_next(q);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3982
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3983 ngx_queue_remove(&f->queue);
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3984 ngx_queue_insert_tail(&ctx->frames, &f->queue);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3985
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3986 } while (q != ngx_queue_sentinel(&ctx->sent));
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3987
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3988 ngx_quic_congestion_lost(c, start);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3989
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3990 if (qc->closing) {
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3991 return;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3992 }
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3993
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	3994 ngx_post_event(&qc->push, &ngx_posted_events);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3995 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3996
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3997
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3998 ngx_connection_t *
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	3999 ngx_quic_open_stream(ngx_connection_t *c, ngx_uint_t bidi)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4000 {
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4001 size_t rcvbuf_size;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4002 uint64_t id;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4003 ngx_quic_stream_t qs, sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4004 ngx_quic_connection_t *qc;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4005
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4006 qs = c->qs;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4007 qc = qs->parent->quic;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4008
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4009 if (bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4010 if (qc->streams.server_streams_bidi
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4011 >= qc->streams.server_max_streams_bidi)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4012 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4013 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4014 "quic too many server bidi streams: %uL",
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4015 qc->streams.server_streams_bidi);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4016 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4017 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4018
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4019 id = (qc->streams.server_streams_bidi << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4020 \| NGX_QUIC_STREAM_SERVER_INITIATED;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4021
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4022 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4023 "quic creating server bidi stream %uL/%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4024 qc->streams.server_streams_bidi,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4025 qc->streams.server_max_streams_bidi, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4026
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4027 qc->streams.server_streams_bidi++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4028 rcvbuf_size = qc->tp.initial_max_stream_data_bidi_local;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4029
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4030 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4031 if (qc->streams.server_streams_uni
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4032 >= qc->streams.server_max_streams_uni)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4033 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4034 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4035 "quic too many server uni streams: %uL",
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4036 qc->streams.server_streams_uni);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4037 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4038 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4039
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4040 id = (qc->streams.server_streams_uni << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4041 \| NGX_QUIC_STREAM_SERVER_INITIATED
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4042 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4043
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4044 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4045 "quic creating server uni stream %uL/%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4046 qc->streams.server_streams_uni,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4047 qc->streams.server_max_streams_uni, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4048
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4049 qc->streams.server_streams_uni++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4050 rcvbuf_size = 0;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4051 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4052
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4053 sn = ngx_quic_create_stream(qs->parent, id, rcvbuf_size);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4054 if (sn == NULL) {
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4055 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4056 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4057
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4058 return sn->c;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4059 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4060
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4061
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4062 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4063 ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4064 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4065 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4066 ngx_rbtree_node_t **p;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4067 ngx_quic_stream_t qn, qnt;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4068
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4069 for ( ;; ) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4070 qn = (ngx_quic_stream_t *) node;
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4071 qnt = (ngx_quic_stream_t *) temp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4072
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4073 p = (qn->id < qnt->id) ? &temp->left : &temp->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4074
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4075 if (*p == sentinel) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4076 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4077 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4078
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4079 temp = *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4080 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4081
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4082 *p = node;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4083 node->parent = temp;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4084 node->left = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4085 node->right = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4086 ngx_rbt_red(node);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4087 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4088
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4089
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4090 static ngx_quic_stream_t *
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4091 ngx_quic_find_stream(ngx_rbtree_t *rbtree, uint64_t id)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4092 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4093 ngx_rbtree_node_t node, sentinel;
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4094 ngx_quic_stream_t *qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4095
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4096 node = rbtree->root;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4097 sentinel = rbtree->sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4098
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4099 while (node != sentinel) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4100 qn = (ngx_quic_stream_t *) node;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4101
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4102 if (id == qn->id) {
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4103 return qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4104 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4105
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	4106 node = (id < qn->id) ? node->left : node->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4107 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4108
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4109 return NULL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4110 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4111
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4112
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4113 static ngx_quic_stream_t *
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4114 ngx_quic_create_client_stream(ngx_connection_t *c, uint64_t id)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4115 {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4116 size_t n;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4117 uint64_t min_id;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4118 ngx_quic_stream_t *sn;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4119 ngx_quic_connection_t *qc;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4120
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4121 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4122 "quic stream id 0x%xL is new", id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4123
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4124 qc = c->quic;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4125
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4126 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4127
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4128 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4129 if ((id >> 2) < qc->streams.server_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4130 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4131 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4132
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4133 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4134 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4135 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4136
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4137 if ((id >> 2) < qc->streams.client_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4138 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4139 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4140
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4141 if ((id >> 2) >= qc->streams.client_max_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4142 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4143 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4144 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4145
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4146 min_id = (qc->streams.client_streams_uni << 2)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4147 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4148 qc->streams.client_streams_uni = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4149 n = qc->tp.initial_max_stream_data_uni;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4150
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4151 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4152
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4153 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4154 if ((id >> 2) < qc->streams.server_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4155 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4156 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4157
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4158 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4159 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4160 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4161
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4162 if ((id >> 2) < qc->streams.client_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4163 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4164 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4165
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4166 if ((id >> 2) >= qc->streams.client_max_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4167 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4168 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4169 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4170
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4171 min_id = (qc->streams.client_streams_bidi << 2);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4172 qc->streams.client_streams_bidi = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4173 n = qc->tp.initial_max_stream_data_bidi_remote;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4174 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4175
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4176 if (n < NGX_QUIC_STREAM_BUFSIZE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4177 n = NGX_QUIC_STREAM_BUFSIZE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4178 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4179
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4180 /*
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4181 * 2.1. Stream Types and Identifiers
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4182 *
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4183 * Within each type, streams are created with numerically increasing
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4184 * stream IDs. A stream ID that is used out of order results in all
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4185 * streams of that type with lower-numbered stream IDs also being
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4186 * opened.
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4187 */
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4188
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4189 for ( /* void */ ; min_id < id; min_id += 0x04) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4190
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4191 sn = ngx_quic_create_stream(c, min_id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4192 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4193 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4194 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4195
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4196 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4197 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4198
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4199 return ngx_quic_create_stream(c, id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4200 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4201
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4202
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4203 static ngx_quic_stream_t *
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4204 ngx_quic_create_stream(ngx_connection_t *c, uint64_t id, size_t rcvbuf_size)
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4205 {
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4206 ngx_log_t *log;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4207 ngx_pool_t *pool;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4208 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4209 ngx_pool_cleanup_t *cln;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4210 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4211
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4212 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4213 "quic stream id 0x%xL create", id);
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4214
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4215 qc = c->quic;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4216
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4217 pool = ngx_create_pool(NGX_DEFAULT_POOL_SIZE, c->log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4218 if (pool == NULL) {
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4219 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4220 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4221
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4222 sn = ngx_pcalloc(pool, sizeof(ngx_quic_stream_t));
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4223 if (sn == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4224 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4225 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4226 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4227
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4228 sn->node.key = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4229 sn->parent = c;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4230 sn->id = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4231
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4232 sn->b = ngx_create_temp_buf(pool, rcvbuf_size);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4233 if (sn->b == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4234 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4235 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4236 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4237
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4238 ngx_queue_init(&sn->fs.frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4239
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4240 log = ngx_palloc(pool, sizeof(ngx_log_t));
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4241 if (log == NULL) {
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4242 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4243 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4244 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4245
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4246 log = c->log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4247 pool->log = log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4248
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4249 sn->c = ngx_get_connection(-1, log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4250 if (sn->c == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4251 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4252 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4253 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4254
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4255 sn->c->qs = sn;
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	4256 sn->c->type = SOCK_STREAM;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4257 sn->c->pool = pool;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4258 sn->c->ssl = c->ssl;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4259 sn->c->sockaddr = c->sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4260 sn->c->listening = c->listening;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4261 sn->c->addr_text = c->addr_text;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4262 sn->c->local_sockaddr = c->local_sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4263 sn->c->number = ngx_atomic_fetch_add(ngx_connection_counter, 1);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4264
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4265 sn->c->recv = ngx_quic_stream_recv;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4266 sn->c->send = ngx_quic_stream_send;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4267 sn->c->send_chain = ngx_quic_stream_send_chain;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4268
8479 b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	4269 sn->c->read->log = log;
b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	4270 sn->c->write->log = log;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4271
8362 44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	4272 log->connection = sn->c->number;
44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	4273
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4274 if ((id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4275 \|\| (id & NGX_QUIC_STREAM_SERVER_INITIATED))
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4276 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4277 sn->c->write->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4278 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4279
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4280 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4281 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4282 sn->send_max_data = qc->ctp.initial_max_stream_data_uni;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4283 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4284
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4285 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4286 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4287 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_remote;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4288 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4289 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_local;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4290 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4291 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4292
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4293 cln = ngx_pool_cleanup_add(pool, 0);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4294 if (cln == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4295 ngx_close_connection(sn->c);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4296 ngx_destroy_pool(pool);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4297 return NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4298 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4299
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4300 cln->handler = ngx_quic_stream_cleanup_handler;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4301 cln->data = sn->c;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4302
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4303 ngx_rbtree_insert(&c->quic->streams.tree, &sn->node);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	4304
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4305 return sn;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4306 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4307
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	4308
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4309 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4310 ngx_quic_stream_recv(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4311 {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4312 ssize_t len;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4313 ngx_buf_t *b;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4314 ngx_event_t *rev;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4315 ngx_connection_t *pc;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4316 ngx_quic_frame_t *frame;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4317 ngx_quic_stream_t *qs;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4318 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4319
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4320 qs = c->qs;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4321 b = qs->b;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4322 pc = qs->parent;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4323 qc = pc->quic;
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4324 rev = c->read;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4325
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4326 if (rev->error) {
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4327 return NGX_ERROR;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4328 }
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4329
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4330 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4331 "quic stream id 0x%xL recv: eof:%d, avail:%z",
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4332 qs->id, rev->pending_eof, b->last - b->pos);
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4333
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4334 if (b->pos == b->last) {
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4335 rev->ready = 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4336
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4337 if (rev->pending_eof) {
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4338 rev->eof = 1;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4339 return 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4340 }
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	4341
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4342 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4343 "quic stream id 0x%xL recv() not ready", qs->id);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4344 return NGX_AGAIN;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4345 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4346
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4347 len = ngx_min(b->last - b->pos, (ssize_t) size);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4348
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4349 ngx_memcpy(buf, b->pos, len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4350
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4351 b->pos += len;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4352 qc->streams.received += len;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4353
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4354 if (b->pos == b->last) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4355 b->pos = b->start;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4356 b->last = b->start;
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4357 rev->ready = rev->pending_eof;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4358 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4359
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4360 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4361 "quic stream id 0x%xL recv: %z of %uz", qs->id, len, size);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4362
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4363 if (!rev->pending_eof) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4364 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4365 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4366 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4367 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4368
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4369 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4370 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4371 frame->u.max_stream_data.id = qs->id;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4372 frame->u.max_stream_data.limit = qs->fs.received + (b->pos - b->start)
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4373 + (b->end - b->last);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4374
8499 b0e74a54c98b QUIC: consistent Stream ID logging format. Sergey Kandaurov <pluknet@nginx.com> parents: 8496 diff changeset	4375 ngx_sprintf(frame->info,
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4376 "MAX_STREAM_DATA id:0x%xL limit:%uL l=%d on recv",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4377 frame->u.max_stream_data.id,
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4378 frame->u.max_stream_data.limit,
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4379 frame->level);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4380
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4381 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4382 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4383
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4384 if ((qc->streams.recv_max_data / 2) < qc->streams.received) {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4385
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4386 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4387
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4388 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4389 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4390 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4391
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4392 qc->streams.recv_max_data *= 2;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4393
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4394 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4395 frame->type = NGX_QUIC_FT_MAX_DATA;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4396 frame->u.max_data.max_data = qc->streams.recv_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4397
8500 12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4398 ngx_sprintf(frame->info, "MAX_DATA max_data:%uL level=%d on recv",
12576ac9556d QUIC: fixed format specifiers and removed casts. Sergey Kandaurov <pluknet@nginx.com> parents: 8499 diff changeset	4399 frame->u.max_data.max_data, frame->level);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4400
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4401 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4402
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4403 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4404 "quic stream id 0x%xL recv: increased max data: %uL",
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4405 qs->id, qc->streams.recv_max_data);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4406 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	4407
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4408 return len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4409 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4410
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4411
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4412 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4413 ngx_quic_stream_send(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4414 {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4415 ngx_buf_t b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4416 ngx_chain_t cl;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4417
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4418 ngx_memzero(&b, sizeof(ngx_buf_t));
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4419
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4420 b.memory = 1;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4421 b.pos = buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4422 b.last = buf + size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4423
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4424 cl.buf = &b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4425 cl.next = NULL;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4426
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4427 if (ngx_quic_stream_send_chain(c, &cl, 0) == NGX_CHAIN_ERROR) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4428 return NGX_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4429 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4430
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4431 if (b.pos == buf) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4432 return NGX_AGAIN;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4433 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4434
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4435 return b.pos - buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4436 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4437
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4438
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4439 static ngx_chain_t *
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4440 ngx_quic_stream_send_chain(ngx_connection_t c, ngx_chain_t in, off_t limit)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4441 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4442 u_char *p;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4443 size_t n, max, max_frame, max_flow, max_limit, len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4444 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4445 size_t sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4446 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4447 ngx_buf_t *b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4448 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4449 ngx_uint_t nframes;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4450 #endif
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4451 ngx_event_t *wev;
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4452 ngx_chain_t *cl;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4453 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4454 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4455 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4456 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4457
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4458 qs = c->qs;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4459 pc = qs->parent;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4460 qc = pc->quic;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4461 wev = c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4462
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	4463 if (wev->error) {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4464 return NGX_CHAIN_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4465 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4466
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4467 max_frame = ngx_quic_max_stream_frame(qc);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4468 max_flow = ngx_quic_max_stream_flow(c);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4469 max_limit = limit;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4470
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4471 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4472 sent = 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4473 nframes = 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4474 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4475
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4476 for ( ;; ) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4477 max = ngx_min(max_frame, max_flow);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4478
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4479 if (limit) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4480 max = ngx_min(max, max_limit);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4481 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4482
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4483 for (cl = in, n = 0; in; in = in->next) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4484
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4485 if (!ngx_buf_in_memory(in->buf)) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4486 continue;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4487 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4488
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4489 n += ngx_buf_size(in->buf);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4490
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4491 if (n > max) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4492 n = max;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4493 break;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4494 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4495 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4496
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4497 if (n == 0) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4498 wev->ready = (max_flow ? 1 : 0);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4499 break;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4500 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4501
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4502 frame = ngx_quic_alloc_frame(pc, n);
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4503 if (frame == NULL) {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4504 return NGX_CHAIN_ERROR;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4505 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4506
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4507 frame->level = ssl_encryption_application;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4508 frame->type = NGX_QUIC_FT_STREAM6; /* OFF=1 LEN=1 FIN=0 */
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4509 frame->u.stream.off = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4510 frame->u.stream.len = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4511 frame->u.stream.fin = 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4512
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4513 frame->u.stream.type = frame->type;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4514 frame->u.stream.stream_id = qs->id;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4515 frame->u.stream.offset = c->sent;
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4516 frame->u.stream.length = n;
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4517 frame->u.stream.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4518
8541 dcbb58e7ed11 QUIC: added logging output stream frame offset. Roman Arutyunyan <arut@nginx.com> parents: 8540 diff changeset	4519 ngx_sprintf(frame->info, "STREAM id:0x%xL offset:%O len:%uz level:%d",
dcbb58e7ed11 QUIC: added logging output stream frame offset. Roman Arutyunyan <arut@nginx.com> parents: 8540 diff changeset	4520 qs->id, c->sent, n, frame->level);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4521
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4522 c->sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4523 qc->streams.sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4524 max_flow -= n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4525
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4526 if (limit) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4527 max_limit -= n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4528 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4529
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4530 #if (NGX_DEBUG)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4531 sent += n;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4532 nframes++;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4533 #endif
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4534
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4535 for (p = frame->data; n > 0; cl = cl->next) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4536 b = cl->buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4537
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4538 if (!ngx_buf_in_memory(b)) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4539 continue;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4540 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4541
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4542 len = ngx_min(n, (size_t) (b->last - b->pos));
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4543 p = ngx_cpymem(p, b->pos, len);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4544
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4545 b->pos += len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4546 n -= len;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4547 }
8345 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4548
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 8344 diff changeset	4549 ngx_quic_queue_frame(qc, frame);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4550 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4551
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4552 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4553 "quic send_chain sent:%uz, frames:%ui", sent, nframes);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4554
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4555 return in;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4556 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4557
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4558
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4559 static size_t
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4560 ngx_quic_max_stream_frame(ngx_quic_connection_t *qc)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4561 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4562 /*
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4563 * we need to fit at least 1 frame into a packet, thus account head/tail;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4564 * 25 = 1 + 8x3 is max header for STREAM frame, with 1 byte for frame type
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4565 */
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4566
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4567 return qc->ctp.max_udp_payload_size - NGX_QUIC_MAX_SHORT_HEADER - 25
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4568 - EVP_GCM_TLS_TAG_LEN;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4569 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4570
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4571
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4572 static size_t
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4573 ngx_quic_max_stream_flow(ngx_connection_t *c)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4574 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4575 size_t size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4576 uint64_t sent, unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4577 ngx_quic_stream_t *qs;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4578 ngx_quic_connection_t *qc;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4579
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4580 qs = c->qs;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4581 qc = qs->parent->quic;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4582
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4583 size = NGX_QUIC_STREAM_BUFSIZE;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4584 sent = c->sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4585 unacked = sent - qs->acked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4586
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4587 if (qc->streams.send_max_data == 0) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4588 qc->streams.send_max_data = qc->ctp.initial_max_data;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4589 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4590
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4591 if (unacked >= NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4592 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4593 "quic send flow hit buffer size");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4594 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4595 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4596
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4597 if (unacked + size > NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4598 size = NGX_QUIC_STREAM_BUFSIZE - unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4599 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4600
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4601 if (qc->streams.sent >= qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4602 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4603 "quic send flow hit MAX_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4604 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4605 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4606
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4607 if (qc->streams.sent + size > qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4608 size = qc->streams.send_max_data - qc->streams.sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4609 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4610
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4611 if (sent >= qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4612 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4613 "quic send flow hit MAX_STREAM_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4614 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4615 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4616
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4617 if (sent + size > qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4618 size = qs->send_max_data - sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4619 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4620
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4621 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4622 "quic send flow: %uz", size);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4623
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	4624 return size;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4625 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4626
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4627
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4628 static void
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4629 ngx_quic_stream_cleanup_handler(void *data)
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4630 {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4631 ngx_connection_t *c = data;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4632
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4633 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4634 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4635 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4636 ngx_quic_connection_t *qc;
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4637
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4638 qs = c->qs;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4639 pc = qs->parent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4640 qc = pc->quic;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4641
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4642 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4643 "quic stream id 0x%xL cleanup", qs->id);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4644
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4645 ngx_rbtree_delete(&qc->streams.tree, &qs->node);
8348 d42b50d239f4 Fixed memory leak with reordered stream frames. Vladimir Homutov <vl@nginx.com> parents: 8346 diff changeset	4646 ngx_quic_free_frames(pc, &qs->fs.frames);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4647
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4648 if (qc->closing) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	4649 /* schedule handler call to continue ngx_quic_close_connection() */
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4650 ngx_post_event(pc->read, &ngx_posted_events);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4651 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4652 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	4653
8528 97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4654 if ((qs->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4655 \|\| (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0)
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4656 {
8539 62db595a86b5 QUIC: do not send STOP_SENDING after STREAM fin. Roman Arutyunyan <arut@nginx.com> parents: 8538 diff changeset	4657 if (!c->read->pending_eof && !c->read->error) {
8528 97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4658 frame = ngx_quic_alloc_frame(pc, 0);
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4659 if (frame == NULL) {
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4660 return;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4661 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4662
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4663 frame->level = ssl_encryption_application;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4664 frame->type = NGX_QUIC_FT_STOP_SENDING;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4665 frame->u.stop_sending.id = qs->id;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4666 frame->u.stop_sending.error_code = 0x100; /* HTTP/3 no error */
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4667
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4668 ngx_sprintf(frame->info, "STOP_SENDING id:0x%xL err:0x%xL level:%d",
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4669 qs->id, frame->u.stop_sending.error_code, frame->level);
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4670
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4671 ngx_quic_queue_frame(qc, frame);
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4672 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4673 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	4674
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4675 if ((qs->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4676 frame = ngx_quic_alloc_frame(pc, 0);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4677 if (frame == NULL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4678 return;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4679 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4680
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4681 frame->level = ssl_encryption_application;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4682 frame->type = NGX_QUIC_FT_MAX_STREAMS;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4683
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4684 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4685 frame->u.max_streams.limit = ++qc->streams.client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4686 frame->u.max_streams.bidi = 0;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4687
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4688 } else {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4689 frame->u.max_streams.limit = ++qc->streams.client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4690 frame->u.max_streams.bidi = 1;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4691 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4692
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4693 ngx_sprintf(frame->info, "MAX_STREAMS limit:%uL bidi:%ui level=%d",
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4694 frame->u.max_streams.limit,
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4695 frame->u.max_streams.bidi,
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4696 (int) frame->level);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4697
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4698 ngx_quic_queue_frame(qc, frame);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4699
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4700 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4701 /* do not send fin for client unidirectional streams */
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4702 return;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4703 }
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4704 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4705
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4706 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8478 d2f716e668e8 Fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8477 diff changeset	4707 "quic stream id 0x%xL send fin", qs->id);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4708
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4709 frame = ngx_quic_alloc_frame(pc, 0);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4710 if (frame == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4711 return;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4712 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4713
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4714 frame->level = ssl_encryption_application;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4715 frame->type = NGX_QUIC_FT_STREAM7; /* OFF=1 LEN=1 FIN=1 */
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4716 frame->u.stream.off = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4717 frame->u.stream.len = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4718 frame->u.stream.fin = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4719
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4720 frame->u.stream.type = frame->type;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4721 frame->u.stream.stream_id = qs->id;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4722 frame->u.stream.offset = c->sent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4723 frame->u.stream.length = 0;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4724 frame->u.stream.data = NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4725
8541 dcbb58e7ed11 QUIC: added logging output stream frame offset. Roman Arutyunyan <arut@nginx.com> parents: 8540 diff changeset	4726 ngx_sprintf(frame->info, "STREAM id:0x%xL offset:%O fin:1 level:%d",
dcbb58e7ed11 QUIC: added logging output stream frame offset. Roman Arutyunyan <arut@nginx.com> parents: 8540 diff changeset	4727 qs->id, c->sent, frame->level);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4728
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4729 ngx_quic_queue_frame(qc, frame);
8293 1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	4730
1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	4731 (void) ngx_quic_output(pc);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4732 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4733
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	4734
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4735 static ngx_quic_frame_t *
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4736 ngx_quic_alloc_frame(ngx_connection_t *c, size_t size)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4737 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4738 u_char *p;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4739 ngx_queue_t *q;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4740 ngx_quic_frame_t *frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4741 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4742
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4743 if (size) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4744 p = ngx_alloc(size, c->log);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4745 if (p == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4746 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4747 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4748
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4749 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4750 p = NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4751 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4752
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4753 qc = c->quic;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4754
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4755 if (!ngx_queue_empty(&qc->free_frames)) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4756
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4757 q = ngx_queue_head(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4758 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4759
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4760 ngx_queue_remove(&frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4761
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4762 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4763 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4764 "quic reuse frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4765 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4766
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4767 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4768 frame = ngx_pcalloc(c->pool, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4769 if (frame == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4770 ngx_free(p);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4771 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4772 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4773
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4774 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4775 ++qc->nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4776 #endif
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4777
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4778 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4779 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4780 "quic alloc frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4781 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4782 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4783
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4784 ngx_memzero(frame, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4785
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4786 frame->data = p;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4787
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4788 return frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4789 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4790
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4791
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4792 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4793 ngx_quic_congestion_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4794 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4795 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4796 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4797 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4798
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4799 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4800 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4801 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4802
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4803 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4804 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4805
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4806 cg->in_flight -= f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4807
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4808 timer = f->last - cg->recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4809
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4810 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4811 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4812 "quic congestion ack recovery win:%uz, ss:%uz, if:%uz",
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4813 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4814
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4815 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4816 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4817
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4818 if (cg->window < cg->ssthresh) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4819 cg->window += f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4820
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4821 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4822 "quic congestion slow start win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4823 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4824
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4825 } else {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4826 cg->window += qc->tp.max_udp_payload_size * f->plen / cg->window;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4827
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4828 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4829 "quic congestion avoidance win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4830 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4831 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4832
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4833 /* prevent recovery_start from wrapping */
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4834
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4835 timer = cg->recovery_start - ngx_current_msec + qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4836
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4837 if ((ngx_msec_int_t) timer < 0) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4838 cg->recovery_start = ngx_current_msec - qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4839 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4840 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4841
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4842
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4843 static void
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4844 ngx_quic_congestion_lost(ngx_connection_t c, ngx_quic_frame_t f)
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4845 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4846 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4847 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4848 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4849
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4850 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4851 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4852 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4853
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4854 qc = c->quic;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4855 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4856
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4857 cg->in_flight -= f->plen;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4858
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4859 timer = f->last - cg->recovery_start;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4860
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4861 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4862 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4863 "quic congestion lost recovery win:%uz, ss:%uz, if:%uz",
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4864 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	4865
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4866 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4867 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4868
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4869 cg->recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4870 cg->window /= 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4871
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	4872 if (cg->window < qc->tp.max_udp_payload_size * 2) {
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	4873 cg->window = qc->tp.max_udp_payload_size * 2;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4874 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4875
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4876 cg->ssthresh = cg->window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4877
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4878 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4879 "quic congestion lost win:%uz, ss:%uz, if:%uz",
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4880 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4881 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4882
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4883
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	4884 static void
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4885 ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4886 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4887 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4888
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4889 qc = c->quic;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4890
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4891 if (frame->data) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4892 ngx_free(frame->data);
8394 df18ae7161b8 Assorted fixes. Sergey Kandaurov <pluknet@nginx.com> parents: 8393 diff changeset	4893 frame->data = NULL;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4894 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4895
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4896 ngx_queue_insert_head(&qc->free_frames, &frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4897
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4898 #ifdef NGX_QUIC_DEBUG_FRAMES_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4899 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4900 "quic free frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	4901 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	4902 }

Mercurial > hg > nginx

annotate src/event/ngx_event_quic.c @ 8561:b4ef79ef1c23 quic