nginx: src/event/quic/ngx_event

annotate src/event/quic/ngx_event_quic.c @ 8734:c61fcdc1b8e3 quic

UDP: extended datagram context. Sometimes it is required to process datagram properties at higher level (i.e. QUIC is interested in source address which may change and IP options). The patch adds ngx_udp_dgram_t structure used to pass packet-related information in c->udp.

author	Vladimir Homutov <vl@nginx.com>
date	Fri, 02 Apr 2021 18:58:19 +0300
parents	90ae21799f67
children	9ce6d80df113

rev	line source
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	1
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2 /*
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	3 * Copyright (C) Nginx, Inc.
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	4 */
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	5
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	6
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	7 #include <ngx_config.h>
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	8 #include <ngx_core.h>
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	9 #include <ngx_event.h>
8486 d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	10 #include <ngx_event_quic_transport.h>
d0ac4449a07f QUIC: fixed bulding perl module by reducing header pollution. Sergey Kandaurov <pluknet@nginx.com> parents: 8483 diff changeset	11 #include <ngx_event_quic_protection.h>
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	12 #include <ngx_sha1.h>
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	13
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	14
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	15 /* 0-RTT and 1-RTT data exist in the same packet number space,
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	16 * so we have 3 packet number spaces:
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	17 *
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	18 * 0 - Initial
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	19 * 1 - Handshake
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	20 * 2 - 0-RTT and 1-RTT
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	21 */
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	22 #define ngx_quic_get_send_ctx(qc, level) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	23 ((level) == ssl_encryption_initial) ? &((qc)->send_ctx[0]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	24 : (((level) == ssl_encryption_handshake) ? &((qc)->send_ctx[1]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	25 : &((qc)->send_ctx[2]))
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	26
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	27 #define ngx_quic_lost_threshold(qc) \
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	28 ngx_max(NGX_QUIC_TIME_THR * ngx_max((qc)->latest_rtt, (qc)->avg_rtt), \
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	29 NGX_QUIC_TIME_GRANULARITY)
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	30
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	31 #define NGX_QUIC_SEND_CTX_LAST (NGX_QUIC_ENCRYPTION_LAST - 1)
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	32
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	33 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	34 * 7.4. Cryptographic Message Buffering
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	35 * Implementations MUST support buffering at least 4096 bytes of data
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	36 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	37 #define NGX_QUIC_MAX_BUFFERED 65535
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	38
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	39 #define NGX_QUIC_STREAM_GONE (void *) -1
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	40
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	41 #define NGX_QUIC_UNSET_PN (uint64_t) -1
85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	42
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	43 /*
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	44 * Endpoints MUST discard packets that are too small to be valid QUIC
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	45 * packets. With the set of AEAD functions defined in [QUIC-TLS],
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	46 * packets that are smaller than 21 bytes are never valid.
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	47 */
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	48 #define NGX_QUIC_MIN_PKT_LEN 21
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	49
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	50 #define NGX_QUIC_MIN_SR_PACKET 43 /* 5 random + 16 srt + 22 padding */
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	51 #define NGX_QUIC_MAX_SR_PACKET 1200
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	52
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	53 #define NGX_QUIC_MAX_ACK_GAP 2
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	54
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	55
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	56 typedef struct {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	57 ngx_rbtree_t tree;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	58 ngx_rbtree_node_t sentinel;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	59
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	60 uint64_t received;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	61 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	62 uint64_t recv_max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	63 uint64_t send_max_data;
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	64
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	65 uint64_t server_max_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	66 uint64_t server_max_streams_bidi;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	67 uint64_t server_streams_uni;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	68 uint64_t server_streams_bidi;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	69
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	70 uint64_t client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	71 uint64_t client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	72 uint64_t client_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	73 uint64_t client_streams_bidi;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	74 } ngx_quic_streams_t;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	75
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	76
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	77 typedef struct {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	78 size_t in_flight;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	79 size_t window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	80 size_t ssthresh;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	81 ngx_msec_t recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	82 } ngx_quic_congestion_t;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	83
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	84
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	85 /*
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	86 * 12.3. Packet Numbers
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	87 *
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	88 * Conceptually, a packet number space is the context in which a packet
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	89 * can be processed and acknowledged. Initial packets can only be sent
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	90 * with Initial packet protection keys and acknowledged in packets which
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	91 * are also Initial packets.
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	92 */
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	93 typedef struct {
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	94 enum ssl_encryption_level_t level;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	95
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	96 uint64_t pnum; /* to be sent */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	97 uint64_t largest_ack; /* received from peer */
d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	98 uint64_t largest_pn; /* received from peer */
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	99
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	100 ngx_queue_t frames;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	101 ngx_queue_t sent;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	102
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	103 uint64_t pending_ack; /* non sent ack-eliciting */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	104 uint64_t largest_range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	105 uint64_t first_range;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	106 ngx_msec_t largest_received;
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	107 ngx_msec_t ack_delay_start;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	108 ngx_uint_t nranges;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	109 ngx_quic_ack_range_t ranges[NGX_QUIC_MAX_RANGES];
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	110 ngx_uint_t send_ack;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	111 } ngx_quic_send_ctx_t;
8307 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	112
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 8306 diff changeset	113
8638 d1cf691a82e8 Core: hide "struct ngx_quic_connection_s" and further reduce diffs. Sergey Kandaurov <pluknet@nginx.com> parents: 8634 diff changeset	114 typedef struct {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	115 ngx_udp_connection_t udp;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	116
8624 340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	117 uint32_t version;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	118 ngx_str_t scid; /* initial client ID */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	119 ngx_str_t dcid; /* server (our own) ID */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	120 ngx_str_t odcid; /* original server ID */
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	121
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	122 struct sockaddr *sockaddr;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	123 socklen_t socklen;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	124
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	125 ngx_queue_t client_ids;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	126 ngx_queue_t server_ids;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	127 ngx_queue_t free_client_ids;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	128 ngx_queue_t free_server_ids;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	129 ngx_uint_t nclient_ids;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	130 ngx_uint_t nserver_ids;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	131 uint64_t max_retired_seqnum;
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	132 uint64_t client_seqnum;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	133 uint64_t server_seqnum;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	134
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	135 ngx_uint_t client_tp_done;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	136 ngx_quic_tp_t tp;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	137 ngx_quic_tp_t ctp;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	138
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	139 ngx_quic_send_ctx_t send_ctx[NGX_QUIC_SEND_CTX_LAST];
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	140
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	141 ngx_quic_frames_stream_t crypto[NGX_QUIC_ENCRYPTION_LAST];
8306 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 8305 diff changeset	142
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	143 ngx_quic_keys_t *keys;
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	144
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	145 ngx_quic_conf_t *conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	146
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	147 ngx_event_t push;
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	148 ngx_event_t pto;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	149 ngx_event_t close;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	150 ngx_msec_t last_cc;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	151
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	152 ngx_msec_t latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	153 ngx_msec_t avg_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	154 ngx_msec_t min_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	155 ngx_msec_t rttvar;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	156
8518 f9b1a4e52597 QUIC: changed c->quic->pto_count type to ngx_uint_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8517 diff changeset	157 ngx_uint_t pto_count;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	158
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	159 ngx_queue_t free_frames;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	160 ngx_chain_t *free_bufs;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	161 ngx_buf_t *free_shadow_bufs;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	162
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	163 #ifdef NGX_QUIC_DEBUG_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	164 ngx_uint_t nframes;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	165 ngx_uint_t nbufs;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	166 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	167
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	168 ngx_quic_streams_t streams;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	169 ngx_quic_congestion_t congestion;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	170 off_t received;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	171
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	172 ngx_uint_t error;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	173 enum ssl_encryption_level_t error_level;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	174 ngx_uint_t error_ftype;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	175 const char *error_reason;
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	176
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	177 ngx_uint_t shutdown_code;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	178 const char *shutdown_reason;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	179
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	180 unsigned error_app:1;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	181 unsigned send_timer_set:1;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	182 unsigned closing:1;
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	183 unsigned shutdown:1;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	184 unsigned draining:1;
8319 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8316 diff changeset	185 unsigned key_phase:1;
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	186 unsigned validated:1;
8638 d1cf691a82e8 Core: hide "struct ngx_quic_connection_s" and further reduce diffs. Sergey Kandaurov <pluknet@nginx.com> parents: 8634 diff changeset	187 } ngx_quic_connection_t;
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	188
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	189
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	190 typedef struct {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	191 ngx_queue_t queue;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	192 uint64_t seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	193 size_t len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	194 u_char id[NGX_QUIC_CID_LEN_MAX];
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	195 u_char sr_token[NGX_QUIC_SR_TOKEN_LEN];
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	196 } ngx_quic_client_id_t;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	197
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	198
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	199 typedef struct {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	200 ngx_udp_connection_t udp;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	201 ngx_queue_t queue;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	202 uint64_t seqnum;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	203 size_t len;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	204 u_char id[NGX_QUIC_CID_LEN_MAX];
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	205 } ngx_quic_server_id_t;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	206
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	207
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	208 typedef ngx_int_t (ngx_quic_frame_handler_pt)(ngx_connection_t c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	209 ngx_quic_frame_t frame, void data);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	210
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	211
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	212 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	213 static int ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	214 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	215 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	216 static int ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	217 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	218 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	219 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	220 static int ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	221 enum ssl_encryption_level_t level, const uint8_t *read_secret,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	222 const uint8_t *write_secret, size_t secret_len);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	223 #endif
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	224
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	225 static int ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	226 enum ssl_encryption_level_t level, const uint8_t *data, size_t len);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	227 static int ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	228 static int ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	229 enum ssl_encryption_level_t level, uint8_t alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	230
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	231
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	232 static ngx_int_t ngx_quic_apply_transport_params(ngx_connection_t *c,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	233 ngx_quic_tp_t *ctp);
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	234 static ngx_quic_connection_t ngx_quic_new_connection(ngx_connection_t c,
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	235 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	236 static ngx_int_t ngx_quic_send_stateless_reset(ngx_connection_t *c,
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	237 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	238 static ngx_int_t ngx_quic_new_sr_token(ngx_connection_t c, ngx_str_t cid,
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	239 u_char secret, u_char token);
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	240 static ngx_int_t ngx_quic_process_stateless_reset(ngx_connection_t *c,
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	241 ngx_quic_header_t *pkt);
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	242 static ngx_int_t ngx_quic_negotiate_version(ngx_connection_t *c,
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	243 ngx_quic_header_t *inpkt);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	244 static ngx_int_t ngx_quic_create_server_id(ngx_connection_t c, u_char id);
8676 7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	245 #if (NGX_QUIC_BPF)
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	246 static ngx_int_t ngx_quic_bpf_attach_id(ngx_connection_t c, u_char id);
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	247 #endif
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	248 static ngx_int_t ngx_quic_send_retry(ngx_connection_t *c,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	249 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	250 static ngx_int_t ngx_quic_new_token(ngx_connection_t c, u_char key,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	251 ngx_str_t token, ngx_str_t odcid, time_t expires, ngx_uint_t is_retry);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	252 static void ngx_quic_address_hash(ngx_connection_t *c, ngx_uint_t no_port,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	253 u_char buf[20]);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	254 static ngx_int_t ngx_quic_validate_token(ngx_connection_t *c,
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	255 u_char key, ngx_quic_header_t pkt);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	256 static ngx_int_t ngx_quic_init_connection(ngx_connection_t *c);
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	257 static ngx_inline size_t ngx_quic_max_udp_payload(ngx_connection_t *c);
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	258 static void ngx_quic_input_handler(ngx_event_t *rev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	259
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	260 static void ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	261 static ngx_int_t ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	262 static void ngx_quic_close_timer_handler(ngx_event_t *ev);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	263 static ngx_int_t ngx_quic_close_streams(ngx_connection_t *c,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	264 ngx_quic_connection_t *qc);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	265
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	266 static ngx_int_t ngx_quic_input(ngx_connection_t c, ngx_buf_t b,
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	267 ngx_quic_conf_t *conf);
bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	268 static ngx_int_t ngx_quic_process_packet(ngx_connection_t *c,
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	269 ngx_quic_conf_t conf, ngx_quic_header_t pkt);
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	270 static ngx_int_t ngx_quic_process_payload(ngx_connection_t *c,
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	271 ngx_quic_header_t *pkt);
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	272 static ngx_int_t ngx_quic_send_early_cc(ngx_connection_t *c,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	273 ngx_quic_header_t inpkt, ngx_uint_t err, const char reason);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	274 static void ngx_quic_discard_ctx(ngx_connection_t *c,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	275 enum ssl_encryption_level_t level);
8688 a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	276 static ngx_int_t ngx_quic_check_csid(ngx_quic_connection_t *qc,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	277 ngx_quic_header_t *pkt);
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	278 static ngx_int_t ngx_quic_handle_frames(ngx_connection_t *c,
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	279 ngx_quic_header_t *pkt);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	280 static ngx_int_t ngx_quic_ack_packet(ngx_connection_t *c,
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	281 ngx_quic_header_t *pkt);
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	282 static ngx_int_t ngx_quic_send_ack_range(ngx_connection_t *c,
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	283 ngx_quic_send_ctx_t *ctx, uint64_t smallest, uint64_t largest);
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	284 static void ngx_quic_drop_ack_ranges(ngx_connection_t *c,
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	285 ngx_quic_send_ctx_t *ctx, uint64_t pn);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	286 static ngx_int_t ngx_quic_send_ack(ngx_connection_t *c,
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	287 ngx_quic_send_ctx_t *ctx);
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	288 static ngx_int_t ngx_quic_send_cc(ngx_connection_t *c);
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	289 static ngx_int_t ngx_quic_send_new_token(ngx_connection_t *c);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	290
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	291 static ngx_int_t ngx_quic_handle_ack_frame(ngx_connection_t *c,
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	292 ngx_quic_header_t pkt, ngx_quic_frame_t f);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	293 static ngx_int_t ngx_quic_handle_ack_frame_range(ngx_connection_t *c,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	294 ngx_quic_send_ctx_t *ctx, uint64_t min, uint64_t max,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	295 ngx_msec_t *send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	296 static void ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	297 enum ssl_encryption_level_t level, ngx_msec_t send_time);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	298 static ngx_inline ngx_msec_t ngx_quic_pto(ngx_connection_t *c,
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	299 ngx_quic_send_ctx_t *ctx);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	300 static void ngx_quic_handle_stream_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	301 ngx_quic_frame_t *f);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	302
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	303 static ngx_int_t ngx_quic_handle_ordered_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	304 ngx_quic_frames_stream_t fs, ngx_quic_frame_t frame,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	305 ngx_quic_frame_handler_pt handler, void *data);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	306 static ngx_int_t ngx_quic_adjust_frame_offset(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	307 ngx_quic_frame_t *f, uint64_t offset_in);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	308 static ngx_int_t ngx_quic_buffer_frame(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	309 ngx_quic_frames_stream_t stream, ngx_quic_frame_t f);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	310
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	311 static ngx_int_t ngx_quic_handle_crypto_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	312 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	313 static ngx_int_t ngx_quic_crypto_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	314 ngx_quic_frame_t frame, void data);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	315 static ngx_int_t ngx_quic_handle_stream_frame(ngx_connection_t *c,
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	316 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	317 static ngx_int_t ngx_quic_stream_input(ngx_connection_t *c,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	318 ngx_quic_frame_t frame, void data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	319
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	320 static ngx_int_t ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	321 ngx_quic_max_data_frame_t *f);
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	322 static ngx_int_t ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	323 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	324 static ngx_int_t ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	325 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f);
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	326 static ngx_int_t ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	327 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	328 static ngx_int_t ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	329 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	330 static ngx_int_t ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	331 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f);
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	332 static ngx_int_t ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	333 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f);
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	334 static ngx_int_t ngx_quic_handle_path_challenge_frame(ngx_connection_t *c,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	335 ngx_quic_header_t pkt, ngx_quic_path_challenge_frame_t f);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	336 static ngx_int_t ngx_quic_handle_new_connection_id_frame(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	337 ngx_quic_header_t pkt, ngx_quic_new_conn_id_frame_t f);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	338 static ngx_int_t ngx_quic_retire_connection_id(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	339 enum ssl_encryption_level_t level, uint64_t seqnum);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	340 static ngx_int_t ngx_quic_handle_retire_connection_id_frame(ngx_connection_t *c,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	341 ngx_quic_header_t pkt, ngx_quic_retire_cid_frame_t f);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	342 static ngx_int_t ngx_quic_issue_server_ids(ngx_connection_t *c);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	343 static void ngx_quic_clear_temp_server_ids(ngx_connection_t *c);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	344 static ngx_quic_server_id_t ngx_quic_insert_server_id(ngx_connection_t c,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	345 ngx_str_t *id);
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	346 static ngx_quic_client_id_t ngx_quic_alloc_client_id(ngx_connection_t c,
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	347 ngx_quic_connection_t *qc);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	348 static ngx_quic_server_id_t ngx_quic_alloc_server_id(ngx_connection_t c,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	349 ngx_quic_connection_t *qc);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	350
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	351 static void ngx_quic_queue_frame(ngx_quic_connection_t *qc,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	352 ngx_quic_frame_t *frame);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	353
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	354 static ngx_int_t ngx_quic_output(ngx_connection_t *c);
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	355 static ngx_uint_t ngx_quic_get_padding_level(ngx_connection_t *c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	356 static ngx_int_t ngx_quic_generate_ack(ngx_connection_t *c,
8332 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 8331 diff changeset	357 ngx_quic_send_ctx_t *ctx);
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	358 static ssize_t ngx_quic_output_packet(ngx_connection_t *c,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	359 ngx_quic_send_ctx_t ctx, u_char data, size_t max, size_t min);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	360 static ngx_int_t ngx_quic_split_frame(ngx_connection_t c, ngx_quic_frame_t f,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	361 size_t len);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	362 static void ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames);
8656 43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	363 static ssize_t ngx_quic_send(ngx_connection_t c, u_char buf, size_t len);
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	364
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	365 static void ngx_quic_set_packet_number(ngx_quic_header_t *pkt,
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	366 ngx_quic_send_ctx_t *ctx);
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	367 static void ngx_quic_pto_handler(ngx_event_t *ev);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	368 static void ngx_quic_lost_handler(ngx_event_t *ev);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	369 static ngx_int_t ngx_quic_detect_lost(ngx_connection_t *c);
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	370 static void ngx_quic_set_lost_timer(ngx_connection_t *c);
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	371 static void ngx_quic_resend_frames(ngx_connection_t *c,
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	372 ngx_quic_send_ctx_t *ctx);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	373 static void ngx_quic_push_handler(ngx_event_t *ev);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	374
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	375 static void ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	376 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	377 static ngx_quic_stream_t ngx_quic_find_stream(ngx_rbtree_t rbtree,
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	378 uint64_t id);
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	379 static ngx_quic_stream_t ngx_quic_create_client_stream(ngx_connection_t c,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	380 uint64_t id);
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	381 static ngx_quic_stream_t ngx_quic_create_stream(ngx_connection_t c,
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	382 uint64_t id, size_t rcvbuf_size);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	383 static ssize_t ngx_quic_stream_recv(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	384 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	385 static ssize_t ngx_quic_stream_send(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	386 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	387 static ngx_chain_t ngx_quic_stream_send_chain(ngx_connection_t c,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	388 ngx_chain_t *in, off_t limit);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	389 static size_t ngx_quic_max_stream_flow(ngx_connection_t *c);
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	390 static void ngx_quic_stream_cleanup_handler(void *data);
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	391 static void ngx_quic_shutdown_quic(ngx_connection_t *c);
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	392 static ngx_quic_frame_t ngx_quic_alloc_frame(ngx_connection_t c);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	393 static void ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	394
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	395 static void ngx_quic_congestion_ack(ngx_connection_t *c,
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	396 ngx_quic_frame_t *frame);
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	397 static void ngx_quic_congestion_lost(ngx_connection_t *c,
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	398 ngx_quic_frame_t *frame);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	399
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	400 static ngx_chain_t ngx_quic_alloc_buf(ngx_connection_t c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	401 static void ngx_quic_free_bufs(ngx_connection_t c, ngx_chain_t in);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	402 static ngx_chain_t ngx_quic_copy_buf(ngx_connection_t c, u_char *data,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	403 size_t len);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	404 static ngx_chain_t ngx_quic_copy_chain(ngx_connection_t c, ngx_chain_t *in,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	405 size_t limit);
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	406 static ngx_chain_t ngx_quic_split_bufs(ngx_connection_t c, ngx_chain_t *in,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	407 size_t len);
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	408
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	409
8674 2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	410 static ngx_core_module_t ngx_quic_module_ctx = {
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	411 ngx_string("quic"),
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	412 NULL,
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	413 NULL
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	414 };
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	415
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	416
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	417 ngx_module_t ngx_quic_module = {
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	418 NGX_MODULE_V1,
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	419 &ngx_quic_module_ctx, /* module context */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	420 NULL, /* module directives */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	421 NGX_CORE_MODULE, /* module type */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	422 NULL, /* init master */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	423 NULL, /* init module */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	424 NULL, /* init process */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	425 NULL, /* init thread */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	426 NULL, /* exit thread */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	427 NULL, /* exit process */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	428 NULL, /* exit master */
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	429 NGX_MODULE_V1_PADDING
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	430 };
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	431
2c7f927f7999 QUIC: ngx_quic_module. Vladimir Homutov <vl@nginx.com> parents: 8673 diff changeset	432
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	433 static SSL_QUIC_METHOD quic_method = {
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	434 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	435 ngx_quic_set_read_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	436 ngx_quic_set_write_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	437 #else
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	438 ngx_quic_set_encryption_secrets,
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	439 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	440 ngx_quic_add_handshake_data,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	441 ngx_quic_flush_flight,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	442 ngx_quic_send_alert,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	443 };
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	444
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	445
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	446 #if (NGX_DEBUG)
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	447
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	448 static void
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	449 ngx_quic_log_frame(ngx_log_t log, ngx_quic_frame_t f, ngx_uint_t tx)
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	450 {
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	451 u_char p, last, pos, end;
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	452 ssize_t n;
8614 3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	453 uint64_t gap, range, largest, smallest;
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	454 ngx_uint_t i;
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	455 u_char buf[NGX_MAX_ERROR_STR];
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	456
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	457 p = buf;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	458 last = buf + sizeof(buf);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	459
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	460 switch (f->type) {
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	461
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	462 case NGX_QUIC_FT_CRYPTO:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	463 p = ngx_slprintf(p, last, "CRYPTO len:%uL off:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	464 f->u.crypto.length, f->u.crypto.offset);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	465 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	466
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	467 case NGX_QUIC_FT_PADDING:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	468 p = ngx_slprintf(p, last, "PADDING");
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	469 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	470
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	471 case NGX_QUIC_FT_ACK:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	472 case NGX_QUIC_FT_ACK_ECN:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	473
8614 3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	474 p = ngx_slprintf(p, last, "ACK n:%ui delay:%uL ",
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	475 f->u.ack.range_count, f->u.ack.delay);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	476
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	477 if (f->data) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	478 pos = f->data->buf->pos;
8695 0b3d70fbba99 QUIC: fixed logging ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8694 diff changeset	479 end = f->data->buf->last;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	480
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	481 } else {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	482 pos = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	483 end = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	484 }
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	485
8614 3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	486 largest = f->u.ack.largest;
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	487 smallest = f->u.ack.largest - f->u.ack.first_range;
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	488
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	489 if (largest == smallest) {
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	490 p = ngx_slprintf(p, last, "%uL", largest);
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	491
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	492 } else {
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	493 p = ngx_slprintf(p, last, "%uL-%uL", largest, smallest);
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	494 }
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	495
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	496 for (i = 0; i < f->u.ack.range_count; i++) {
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	497 n = ngx_quic_parse_ack_range(log, pos, end, &gap, &range);
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	498 if (n == NGX_ERROR) {
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	499 break;
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	500 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	501
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	502 pos += n;
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	503
8614 3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	504 largest = smallest - gap - 2;
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	505 smallest = largest - range;
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	506
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	507 if (largest == smallest) {
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	508 p = ngx_slprintf(p, last, " %uL", largest);
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	509
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	510 } else {
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	511 p = ngx_slprintf(p, last, " %uL-%uL", largest, smallest);
3d79c08bb0f1 QUIC: changed ACK frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8613 diff changeset	512 }
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	513 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	514
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	515 if (f->type == NGX_QUIC_FT_ACK_ECN) {
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	516 p = ngx_slprintf(p, last, " ECN counters ect0:%uL ect1:%uL ce:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	517 f->u.ack.ect0, f->u.ack.ect1, f->u.ack.ce);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	518 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	519 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	520
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	521 case NGX_QUIC_FT_PING:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	522 p = ngx_slprintf(p, last, "PING");
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	523 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	524
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	525 case NGX_QUIC_FT_NEW_CONNECTION_ID:
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	526 p = ngx_slprintf(p, last,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	527 "NEW_CONNECTION_ID seq:%uL retire:%uL len:%ud",
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	528 f->u.ncid.seqnum, f->u.ncid.retire, f->u.ncid.len);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	529 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	530
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	531 case NGX_QUIC_FT_RETIRE_CONNECTION_ID:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	532 p = ngx_slprintf(p, last, "RETIRE_CONNECTION_ID seqnum:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	533 f->u.retire_cid.sequence_number);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	534 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	535
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	536 case NGX_QUIC_FT_CONNECTION_CLOSE:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	537 case NGX_QUIC_FT_CONNECTION_CLOSE_APP:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	538 p = ngx_slprintf(p, last, "CONNECTION_CLOSE%s err:%ui",
8692 0697294f79a4 QUIC: removed redundant "app" flag from ngx_quic_close_frame_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8688 diff changeset	539 f->type == NGX_QUIC_FT_CONNECTION_CLOSE ? "" : "_APP",
0697294f79a4 QUIC: removed redundant "app" flag from ngx_quic_close_frame_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8688 diff changeset	540 f->u.close.error_code);
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	541
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	542 if (f->u.close.reason.len) {
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	543 p = ngx_slprintf(p, last, " %V", &f->u.close.reason);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	544 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	545
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	546 if (f->type == NGX_QUIC_FT_CONNECTION_CLOSE) {
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	547 p = ngx_slprintf(p, last, " ft:%ui", f->u.close.frame_type);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	548 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	549
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	550 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	551
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	552 case NGX_QUIC_FT_STREAM0:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	553 case NGX_QUIC_FT_STREAM1:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	554 case NGX_QUIC_FT_STREAM2:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	555 case NGX_QUIC_FT_STREAM3:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	556 case NGX_QUIC_FT_STREAM4:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	557 case NGX_QUIC_FT_STREAM5:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	558 case NGX_QUIC_FT_STREAM6:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	559 case NGX_QUIC_FT_STREAM7:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	560
8615 27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	561 p = ngx_slprintf(p, last, "STREAM id:0x%xL", f->u.stream.stream_id);
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	562
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	563 if (f->u.stream.off) {
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	564 p = ngx_slprintf(p, last, " off:%uL", f->u.stream.offset);
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	565 }
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	566
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	567 if (f->u.stream.len) {
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	568 p = ngx_slprintf(p, last, " len:%uL", f->u.stream.length);
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	569 }
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	570
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	571 if (f->u.stream.fin) {
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	572 p = ngx_slprintf(p, last, " fin:1");
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	573 }
27e305834078 QUIC: changed STREAM frame debugging. Roman Arutyunyan <arut@nginx.com> parents: 8614 diff changeset	574
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	575 #ifdef NGX_QUIC_DEBUG_FRAMES
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	576 {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	577 ngx_chain_t *cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	578
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	579 p = ngx_slprintf(p, last, " data:");
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	580
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	581 for (cl = f->data; cl; cl = cl->next) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	582 p = ngx_slprintf(p, last, "%*xs",
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	583 cl->buf->last - cl->buf->pos, cl->buf->pos);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	584 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	585 }
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	586 #endif
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	587
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	588 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	589
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	590 case NGX_QUIC_FT_MAX_DATA:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	591 p = ngx_slprintf(p, last, "MAX_DATA max_data:%uL on recv",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	592 f->u.max_data.max_data);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	593 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	594
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	595 case NGX_QUIC_FT_RESET_STREAM:
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	596 p = ngx_slprintf(p, last, "RESET_STREAM"
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	597 " id:0x%xL error_code:0x%xL final_size:0x%xL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	598 f->u.reset_stream.id, f->u.reset_stream.error_code,
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	599 f->u.reset_stream.final_size);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	600 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	601
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	602 case NGX_QUIC_FT_STOP_SENDING:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	603 p = ngx_slprintf(p, last, "STOP_SENDING id:0x%xL err:0x%xL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	604 f->u.stop_sending.id, f->u.stop_sending.error_code);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	605 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	606
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	607 case NGX_QUIC_FT_STREAMS_BLOCKED:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	608 case NGX_QUIC_FT_STREAMS_BLOCKED2:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	609 p = ngx_slprintf(p, last, "STREAMS_BLOCKED limit:%uL bidi:%ui",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	610 f->u.streams_blocked.limit, f->u.streams_blocked.bidi);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	611 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	612
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	613 case NGX_QUIC_FT_MAX_STREAMS:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	614 case NGX_QUIC_FT_MAX_STREAMS2:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	615 p = ngx_slprintf(p, last, "MAX_STREAMS limit:%uL bidi:%ui",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	616 f->u.max_streams.limit, f->u.max_streams.bidi);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	617 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	618
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	619 case NGX_QUIC_FT_MAX_STREAM_DATA:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	620 p = ngx_slprintf(p, last, "MAX_STREAM_DATA id:0x%xL limit:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	621 f->u.max_stream_data.id, f->u.max_stream_data.limit);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	622 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	623
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	624
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	625 case NGX_QUIC_FT_DATA_BLOCKED:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	626 p = ngx_slprintf(p, last, "DATA_BLOCKED limit:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	627 f->u.data_blocked.limit);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	628 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	629
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	630 case NGX_QUIC_FT_STREAM_DATA_BLOCKED:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	631 p = ngx_slprintf(p, last, "STREAM_DATA_BLOCKED id:0x%xL limit:%uL",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	632 f->u.stream_data_blocked.id,
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	633 f->u.stream_data_blocked.limit);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	634 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	635
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	636 case NGX_QUIC_FT_PATH_CHALLENGE:
8670 b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	637 p = ngx_slprintf(p, last, "PATH_CHALLENGE data:0x%*xs",
b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	638 sizeof(f->u.path_challenge.data),
b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	639 f->u.path_challenge.data);
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	640 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	641
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	642 case NGX_QUIC_FT_PATH_RESPONSE:
8670 b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	643 p = ngx_slprintf(p, last, "PATH_RESPONSE data:0x%*xs",
b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	644 sizeof(f->u.path_challenge.data),
b14338acbf9d QUIC: fixed logging PATH_CHALLENGE/RESPONSE and build with GCC < 5. Sergey Kandaurov <pluknet@nginx.com> parents: 8663 diff changeset	645 f->u.path_challenge.data);
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	646 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	647
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	648 case NGX_QUIC_FT_NEW_TOKEN:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	649 p = ngx_slprintf(p, last, "NEW_TOKEN");
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	650 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	651
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	652 case NGX_QUIC_FT_HANDSHAKE_DONE:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	653 p = ngx_slprintf(p, last, "HANDSHAKE DONE");
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	654 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	655
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	656 default:
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	657 p = ngx_slprintf(p, last, "unknown type 0x%xi", f->type);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	658 break;
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	659 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	660
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	661 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, log, 0, "quic frame %s %s %*s",
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	662 tx ? "tx" : "rx", ngx_quic_level_name(f->level),
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	663 p - buf, buf);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	664 }
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	665
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	666
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	667 static void
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	668 ngx_quic_connstate_dbg(ngx_connection_t *c)
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	669 {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	670 u_char p, last;
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	671 ngx_quic_connection_t *qc;
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	672 u_char buf[NGX_MAX_ERROR_STR];
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	673
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	674 p = buf;
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	675 last = p + sizeof(buf);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	676
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	677 qc = ngx_quic_get_connection(c);
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	678
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	679 p = ngx_slprintf(p, last, "state:");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	680
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	681 if (qc) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	682
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	683 if (qc->error) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	684 p = ngx_slprintf(p, last, "%s", qc->error_app ? " app" : "");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	685 p = ngx_slprintf(p, last, " error:%ui", qc->error);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	686
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	687 if (qc->error_reason) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	688 p = ngx_slprintf(p, last, " \"%s\"", qc->error_reason);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	689 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	690 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	691
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	692 p = ngx_slprintf(p, last, "%s", qc->shutdown ? " shutdown" : "");
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	693 p = ngx_slprintf(p, last, "%s", qc->closing ? " closing" : "");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	694 p = ngx_slprintf(p, last, "%s", qc->draining ? " draining" : "");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	695 p = ngx_slprintf(p, last, "%s", qc->key_phase ? " kp" : "");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	696 p = ngx_slprintf(p, last, "%s", qc->validated? " valid" : "");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	697
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	698 } else {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	699 p = ngx_slprintf(p, last, " early");
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	700 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	701
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	702 if (c->read->timer_set) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	703 p = ngx_slprintf(p, last,
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	704 qc && qc->send_timer_set ? " send:%M" : " read:%M",
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	705 c->read->timer.key - ngx_current_msec);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	706 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	707
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	708 if (qc) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	709
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	710 if (qc->push.timer_set) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	711 p = ngx_slprintf(p, last, " push:%M",
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	712 qc->push.timer.key - ngx_current_msec);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	713 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	714
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	715 if (qc->pto.timer_set) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	716 p = ngx_slprintf(p, last, " pto:%M",
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	717 qc->pto.timer.key - ngx_current_msec);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	718 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	719
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	720 if (qc->close.timer_set) {
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	721 p = ngx_slprintf(p, last, " close:%M",
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	722 qc->close.timer.key - ngx_current_msec);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	723 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	724 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	725
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	726 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	727 "quic %*s", p - buf, buf);
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	728 }
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	729
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	730 #else
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	731
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	732 #define ngx_quic_log_frame(log, f, tx)
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	733 #define ngx_quic_connstate_dbg(c)
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	734
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	735 #endif
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	736
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	737
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	738 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	739
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	740 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	741 ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	742 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	743 const uint8_t *rsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	744 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	745 ngx_connection_t *c;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	746 ngx_quic_connection_t *qc;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	747
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	748 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	749 qc = ngx_quic_get_connection(c);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	750
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	751 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	752 "quic ngx_quic_set_read_secret() level:%d", level);
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	753 #ifdef NGX_QUIC_DEBUG_CRYPTO
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	754 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	755 "quic read secret len:%uz %*xs", secret_len,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	756 secret_len, rsecret);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	757 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	758
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	759 return ngx_quic_keys_set_encryption_secret(c->pool, 0, qc->keys, level,
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	760 cipher, rsecret, secret_len);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	761 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	762
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	763
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	764 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	765 ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	766 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	767 const uint8_t *wsecret, size_t secret_len)
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	768 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	769 ngx_connection_t *c;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	770 ngx_quic_connection_t *qc;
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	771
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	772 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	773 qc = ngx_quic_get_connection(c);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	774
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	775 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	776 "quic ngx_quic_set_write_secret() level:%d", level);
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	777 #ifdef NGX_QUIC_DEBUG_CRYPTO
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	778 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	779 "quic write secret len:%uz %*xs", secret_len,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	780 secret_len, wsecret);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	781 #endif
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	782
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	783 return ngx_quic_keys_set_encryption_secret(c->pool, 1, qc->keys, level,
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	784 cipher, wsecret, secret_len);
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	785 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	786
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	787 #else
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	788
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	789 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	790 ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	791 enum ssl_encryption_level_t level, const uint8_t *rsecret,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	792 const uint8_t *wsecret, size_t secret_len)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	793 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	794 ngx_connection_t *c;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	795 const SSL_CIPHER *cipher;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	796 ngx_quic_connection_t *qc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	797
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	798 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	799 qc = ngx_quic_get_connection(c);
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	800
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	801 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	802 "quic ngx_quic_set_encryption_secrets() level:%d", level);
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	803 #ifdef NGX_QUIC_DEBUG_CRYPTO
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	804 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	805 "quic read secret len:%uz %*xs", secret_len,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	806 secret_len, rsecret);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	807 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	808
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	809 cipher = SSL_get_current_cipher(ssl_conn);
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	810
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	811 if (ngx_quic_keys_set_encryption_secret(c->pool, 0, qc->keys, level,
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	812 cipher, rsecret, secret_len)
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	813 != 1)
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	814 {
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	815 return 0;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	816 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	817
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	818 if (level == ssl_encryption_early_data) {
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	819 return 1;
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	820 }
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	821
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	822 #ifdef NGX_QUIC_DEBUG_CRYPTO
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	823 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	824 "quic write secret len:%uz %*xs", secret_len,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	825 secret_len, wsecret);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	826 #endif
8303 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 8302 diff changeset	827
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	828 return ngx_quic_keys_set_encryption_secret(c->pool, 1, qc->keys, level,
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	829 cipher, wsecret, secret_len);
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	830 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	831
8204 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	832 #endif
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 8203 diff changeset	833
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	834
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	835 static int
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	836 ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	837 enum ssl_encryption_level_t level, const uint8_t *data, size_t len)
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	838 {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	839 u_char p, end;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	840 size_t client_params_len;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	841 const uint8_t *client_params;
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	842 ngx_quic_tp_t ctp;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	843 ngx_quic_frame_t *frame;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	844 ngx_connection_t *c;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	845 ngx_quic_connection_t *qc;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	846 ngx_quic_frames_stream_t *fs;
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	847
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	848 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	849 qc = ngx_quic_get_connection(c);
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	850
8186 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 8185 diff changeset	851 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	852 "quic ngx_quic_add_handshake_data");
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	853
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	854 if (!qc->client_tp_done) {
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	855 /*
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	856 * things to do once during handshake: check ALPN and transport
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	857 * parameters; we want to break handshake if something is wrong
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	858 * here;
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	859 */
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	860
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	861 #if defined(TLSEXT_TYPE_application_layer_protocol_negotiation)
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	862 if (qc->conf->require_alpn) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	863 unsigned int len;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	864 const unsigned char *data;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	865
8619 bb3f4f669417 QUIC: passing ssl_conn to SSL_get0_alpn_selected() directly. Sergey Kandaurov <pluknet@nginx.com> parents: 8617 diff changeset	866 SSL_get0_alpn_selected(ssl_conn, &data, &len);
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	867
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	868 if (len == 0) {
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	869 qc->error = 0x100 + SSL_AD_NO_APPLICATION_PROTOCOL;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	870 qc->error_reason = "unsupported protocol in ALPN extension";
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	871
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	872 ngx_log_error(NGX_LOG_INFO, c->log, 0,
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	873 "quic unsupported protocol in ALPN extension");
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	874 return 0;
893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	875 }
8438 a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	876 }
a2c34e77cfc1 QUIC: added ALPN checks. Vladimir Homutov <vl@nginx.com> parents: 8437 diff changeset	877 #endif
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	878
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	879 SSL_get_peer_quic_transport_params(ssl_conn, &client_params,
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	880 &client_params_len);
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	881
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	882 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	883 "quic SSL_get_peer_quic_transport_params():"
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	884 " params_len:%ui", client_params_len);
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	885
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	886 if (client_params_len == 0) {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	887 /* quic-tls 8.2 */
8447 97adb87f149b Get rid of hardcoded numbers used for quic handshake errors. Sergey Kandaurov <pluknet@nginx.com> parents: 8446 diff changeset	888 qc->error = NGX_QUIC_ERR_CRYPTO(SSL_AD_MISSING_EXTENSION);
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	889 qc->error_reason = "missing transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	890
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	891 ngx_log_error(NGX_LOG_INFO, c->log, 0,
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	892 "missing transport parameters");
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	893 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	894 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	895
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	896 p = (u_char *) client_params;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	897 end = p + client_params_len;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	898
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	899 /* defaults for parameters not sent by client */
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	900 ngx_memcpy(&ctp, &qc->ctp, sizeof(ngx_quic_tp_t));
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	901
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	902 if (ngx_quic_parse_transport_params(p, end, &ctp, c->log)
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	903 != NGX_OK)
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	904 {
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	905 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	906 qc->error_reason = "failed to process transport parameters";
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	907
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	908 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	909 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	910
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	911 if (ngx_quic_apply_transport_params(c, &ctp) != NGX_OK) {
8435 5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	912 return 0;
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	913 }
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	914
5bc9229ec4cf QUIC: raise error on missing transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8434 diff changeset	915 qc->client_tp_done = 1;
8260 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	916 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8259 diff changeset	917
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	918 fs = &qc->crypto[level];
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	919
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	920 frame = ngx_quic_alloc_frame(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	921 if (frame == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	922 return 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	923 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	924
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	925 frame->data = ngx_quic_copy_buf(c, (u_char *) data, len);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	926 if (frame->data == NGX_CHAIN_ERROR) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	927 return 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	928 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	929
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	930 frame->level = level;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	931 frame->type = NGX_QUIC_FT_CRYPTO;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	932 frame->u.crypto.offset = fs->sent;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	933 frame->u.crypto.length = len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	934
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	935 fs->sent += len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	936
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	937 ngx_quic_queue_frame(qc, frame);
8184 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 8183 diff changeset	938
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	939 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	940 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	941
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	942
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	943 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	944 ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	945 {
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	946 #if (NGX_DEBUG)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	947 ngx_connection_t *c;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	948
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	949 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	950
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	951 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	952 "quic ngx_quic_flush_flight()");
8360 f175006124d0 Cleaned up hexdumps in debug output. Vladimir Homutov <vl@nginx.com> parents: 8359 diff changeset	953 #endif
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	954 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	955 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	956
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	957
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	958 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	959 ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn, enum ssl_encryption_level_t level,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	960 uint8_t alert)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	961 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	962 ngx_connection_t *c;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	963 ngx_quic_connection_t *qc;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	964
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	965 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	966
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	967 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	968 "quic ngx_quic_send_alert() lvl:%d alert:%d",
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	969 (int) level, (int) alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	970
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	971 qc = ngx_quic_get_connection(c);
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	972 if (qc == NULL) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	973 return 1;
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	974 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	975
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	976 qc->error_level = level;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	977 qc->error = NGX_QUIC_ERR_CRYPTO(alert);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	978 qc->error_reason = "TLS alert";
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	979 qc->error_app = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	980 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	981
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	982 if (ngx_quic_send_cc(c) != NGX_OK) {
8235 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	983 return 0;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	984 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 8234 diff changeset	985
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	986 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	987 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	988
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	989
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	990 static ngx_int_t
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	991 ngx_quic_apply_transport_params(ngx_connection_t c, ngx_quic_tp_t ctp)
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	992 {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	993 ngx_quic_connection_t *qc;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	994
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	995 qc = ngx_quic_get_connection(c);
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	996
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	997 if (qc->scid.len != ctp->initial_scid.len
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	998 \|\| ngx_memcmp(qc->scid.data, ctp->initial_scid.data, qc->scid.len) != 0)
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	999 {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1000 ngx_log_error(NGX_LOG_INFO, c->log, 0,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1001 "quic client initial_source_connection_id mismatch");
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1002 return NGX_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1003 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1004
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1005 if (ctp->max_udp_payload_size < NGX_QUIC_MIN_INITIAL_SIZE
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1006 \|\| ctp->max_udp_payload_size > NGX_QUIC_MAX_UDP_PAYLOAD_SIZE)
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1007 {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1008 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1009 qc->error_reason = "invalid maximum packet size";
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1010
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1011 ngx_log_error(NGX_LOG_INFO, c->log, 0,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1012 "quic maximum packet size is invalid");
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1013 return NGX_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1014
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1015 } else if (ctp->max_udp_payload_size > ngx_quic_max_udp_payload(c)) {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1016 ctp->max_udp_payload_size = ngx_quic_max_udp_payload(c);
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1017 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	1018 "quic client maximum packet size truncated");
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1019 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1020
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1021 if (ctp->active_connection_id_limit < 2) {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1022 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1023 qc->error_reason = "invalid active_connection_id_limit";
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1024
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1025 ngx_log_error(NGX_LOG_INFO, c->log, 0,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1026 "quic active_connection_id_limit is invalid");
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1027 return NGX_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1028 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1029
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1030 if (ctp->ack_delay_exponent > 20) {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1031 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1032 qc->error_reason = "invalid ack_delay_exponent";
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1033
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1034 ngx_log_error(NGX_LOG_INFO, c->log, 0,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1035 "quic ack_delay_exponent is invalid");
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1036 return NGX_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1037 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1038
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1039 if (ctp->max_ack_delay > 16384) {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1040 qc->error = NGX_QUIC_ERR_TRANSPORT_PARAMETER_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1041 qc->error_reason = "invalid max_ack_delay";
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1042
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1043 ngx_log_error(NGX_LOG_INFO, c->log, 0,
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1044 "quic max_ack_delay is invalid");
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1045 return NGX_ERROR;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1046 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1047
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1048 if (ctp->max_idle_timeout > 0
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1049 && ctp->max_idle_timeout < qc->tp.max_idle_timeout)
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1050 {
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1051 qc->tp.max_idle_timeout = ctp->max_idle_timeout;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1052 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1053
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1054 qc->streams.server_max_streams_bidi = ctp->initial_max_streams_bidi;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1055 qc->streams.server_max_streams_uni = ctp->initial_max_streams_uni;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1056
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1057 ngx_memcpy(&qc->ctp, ctp, sizeof(ngx_quic_tp_t));
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1058
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1059 return NGX_OK;
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1060 }
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1061
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1062
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1063 void
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	1064 ngx_quic_run(ngx_connection_t c, ngx_quic_conf_t conf)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1065 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1066 ngx_int_t rc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1067 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1068
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1069 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic run");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1070
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	1071 rc = ngx_quic_input(c, c->buffer, conf);
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1072 if (rc != NGX_OK) {
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	1073 ngx_quic_close_connection(c, rc == NGX_DECLINED ? NGX_DONE : NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1074 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1075 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1076
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1077 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1078
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1079 if (qc == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1080 ngx_quic_close_connection(c, NGX_DONE);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1081 return;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1082 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1083
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1084 ngx_add_timer(c->read, qc->tp.max_idle_timeout);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1085 ngx_quic_connstate_dbg(c);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1086
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1087 c->read->handler = ngx_quic_input_handler;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1088
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1089 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1090 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1091
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1092
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1093 static ngx_quic_connection_t *
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	1094 ngx_quic_new_connection(ngx_connection_t c, ngx_quic_conf_t conf,
bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	1095 ngx_quic_header_t *pkt)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1096 {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	1097 ngx_uint_t i;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1098 ngx_quic_tp_t *ctp;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1099 ngx_quic_client_id_t *cid;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1100 ngx_quic_connection_t *qc;
8387 eebdda507ec3 Added tests for connection id lengths in initial packet. Vladimir Homutov <vl@nginx.com> parents: 8386 diff changeset	1101
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1102 qc = ngx_pcalloc(c->pool, sizeof(ngx_quic_connection_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1103 if (qc == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1104 return NULL;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1105 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1106
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1107 qc->keys = ngx_quic_keys_new(c->pool);
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1108 if (qc->keys == NULL) {
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1109 return NULL;
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1110 }
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1111
8624 340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	1112 qc->version = pkt->version;
340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	1113
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1114 ngx_rbtree_init(&qc->streams.tree, &qc->streams.sentinel,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1115 ngx_quic_rbtree_insert_stream);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1116
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1117 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	1118 ngx_queue_init(&qc->send_ctx[i].frames);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	1119 ngx_queue_init(&qc->send_ctx[i].sent);
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	1120 qc->send_ctx[i].largest_pn = NGX_QUIC_UNSET_PN;
85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	1121 qc->send_ctx[i].largest_ack = NGX_QUIC_UNSET_PN;
85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	1122 qc->send_ctx[i].largest_range = NGX_QUIC_UNSET_PN;
85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	1123 qc->send_ctx[i].pending_ack = NGX_QUIC_UNSET_PN;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	1124 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	1125
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	1126 qc->send_ctx[0].level = ssl_encryption_initial;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	1127 qc->send_ctx[1].level = ssl_encryption_handshake;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	1128 qc->send_ctx[2].level = ssl_encryption_application;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1129
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1130 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1131 ngx_queue_init(&qc->crypto[i].frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	1132 }
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	1133
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	1134 ngx_queue_init(&qc->free_frames);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1135 ngx_queue_init(&qc->client_ids);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1136 ngx_queue_init(&qc->server_ids);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1137 ngx_queue_init(&qc->free_client_ids);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1138 ngx_queue_init(&qc->free_server_ids);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	1139
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1140 qc->avg_rtt = NGX_QUIC_INITIAL_RTT;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1141 qc->rttvar = NGX_QUIC_INITIAL_RTT / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1142 qc->min_rtt = NGX_TIMER_INFINITE;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1143
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1144 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1145 * qc->latest_rtt = 0
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1146 * qc->nclient_ids = 0
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1147 * qc->nserver_ids = 0
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1148 * qc->max_retired_seqnum = 0
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1149 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	1150
8477 031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1151 qc->received = pkt->raw->last - pkt->raw->start;
031918df51c0 QUIC: added anti-amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8476 diff changeset	1152
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1153 qc->pto.log = c->log;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1154 qc->pto.data = c;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1155 qc->pto.handler = ngx_quic_pto_handler;
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	1156 qc->pto.cancelable = 1;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	1157
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	1158 qc->push.log = c->log;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	1159 qc->push.data = c;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	1160 qc->push.handler = ngx_quic_push_handler;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	1161 qc->push.cancelable = 1;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	1162
8481 0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	1163 qc->conf = conf;
0d2b2664b41c QUIC: added "quic" listen parameter. Roman Arutyunyan <arut@nginx.com> parents: 8480 diff changeset	1164 qc->tp = conf->tp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1165
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1166 if (qc->tp.disable_active_migration) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1167 qc->sockaddr = ngx_palloc(c->pool, c->socklen);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1168 if (qc->sockaddr == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1169 return NULL;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1170 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1171
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1172 ngx_memcpy(qc->sockaddr, c->sockaddr, c->socklen);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1173 qc->socklen = c->socklen;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1174 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1175
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1176 ctp = &qc->ctp;
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1177
ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1178 /* defaults to be used before actual client parameters are received */
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1179 ctp->max_udp_payload_size = ngx_quic_max_udp_payload(c);
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1180 ctp->ack_delay_exponent = NGX_QUIC_DEFAULT_ACK_DELAY_EXPONENT;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1181 ctp->max_ack_delay = NGX_QUIC_DEFAULT_MAX_ACK_DELAY;
8701 ba9e34c03968 QUIC: added check of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8698 diff changeset	1182 ctp->active_connection_id_limit = 2;
8265 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 8263 diff changeset	1183
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	1184 qc->streams.recv_max_data = qc->tp.initial_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	1185
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	1186 qc->streams.client_max_streams_uni = qc->tp.initial_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	1187 qc->streams.client_max_streams_bidi = qc->tp.initial_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	1188
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1189 qc->congestion.window = ngx_min(10 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1190 ngx_max(2 * qc->tp.max_udp_payload_size,
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	1191 14720));
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	1192 qc->congestion.ssthresh = (size_t) -1;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	1193 qc->congestion.recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	1194
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1195 qc->odcid.len = pkt->odcid.len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1196 qc->odcid.data = ngx_pstrdup(c->pool, &pkt->odcid);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1197 if (qc->odcid.data == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1198 return NULL;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1199 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1200
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1201 qc->dcid.len = NGX_QUIC_SERVER_CID_LEN;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1202 qc->dcid.data = ngx_pnalloc(c->pool, qc->dcid.len);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1203 if (qc->dcid.data == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1204 return NULL;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1205 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1206
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1207 if (ngx_quic_create_server_id(c, qc->dcid.data) != NGX_OK) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1208 return NULL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1209 }
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1210
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1211 qc->tp.original_dcid = qc->odcid;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1212 qc->tp.initial_scid = qc->dcid;
8417 6633f17044eb QUIC draft-28 transport parameters support. Sergey Kandaurov <pluknet@nginx.com> parents: 8415 diff changeset	1213
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1214 if (pkt->validated && pkt->retried) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1215 qc->tp.retry_scid.len = pkt->dcid.len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1216 qc->tp.retry_scid.data = ngx_pstrdup(c->pool, &pkt->dcid);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1217 if (qc->tp.retry_scid.data == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1218 return NULL;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1219 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1220 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1221
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1222 qc->scid.len = pkt->scid.len;
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1223 qc->scid.data = ngx_pstrdup(c->pool, &pkt->scid);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1224 if (qc->scid.data == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1225 return NULL;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1226 }
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1227
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	1228 cid = ngx_quic_alloc_client_id(c, qc);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1229 if (cid == NULL) {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1230 return NULL;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1231 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1232
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1233 cid->seqnum = 0;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1234 cid->len = pkt->scid.len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1235 ngx_memcpy(cid->id, pkt->scid.data, pkt->scid.len);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1236
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1237 ngx_queue_insert_tail(&qc->client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1238 qc->nclient_ids++;
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	1239 qc->client_seqnum = 0;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	1240
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1241 qc->server_seqnum = NGX_QUIC_UNSET_PN;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1242
8710 44b4c6180106 QUIC: multiple versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8709 diff changeset	1243 if (ngx_quic_keys_set_initial_secret(c->pool, qc->keys, &pkt->dcid,
44b4c6180106 QUIC: multiple versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8709 diff changeset	1244 qc->version)
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1245 != NGX_OK)
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1246 {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1247 return NULL;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1248 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1249
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1250 c->udp = &qc->udp;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1251
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1252 if (ngx_quic_insert_server_id(c, &qc->odcid) == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1253 return NULL;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1254 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1255
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1256 qc->server_seqnum = 0;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1257
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1258 if (ngx_quic_insert_server_id(c, &qc->dcid) == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1259 return NULL;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1260 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1261
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1262 qc->validated = pkt->validated;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1263
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	1264 return qc;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1265 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1266
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1267
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1268 static ngx_int_t
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1269 ngx_quic_send_stateless_reset(ngx_connection_t c, ngx_quic_conf_t conf,
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1270 ngx_quic_header_t *pkt)
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1271 {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1272 u_char *token;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1273 size_t len, max;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1274 uint16_t rndbytes;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1275 u_char buf[NGX_QUIC_MAX_SR_PACKET];
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1276
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1277 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1278 "quic handle stateless reset output");
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1279
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1280 if (pkt->len <= NGX_QUIC_MIN_PKT_LEN) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1281 return NGX_DECLINED;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1282 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1283
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1284 if (pkt->len <= NGX_QUIC_MIN_SR_PACKET) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1285 len = pkt->len - 1;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1286
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1287 } else {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1288 max = ngx_min(NGX_QUIC_MAX_SR_PACKET, pkt->len * 3);
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1289
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1290 if (RAND_bytes((u_char *) &rndbytes, sizeof(rndbytes)) != 1) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1291 return NGX_ERROR;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1292 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1293
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1294 len = (rndbytes % (max - NGX_QUIC_MIN_SR_PACKET + 1))
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1295 + NGX_QUIC_MIN_SR_PACKET;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1296 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1297
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1298 if (RAND_bytes(buf, len - NGX_QUIC_SR_TOKEN_LEN) != 1) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1299 return NGX_ERROR;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1300 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1301
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1302 buf[0] &= ~NGX_QUIC_PKT_LONG;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1303 buf[0] \|= NGX_QUIC_PKT_FIXED_BIT;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1304
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1305 token = &buf[len - NGX_QUIC_SR_TOKEN_LEN];
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1306
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1307 if (ngx_quic_new_sr_token(c, &pkt->dcid, conf->sr_token_key, token)
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1308 != NGX_OK)
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1309 {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1310 return NGX_ERROR;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1311 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1312
8656 43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	1313 (void) ngx_quic_send(c, buf, len);
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1314
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1315 return NGX_DECLINED;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1316 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1317
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1318
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1319 static ngx_int_t
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1320 ngx_quic_new_sr_token(ngx_connection_t c, ngx_str_t cid, u_char *secret,
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1321 u_char *token)
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1322 {
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1323 ngx_str_t tmp;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1324
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1325 tmp.data = secret;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1326 tmp.len = NGX_QUIC_SR_KEY_LEN;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1327
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1328 if (ngx_quic_derive_key(c->log, "sr_token_key", &tmp, cid, token,
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1329 NGX_QUIC_SR_TOKEN_LEN)
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1330 != NGX_OK)
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1331 {
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1332 return NGX_ERROR;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1333 }
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1334
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1335 #if (NGX_DEBUG)
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1336 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1337 "quic stateless reset token %*xs",
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1338 (size_t) NGX_QUIC_SR_TOKEN_LEN, token);
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1339 #endif
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1340
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1341 return NGX_OK;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1342 }
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1343
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1344
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1345 static ngx_int_t
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1346 ngx_quic_process_stateless_reset(ngx_connection_t c, ngx_quic_header_t pkt)
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1347 {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1348 u_char *tail, ch;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1349 ngx_uint_t i;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1350 ngx_queue_t *q;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1351 ngx_quic_client_id_t *cid;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1352 ngx_quic_connection_t *qc;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1353
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1354 qc = ngx_quic_get_connection(c);
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1355
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1356 /* A stateless reset uses an entire UDP datagram */
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1357 if (pkt->raw->start != pkt->data) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1358 return NGX_DECLINED;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1359 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1360
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1361 tail = pkt->raw->last - NGX_QUIC_SR_TOKEN_LEN;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1362
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1363 for (q = ngx_queue_head(&qc->client_ids);
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1364 q != ngx_queue_sentinel(&qc->client_ids);
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1365 q = ngx_queue_next(q))
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1366 {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1367 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1368
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1369 if (cid->seqnum == 0) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1370 /* no stateless reset token in initial connection id */
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1371 continue;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1372 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1373
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1374 /* constant time comparison */
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1375
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1376 for (ch = 0, i = 0; i < NGX_QUIC_SR_TOKEN_LEN; i++) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1377 ch \|= tail[i] ^ cid->sr_token[i];
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1378 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1379
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1380 if (ch == 0) {
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1381 return NGX_OK;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1382 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1383 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1384
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1385 return NGX_DECLINED;
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1386 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1387
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1388
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1389 static ngx_int_t
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1390 ngx_quic_negotiate_version(ngx_connection_t c, ngx_quic_header_t inpkt)
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1391 {
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1392 size_t len;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1393 ngx_quic_header_t pkt;
8625 4416b7ab0a27 QUIC: multiple versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8624 diff changeset	1394 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1395
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1396 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1397 "sending version negotiation packet");
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1398
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1399 pkt.log = c->log;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1400 pkt.flags = NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_FIXED_BIT;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1401 pkt.dcid = inpkt->scid;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1402 pkt.scid = inpkt->dcid;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1403
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1404 len = ngx_quic_create_version_negotiation(&pkt, buf);
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1405
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1406 #ifdef NGX_QUIC_DEBUG_PACKETS
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1407 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1408 "quic vnego packet to send len:%uz %*xs", len, len, buf);
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1409 #endif
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1410
8656 43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	1411 (void) ngx_quic_send(c, buf, len);
8522 fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1412
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1413 return NGX_ERROR;
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1414 }
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1415
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1416
fc89d02bdca2 QUIC: added version negotiation support. Vladimir Homutov <vl@nginx.com> parents: 8519 diff changeset	1417 static ngx_int_t
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1418 ngx_quic_create_server_id(ngx_connection_t c, u_char id)
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1419 {
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1420 if (RAND_bytes(id, NGX_QUIC_SERVER_CID_LEN) != 1) {
8382 b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	1421 return NGX_ERROR;
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	1422 }
b7704303a7e5 Server CID change refactored. Sergey Kandaurov <pluknet@nginx.com> parents: 8381 diff changeset	1423
8676 7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1424 #if (NGX_QUIC_BPF)
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1425 if (ngx_quic_bpf_attach_id(c, id) != NGX_OK) {
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1426 ngx_log_error(NGX_LOG_ERR, c->log, 0,
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1427 "quic bpf failed to generate socket key");
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1428 /* ignore error, things still may work */
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1429 }
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1430 #endif
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1431
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1432 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1433 "quic create server id %*xs",
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1434 (size_t) NGX_QUIC_SERVER_CID_LEN, id);
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1435 return NGX_OK;
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1436 }
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1437
89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1438
8676 7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1439 #if (NGX_QUIC_BPF)
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1440
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1441 static ngx_int_t
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1442 ngx_quic_bpf_attach_id(ngx_connection_t c, u_char id)
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1443 {
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1444 int fd;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1445 uint64_t cookie;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1446 socklen_t optlen;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1447
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1448 fd = c->listening->fd;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1449
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1450 optlen = sizeof(cookie);
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1451
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1452 if (getsockopt(fd, SOL_SOCKET, SO_COOKIE, &cookie, &optlen) == -1) {
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1453 ngx_log_error(NGX_LOG_ERR, c->log, ngx_socket_errno,
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1454 "quic getsockopt(SO_COOKIE) failed");
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1455
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1456 return NGX_ERROR;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1457 }
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1458
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1459 ngx_quic_dcid_encode_key(id, cookie);
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1460
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1461 return NGX_OK;
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1462 }
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1463
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1464 #endif
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1465
7df607cb2d11 QUIC: ngx_quic_bpf module. Vladimir Homutov <vl@nginx.com> parents: 8674 diff changeset	1466
8368 89ccb04736b9 Server CID change. Sergey Kandaurov <pluknet@nginx.com> parents: 8367 diff changeset	1467 static ngx_int_t
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1468 ngx_quic_send_retry(ngx_connection_t c, ngx_quic_conf_t conf,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1469 ngx_quic_header_t *inpkt)
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1470 {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1471 time_t expires;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1472 ssize_t len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1473 ngx_str_t res, token;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1474 ngx_quic_header_t pkt;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1475
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1476 u_char buf[NGX_QUIC_RETRY_BUFFER_SIZE];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1477 u_char dcid[NGX_QUIC_SERVER_CID_LEN];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1478
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1479 expires = ngx_time() + NGX_QUIC_RETRY_TOKEN_LIFETIME;
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1480
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1481 if (ngx_quic_new_token(c, conf->av_token_key, &token, &inpkt->dcid,
cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1482 expires, 1)
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1483 != NGX_OK)
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1484 {
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1485 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1486 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1487
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1488 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1489 pkt.flags = NGX_QUIC_PKT_FIXED_BIT \| NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_RETRY;
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1490 pkt.version = inpkt->version;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1491 pkt.log = c->log;
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1492
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1493 pkt.odcid = inpkt->dcid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1494 pkt.dcid = inpkt->scid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1495
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1496 /* TODO: generate routable dcid */
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1497 if (RAND_bytes(dcid, NGX_QUIC_SERVER_CID_LEN) != 1) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1498 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1499 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1500
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1501 pkt.scid.len = NGX_QUIC_SERVER_CID_LEN;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1502 pkt.scid.data = dcid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1503
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1504 pkt.token = token;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1505
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1506 res.data = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1507
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	1508 if (ngx_quic_encrypt(&pkt, &res) != NGX_OK) {
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1509 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1510 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1511
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1512 #ifdef NGX_QUIC_DEBUG_PACKETS
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1513 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1514 "quic packet to send len:%uz %xV", res.len, &res);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1515 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1516
8656 43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	1517 len = ngx_quic_send(c, res.data, res.len);
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	1518 if (len == NGX_ERROR) {
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1519 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1520 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1521
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1522 ngx_log_debug(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	1523 "quic retry packet sent to %xV", &pkt.dcid);
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1524
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1525 /*
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1526 * quic-transport 17.2.5.1: A server MUST NOT send more than one Retry
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1527 * packet in response to a single UDP datagram.
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1528 * NGX_DONE will stop quic_input() from processing further
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1529 */
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1530 return NGX_DONE;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1531 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1532
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1533
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1534 static ngx_int_t
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1535 ngx_quic_new_token(ngx_connection_t c, u_char key, ngx_str_t *token,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1536 ngx_str_t *odcid, time_t exp, ngx_uint_t is_retry)
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1537 {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1538 int len, iv_len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1539 u_char p, iv;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1540 EVP_CIPHER_CTX *ctx;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1541 const EVP_CIPHER *cipher;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1542
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1543 u_char in[NGX_QUIC_MAX_TOKEN_SIZE];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1544
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1545 ngx_quic_address_hash(c, !is_retry, in);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1546
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1547 p = in + 20;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1548
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1549 p = ngx_cpymem(p, &exp, sizeof(time_t));
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1550
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1551 *p++ = is_retry ? 1 : 0;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1552
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1553 if (odcid) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1554 *p++ = odcid->len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1555 p = ngx_cpymem(p, odcid->data, odcid->len);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1556
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1557 } else {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1558 *p++ = 0;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1559 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1560
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1561 len = p - in;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1562
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1563 cipher = EVP_aes_256_cbc();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1564 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1565
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1566 token->len = iv_len + len + EVP_CIPHER_block_size(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1567 token->data = ngx_pnalloc(c->pool, token->len);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1568 if (token->data == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1569 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1570 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1571
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1572 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1573 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1574 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1575 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1576
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1577 iv = token->data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1578
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1579 if (RAND_bytes(iv, iv_len) <= 0
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1580 \|\| !EVP_EncryptInit_ex(ctx, cipher, NULL, key, iv))
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1581 {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1582 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1583 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1584 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1585
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1586 token->len = iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1587
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1588 if (EVP_EncryptUpdate(ctx, token->data + token->len, &len, in, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1589 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1590 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1591 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1592
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1593 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1594
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1595 if (EVP_EncryptFinal_ex(ctx, token->data + token->len, &len) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1596 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1597 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1598 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1599
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1600 token->len += len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1601
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1602 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1603
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1604 #ifdef NGX_QUIC_DEBUG_PACKETS
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1605 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1606 "quic new token len:%uz %xV", token->len, token);
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1607 #endif
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1608
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1609 return NGX_OK;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1610 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1611
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1612
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1613 static void
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1614 ngx_quic_address_hash(ngx_connection_t *c, ngx_uint_t no_port, u_char buf[20])
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1615 {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1616 size_t len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1617 u_char *data;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1618 ngx_sha1_t sha1;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1619 struct sockaddr_in *sin;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1620 #if (NGX_HAVE_INET6)
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1621 struct sockaddr_in6 *sin6;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1622 #endif
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1623
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1624 len = (size_t) c->socklen;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1625 data = (u_char *) c->sockaddr;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1626
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1627 if (no_port) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1628 switch (c->sockaddr->sa_family) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1629
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1630 #if (NGX_HAVE_INET6)
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1631 case AF_INET6:
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1632 sin6 = (struct sockaddr_in6 *) c->sockaddr;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1633
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1634 len = sizeof(struct in6_addr);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1635 data = sin6->sin6_addr.s6_addr;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1636
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1637 break;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1638 #endif
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1639
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1640 case AF_INET:
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1641 sin = (struct sockaddr_in *) c->sockaddr;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1642
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1643 len = sizeof(in_addr_t);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1644 data = (u_char *) &sin->sin_addr;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1645
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1646 break;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1647 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1648 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1649
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1650 ngx_sha1_init(&sha1);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1651 ngx_sha1_update(&sha1, data, len);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1652 ngx_sha1_final(buf, &sha1);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1653 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1654
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1655
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1656 static ngx_int_t
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1657 ngx_quic_validate_token(ngx_connection_t c, u_char key,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1658 ngx_quic_header_t *pkt)
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1659 {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1660 int len, tlen, iv_len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1661 u_char iv, p;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1662 time_t now, exp;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1663 size_t total;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1664 ngx_str_t odcid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1665 EVP_CIPHER_CTX *ctx;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1666 const EVP_CIPHER *cipher;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1667
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1668 u_char addr_hash[20];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1669 u_char tdec[NGX_QUIC_MAX_TOKEN_SIZE];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1670
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1671 /* Retry token or NEW_TOKEN in a previous connection */
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1672
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1673 cipher = EVP_aes_256_cbc();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1674 iv = pkt->token.data;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1675 iv_len = EVP_CIPHER_iv_length(cipher);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1676
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1677 /* sanity checks */
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1678
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1679 if (pkt->token.len < (size_t) iv_len + EVP_CIPHER_block_size(cipher)) {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1680 goto garbage;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1681 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1682
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1683 if (pkt->token.len > (size_t) iv_len + NGX_QUIC_MAX_TOKEN_SIZE) {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1684 goto garbage;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1685 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1686
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1687 ctx = EVP_CIPHER_CTX_new();
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1688 if (ctx == NULL) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1689 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1690 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1691
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1692 if (!EVP_DecryptInit_ex(ctx, cipher, NULL, key, iv)) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1693 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1694 return NGX_ERROR;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1695 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1696
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1697 p = pkt->token.data + iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1698 len = pkt->token.len - iv_len;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1699
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1700 if (EVP_DecryptUpdate(ctx, tdec, &len, p, len) != 1) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1701 EVP_CIPHER_CTX_free(ctx);
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1702 goto garbage;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1703 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1704 total = len;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1705
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1706 if (EVP_DecryptFinal_ex(ctx, tdec + len, &tlen) <= 0) {
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1707 EVP_CIPHER_CTX_free(ctx);
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1708 goto garbage;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1709 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1710 total += tlen;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1711
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1712 EVP_CIPHER_CTX_free(ctx);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1713
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1714 if (total < (20 + sizeof(time_t) + 2)) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1715 goto garbage;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1716 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1717
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1718 p = tdec + 20;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1719
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1720 ngx_memcpy(&exp, p, sizeof(time_t));
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1721 p += sizeof(time_t);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1722
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1723 pkt->retried = (*p++ == 1);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1724
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1725 ngx_quic_address_hash(c, !pkt->retried, addr_hash);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1726
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1727 if (ngx_memcmp(tdec, addr_hash, 20) != 0) {
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1728 goto bad_token;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1729 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1730
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1731 odcid.len = *p++;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1732 if (odcid.len) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1733 if (odcid.len > NGX_QUIC_MAX_CID_LEN) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1734 goto bad_token;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1735 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1736
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1737 if ((size_t)(tdec + total - p) < odcid.len) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1738 goto bad_token;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1739 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1740
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1741 odcid.data = p;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1742 p += odcid.len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1743 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1744
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1745 now = ngx_time();
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1746
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1747 if (now > exp) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1748 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic expired token");
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1749 return NGX_DECLINED;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1750 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1751
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1752 if (odcid.len) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1753 pkt->odcid.len = odcid.len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1754 pkt->odcid.data = ngx_pstrdup(c->pool, &odcid);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1755 if (pkt->odcid.data == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1756 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1757 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1758
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1759 } else {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1760 pkt->odcid = pkt->dcid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1761 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1762
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1763 pkt->validated = 1;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1764
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1765 return NGX_OK;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1766
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1767 garbage:
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1768
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1769 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic garbage token");
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1770
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1771 return NGX_ABORT;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1772
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1773 bad_token:
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	1774
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1775 ngx_log_error(NGX_LOG_INFO, c->log, 0, "quic invalid token");
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	1776
8622 183275308d9a QUIC: fixed address validation issues in a new connection. Sergey Kandaurov <pluknet@nginx.com> parents: 8621 diff changeset	1777 return NGX_DECLINED;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1778 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1779
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1780
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	1781 static ngx_int_t
8221 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 8220 diff changeset	1782 ngx_quic_init_connection(ngx_connection_t *c)
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1783 {
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1784 u_char *p;
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1785 size_t clen;
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1786 ssize_t len;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1787 ngx_ssl_conn_t *ssl_conn;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1788 ngx_quic_connection_t *qc;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1789
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1790 qc = ngx_quic_get_connection(c);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1791
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	1792 if (ngx_ssl_create_connection(qc->conf->ssl, c, NGX_SSL_BUFFER) != NGX_OK) {
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1793 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1794 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1795
8655 f596a4e5794b QUIC: disabling bidirectional SSL shutdown earlier. Sergey Kandaurov <pluknet@nginx.com> parents: 8652 diff changeset	1796 c->ssl->no_wait_shutdown = 1;
f596a4e5794b QUIC: disabling bidirectional SSL shutdown earlier. Sergey Kandaurov <pluknet@nginx.com> parents: 8652 diff changeset	1797
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1798 ssl_conn = c->ssl->connection;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1799
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1800 if (SSL_set_quic_method(ssl_conn, &quic_method) == 0) {
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1801 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1802 "quic SSL_set_quic_method() failed");
8232 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1803 return NGX_ERROR;
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1804 }
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 8231 diff changeset	1805
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1806 #ifdef SSL_READ_EARLY_DATA_SUCCESS
8564 b52b2a33b0e5 QUIC: fixed build with OpenSSL after bed310672f39. Sergey Kandaurov <pluknet@nginx.com> parents: 8563 diff changeset	1807 if (SSL_CTX_get_max_early_data(qc->conf->ssl->ctx)) {
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1808 SSL_set_quic_early_data_enabled(ssl_conn, 1);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1809 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1810 #endif
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	1811
8717 0a0b1de9ccab QUIC: fixed expected TLS codepoint with final draft and BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8710 diff changeset	1812 #if BORINGSSL_API_VERSION >= 13
0a0b1de9ccab QUIC: fixed expected TLS codepoint with final draft and BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8710 diff changeset	1813 SSL_set_quic_use_legacy_codepoint(ssl_conn, qc->version != 1);
0a0b1de9ccab QUIC: fixed expected TLS codepoint with final draft and BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8710 diff changeset	1814 #endif
0a0b1de9ccab QUIC: fixed expected TLS codepoint with final draft and BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 8710 diff changeset	1815
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	1816 if (ngx_quic_new_sr_token(c, &qc->dcid, qc->conf->sr_token_key,
8634 831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1817 qc->tp.sr_token)
831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1818 != NGX_OK)
831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1819 {
831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1820 return NGX_ERROR;
831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1821 }
831d1960826f QUIC: generate default stateless reset token key. Roman Arutyunyan <arut@nginx.com> parents: 8631 diff changeset	1822
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1823 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1824 "quic stateless reset token %*xs",
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1825 (size_t) NGX_QUIC_SR_TOKEN_LEN, qc->tp.sr_token);
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	1826
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1827 len = ngx_quic_create_transport_params(NULL, NULL, &qc->tp, &clen);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1828 /* always succeeds */
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1829
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1830 p = ngx_pnalloc(c->pool, len);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1831 if (p == NULL) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1832 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1833 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1834
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1835 len = ngx_quic_create_transport_params(p, p + len, &qc->tp, NULL);
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1836 if (len < 0) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1837 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1838 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1839
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1840 #ifdef NGX_QUIC_DEBUG_PACKETS
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1841 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	1842 "quic transport parameters len:%uz %*xs", len, len, p);
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1843 #endif
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	1844
8247 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 8246 diff changeset	1845 if (SSL_set_quic_transport_params(ssl_conn, p, len) == 0) {
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1846 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1847 "quic SSL_set_quic_transport_params() failed");
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1848 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1849 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1850
8422 90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1851 #if NGX_OPENSSL_QUIC_ZRTT_CTX
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1852 if (SSL_set_quic_early_data_context(ssl_conn, p, clen) == 0) {
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1853 ngx_log_error(NGX_LOG_INFO, c->log, 0,
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1854 "quic SSL_set_quic_early_data_context() failed");
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1855 return NGX_ERROR;
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1856 }
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1857 #endif
90b02ff6b003 Compatibility with BoringSSL master branch. Sergey Kandaurov <pluknet@nginx.com> parents: 8421 diff changeset	1858
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1859 return NGX_OK;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1860 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1861
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1862
8436 9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1863 static ngx_inline size_t
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1864 ngx_quic_max_udp_payload(ngx_connection_t *c)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1865 {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1866 /* TODO: path MTU discovery */
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1867
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1868 #if (NGX_HAVE_INET6)
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1869 if (c->sockaddr->sa_family == AF_INET6) {
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1870 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT6;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1871 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1872 #endif
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1873
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1874 return NGX_QUIC_MAX_UDP_PAYLOAD_OUT;
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1875 }
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1876
9fe7875ce4bb QUIC: further limiting maximum QUIC packet size. Vladimir Homutov <vl@nginx.com> parents: 8435 diff changeset	1877
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1878 static void
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	1879 ngx_quic_input_handler(ngx_event_t *rev)
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1880 {
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1881 ngx_int_t rc;
8730 90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1882 ngx_buf_t *b;
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1883 ngx_connection_t *c;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1884 ngx_quic_connection_t *qc;
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1885
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	1886 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, rev->log, 0, "quic input handler");
eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	1887
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1888 c = rev->data;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1889 qc = ngx_quic_get_connection(c);
8211 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 8209 diff changeset	1890
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	1891 c->log->action = "handling quic input";
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1892
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1893 if (rev->timedout) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1894 ngx_log_error(NGX_LOG_INFO, c->log, NGX_ETIMEDOUT,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	1895 "quic client timed out");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1896 ngx_quic_close_connection(c, NGX_DONE);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1897 return;
8212 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1898 }
e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 8211 diff changeset	1899
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1900 if (c->close) {
8442 b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1901 qc->error_reason = "graceful shutdown";
b9bce2c4fe33 Close QUIC connection with NO_ERROR on c->close. Sergey Kandaurov <pluknet@nginx.com> parents: 8439 diff changeset	1902 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1903 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1904 }
8220 7ada2feeac18 Added processing of CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8218 diff changeset	1905
8730 90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1906 if (!rev->ready) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1907 if (qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1908 ngx_quic_close_connection(c, NGX_OK);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1909 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1910 return;
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1911 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1912
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1913 if (qc->tp.disable_active_migration) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1914 if (c->socklen != qc->socklen
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1915 \|\| ngx_memcmp(c->sockaddr, qc->sockaddr, c->socklen) != 0)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1916 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1917 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1918 "quic dropping packet from new address");
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1919 return;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1920 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1921 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1922
8734 c61fcdc1b8e3 UDP: extended datagram context. Vladimir Homutov <vl@nginx.com> parents: 8730 diff changeset	1923 b = c->udp->dgram->buffer;
8730 90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1924
90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1925 qc->received += (b->last - b->pos);
90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1926
90ae21799f67 QUIC: do not copy input data. Roman Arutyunyan <arut@nginx.com> parents: 8724 diff changeset	1927 rc = ngx_quic_input(c, b, NULL);
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1928
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1929 if (rc == NGX_ERROR) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1930 ngx_quic_close_connection(c, NGX_ERROR);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1931 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1932 }
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1933
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1934 if (rc == NGX_DECLINED) {
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1935 return;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1936 }
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1937
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1938 /* rc == NGX_OK */
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	1939
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1940 qc->send_timer_set = 0;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	1941 ngx_add_timer(rev, qc->tp.max_idle_timeout);
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	1942
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	1943 ngx_quic_connstate_dbg(c);
8199 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1944 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1945
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 8198 diff changeset	1946
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1947 static void
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1948 ngx_quic_close_connection(ngx_connection_t *c, ngx_int_t rc)
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1949 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1950 ngx_pool_t *pool;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1951 ngx_quic_connection_t *qc;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1952
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1953 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	1954 "quic ngx_quic_close_connection rc:%i", rc);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1955
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1956 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1957
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1958 if (qc == NULL) {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1959 if (rc == NGX_ERROR) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1960 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	1961 "quic close connection early error");
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	1962 }
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1963
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1964 } else if (ngx_quic_close_quic(c, rc) == NGX_AGAIN) {
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1965 return;
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	1966 }
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1967
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1968 if (c->ssl) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1969 (void) ngx_ssl_shutdown(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1970 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1971
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1972 if (c->read->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1973 ngx_del_timer(c->read);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1974 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1975
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1976 #if (NGX_STAT_STUB)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1977 (void) ngx_atomic_fetch_add(ngx_stat_active, -1);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1978 #endif
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1979
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1980 c->destroyed = 1;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1981
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1982 pool = c->pool;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1983
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1984 ngx_close_connection(c);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1985
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	1986 ngx_destroy_pool(pool);
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1987 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1988
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	1989
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	1990 static ngx_int_t
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	1991 ngx_quic_close_quic(ngx_connection_t *c, ngx_int_t rc)
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1992 {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1993 ngx_uint_t i;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1994 ngx_queue_t *q;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1995 ngx_quic_send_ctx_t *ctx;
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	1996 ngx_quic_server_id_t *sid;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	1997 ngx_quic_connection_t *qc;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	1998
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	1999 qc = ngx_quic_get_connection(c);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2000
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2001 if (!qc->closing) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2002
8398 8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	2003 /* drop packets from retransmit queues, no ack is expected */
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	2004 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
8652 e9bd4305e68b QUIC: fixed send contexts cleanup. Vladimir Homutov <vl@nginx.com> parents: 8651 diff changeset	2005 ngx_quic_free_frames(c, &qc->send_ctx[i].sent);
8398 8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	2006 }
8bec0ac23cf9 Fixed retransmission of frames after closing connection. Vladimir Homutov <vl@nginx.com> parents: 8397 diff changeset	2007
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2008 if (rc == NGX_DONE) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2009
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2010 /*
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2011 * 10.2. Idle Timeout
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2012 *
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2013 * If the idle timeout is enabled by either peer, a connection is
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2014 * silently closed and its state is discarded when it remains idle
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2015 */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2016
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2017 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2018 "quic closing %s connection",
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2019 qc->draining ? "drained" : "idle");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2020
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2021 } else {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2022
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2023 /*
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2024 * 10.3. Immediate Close
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2025 *
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2026 * An endpoint sends a CONNECTION_CLOSE frame (Section 19.19)
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2027 * to terminate the connection immediately.
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2028 */
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2029
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2030 qc->error_level = c->ssl ? SSL_quic_read_level(c->ssl->connection)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2031 : ssl_encryption_initial;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2032
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2033 if (rc == NGX_OK) {
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	2034 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	2035 "quic immediate close drain:%d",
d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	2036 qc->draining);
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2037
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2038 qc->close.log = c->log;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2039 qc->close.data = c;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2040 qc->close.handler = ngx_quic_close_timer_handler;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2041 qc->close.cancelable = 1;
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2042
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2043 ctx = ngx_quic_get_send_ctx(qc, qc->error_level);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2044
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	2045 ngx_add_timer(&qc->close, 3 * ngx_quic_pto(c, ctx));
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2046
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2047 qc->error = NGX_QUIC_ERR_NO_ERROR;
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2048
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2049 } else {
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2050 if (qc->error == 0 && !qc->error_app) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2051 qc->error = NGX_QUIC_ERR_INTERNAL_ERROR;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2052 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2053
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2054 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	2055 "quic immediate close due to %s error: %ui %s",
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2056 qc->error_app ? "app " : "", qc->error,
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2057 qc->error_reason ? qc->error_reason : "");
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2058 }
d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2059
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2060 (void) ngx_quic_send_cc(c);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2061
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2062 if (qc->error_level == ssl_encryption_handshake) {
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2063 /* for clients that might not have handshake keys */
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2064 qc->error_level = ssl_encryption_initial;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2065 (void) ngx_quic_send_cc(c);
8400 d96ddef458cd Added sending of extra CONNECTION_CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8399 diff changeset	2066 }
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2067 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2068
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2069 qc->closing = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2070 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2071
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2072 if (rc == NGX_ERROR && qc->close.timer_set) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2073 /* do not wait for timer in case of fatal error */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2074 ngx_del_timer(&qc->close);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2075 }
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2076
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2077 if (ngx_quic_close_streams(c, qc) == NGX_AGAIN) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2078 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2079 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2080
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2081 if (qc->push.timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2082 ngx_del_timer(&qc->push);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2083 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2084
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	2085 if (qc->pto.timer_set) {
3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	2086 ngx_del_timer(&qc->pto);
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2087 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2088
8434 ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	2089 if (qc->push.posted) {
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	2090 ngx_delete_posted_event(&qc->push);
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	2091 }
ea4899591798 QUIC: Fixed connection cleanup. Vladimir Homutov <vl@nginx.com> parents: 8433 diff changeset	2092
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2093 while (!ngx_queue_empty(&qc->server_ids)) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2094 q = ngx_queue_head(&qc->server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2095 sid = ngx_queue_data(q, ngx_quic_server_id_t, queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2096
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2097 ngx_queue_remove(q);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2098 ngx_rbtree_delete(&c->listening->rbtree, &sid->udp.node);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2099 qc->nserver_ids--;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2100 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2101
8553 dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	2102 if (qc->close.timer_set) {
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	2103 return NGX_AGAIN;
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	2104 }
dbcb9d0a3df1 QUIC: prevented posted push event while in the draining state. Vladimir Homutov <vl@nginx.com> parents: 8546 diff changeset	2105
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2106 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2107 "quic part of connection is terminated");
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2108
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2109 /* may be tested from SSL callback during SSL shutdown */
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2110 c->udp = NULL;
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2111
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2112 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2113 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2114
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2115
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2116 void
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2117 ngx_quic_finalize_connection(ngx_connection_t *c, ngx_uint_t err,
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2118 const char *reason)
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2119 {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2120 ngx_quic_connection_t *qc;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2121
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2122 qc = ngx_quic_get_connection(c);
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2123 qc->error = err;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2124 qc->error_reason = reason;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2125 qc->error_app = 1;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2126 qc->error_ftype = 0;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2127
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2128 ngx_quic_close_connection(c, NGX_ERROR);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2129 }
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2130
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2131
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2132 void
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2133 ngx_quic_shutdown_connection(ngx_connection_t *c, ngx_uint_t err,
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2134 const char *reason)
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2135 {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2136 ngx_quic_connection_t *qc;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2137
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2138 qc = ngx_quic_get_connection(c);
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2139 qc->shutdown = 1;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2140 qc->shutdown_code = err;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2141 qc->shutdown_reason = reason;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2142
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2143 ngx_quic_shutdown_quic(c);
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2144 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2145
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	2146
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2147 static void
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2148 ngx_quic_close_timer_handler(ngx_event_t *ev)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2149 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2150 ngx_connection_t *c;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2151
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2152 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic close timer");
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2153
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2154 c = ev->data;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2155 ngx_quic_close_connection(c, NGX_DONE);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2156 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2157
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2158
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2159 static ngx_int_t
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2160 ngx_quic_close_streams(ngx_connection_t c, ngx_quic_connection_t qc)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2161 {
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2162 ngx_event_t rev, wev;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2163 ngx_rbtree_t *tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2164 ngx_rbtree_node_t *node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2165 ngx_quic_stream_t *qs;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2166
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2167 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2168 ngx_uint_t ns;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2169 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2170
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2171 tree = &qc->streams.tree;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2172
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2173 if (tree->root == tree->sentinel) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2174 return NGX_OK;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2175 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2176
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2177 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2178 ns = 0;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2179 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2180
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2181 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2182 node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2183 node = ngx_rbtree_next(tree, node))
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2184 {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2185 qs = (ngx_quic_stream_t *) node;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2186
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2187 rev = qs->c->read;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2188 rev->error = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2189 rev->ready = 1;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2190
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2191 wev = qs->c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2192 wev->error = 1;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	2193 wev->ready = 1;
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2194
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2195 ngx_post_event(rev, &ngx_posted_events);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2196
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2197 if (rev->timer_set) {
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2198 ngx_del_timer(rev);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2199 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2200
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2201 #if (NGX_DEBUG)
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2202 ns++;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2203 #endif
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2204 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2205
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2206 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2207 "quic connection has %ui active streams", ns);
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2208
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2209 return NGX_AGAIN;
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2210 }
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2211
d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2212
8703 d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2213 ngx_int_t
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2214 ngx_quic_reset_stream(ngx_connection_t *c, ngx_uint_t err)
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2215 {
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2216 ngx_event_t *wev;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2217 ngx_connection_t *pc;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2218 ngx_quic_frame_t *frame;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2219 ngx_quic_stream_t *qs;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2220 ngx_quic_connection_t *qc;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2221
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2222 qs = c->quic;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2223 pc = qs->parent;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2224 qc = ngx_quic_get_connection(pc);
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2225
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2226 frame = ngx_quic_alloc_frame(pc);
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2227 if (frame == NULL) {
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2228 return NGX_ERROR;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2229 }
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2230
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2231 frame->level = ssl_encryption_application;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2232 frame->type = NGX_QUIC_FT_RESET_STREAM;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2233 frame->u.reset_stream.id = qs->id;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2234 frame->u.reset_stream.error_code = err;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2235 frame->u.reset_stream.final_size = c->sent;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2236
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2237 ngx_quic_queue_frame(qc, frame);
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2238
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2239 wev = c->write;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2240 wev->error = 1;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2241 wev->ready = 1;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2242
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2243 return NGX_OK;
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2244 }
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2245
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	2246
8354 d11bc25fc4c3 Refactored ngx_quic_close_connection(). Vladimir Homutov <vl@nginx.com> parents: 8350 diff changeset	2247 static ngx_int_t
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	2248 ngx_quic_input(ngx_connection_t c, ngx_buf_t b, ngx_quic_conf_t *conf)
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	2249 {
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2250 u_char *p;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2251 ngx_int_t rc;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2252 ngx_uint_t good;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2253 ngx_quic_header_t pkt;
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	2254
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2255 good = 0;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2256
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2257 p = b->pos;
8208 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 8207 diff changeset	2258
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2259 while (p < b->last) {
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2260
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2261 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2262 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2263 pkt.data = p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2264 pkt.len = b->last - p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2265 pkt.log = c->log;
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	2266 pkt.flags = p[0];
8559 a89a58c642ef QUIC: simplified packet header parsing. Vladimir Homutov <vl@nginx.com> parents: 8558 diff changeset	2267 pkt.raw->pos++;
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	2268
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	2269 rc = ngx_quic_process_packet(c, conf, &pkt);
8193 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 8192 diff changeset	2270
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2271 #if (NGX_DEBUG)
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2272 if (pkt.parsed) {
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	2273 ngx_log_debug5(NGX_LOG_DEBUG_EVENT, c->log, 0,
8609 f32740ddd484 QUIC: got rid of "pkt" abbreviation in logs. Vladimir Homutov <vl@nginx.com> parents: 8608 diff changeset	2274 "quic packet %s done decr:%d pn:%L perr:%ui rc:%i",
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2275 ngx_quic_level_name(pkt.level), pkt.decrypted,
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	2276 pkt.pn, pkt.error, rc);
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2277 } else {
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2278 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8609 f32740ddd484 QUIC: got rid of "pkt" abbreviation in logs. Vladimir Homutov <vl@nginx.com> parents: 8608 diff changeset	2279 "quic packet done parse failed rc:%i", rc);
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2280 }
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2281 #endif
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2282
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2283 if (rc == NGX_ERROR) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2284 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2285 }
8206 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 8205 diff changeset	2286
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2287 if (rc == NGX_DONE) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2288 /* stop further processing */
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2289 return NGX_DECLINED;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2290 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2291
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2292 if (rc == NGX_OK) {
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2293 good = 1;
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2294 }
702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2295
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2296 /* NGX_OK \|\| NGX_DECLINED */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2297
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2298 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2299 * we get NGX_DECLINED when there are no keys [yet] available
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2300 * to decrypt packet.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2301 * Instead of queueing it, we ignore it and rely on the sender's
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2302 * retransmission:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2303 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2304 * 12.2. Coalescing Packets:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2305 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2306 * For example, if decryption fails (because the keys are
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2307 * not available or any other reason), the receiver MAY either
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2308 * discard or buffer the packet for later processing and MUST
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2309 * attempt to process the remaining packets.
8535 eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	2310 *
eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	2311 * We also skip packets that don't match connection state
eb5aa85294e9 QUIC: discard unrecognized long packes. Vladimir Homutov <vl@nginx.com> parents: 8533 diff changeset	2312 * or cannot be parsed properly.
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2313 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2314
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2315 /* b->pos is at header end, adjust by actual packet length */
8558 0f37b4ef3cd9 QUIC: keep the entire packet size in pkt->len. Roman Arutyunyan <arut@nginx.com> parents: 8557 diff changeset	2316 b->pos = pkt.data + pkt.len;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2317
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2318 /* firefox workaround: skip zero padding at the end of quic packet */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2319 while (b->pos < b->last && *(b->pos) == 0) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2320 b->pos++;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2321 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2322
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2323 p = b->pos;
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2324 }
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2325
8545 702f1d2581a4 QUIC: eliminated idle timeout restart for dropped packets. Roman Arutyunyan <arut@nginx.com> parents: 8541 diff changeset	2326 return good ? NGX_OK : NGX_DECLINED;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2327 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2328
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2329
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2330 static ngx_int_t
8563 bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	2331 ngx_quic_process_packet(ngx_connection_t c, ngx_quic_conf_t conf,
bed310672f39 QUIC: moved ssl configuration pointer to quic configuration. Vladimir Homutov <vl@nginx.com> parents: 8562 diff changeset	2332 ngx_quic_header_t *pkt)
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2333 {
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	2334 ngx_int_t rc;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2335 ngx_quic_connection_t *qc;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2336
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2337 c->log->action = "parsing quic packet";
eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2338
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2339 rc = ngx_quic_parse_packet(pkt);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2340
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2341 if (rc == NGX_DECLINED \|\| rc == NGX_ERROR) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2342 return rc;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2343 }
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2344
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2345 pkt->parsed = 1;
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2346
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2347 c->log->action = "processing quic packet";
eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2348
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2349 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2350 "quic packet rx dcid len:%uz %xV",
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2351 pkt->dcid.len, &pkt->dcid);
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2352
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	2353 #if (NGX_DEBUG)
52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	2354 if (pkt->level != ssl_encryption_application) {
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2355 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2356 "quic packet rx scid len:%uz %xV",
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2357 pkt->scid.len, &pkt->scid);
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	2358 }
8641 fe53def49945 QUIC: refactored long header parsing. Sergey Kandaurov <pluknet@nginx.com> parents: 8639 diff changeset	2359
fe53def49945 QUIC: refactored long header parsing. Sergey Kandaurov <pluknet@nginx.com> parents: 8639 diff changeset	2360 if (pkt->level == ssl_encryption_initial) {
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2361 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	2362 "quic address validation token len:%uz %xV",
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	2363 pkt->token.len, &pkt->token);
8641 fe53def49945 QUIC: refactored long header parsing. Sergey Kandaurov <pluknet@nginx.com> parents: 8639 diff changeset	2364 }
8578 52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	2365 #endif
52ad697f9d1c QUIC: enabled more key-related debug by default. Vladimir Homutov <vl@nginx.com> parents: 8577 diff changeset	2366
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2367 qc = ngx_quic_get_connection(c);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2368
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2369 if (qc) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2370
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2371 if (rc == NGX_ABORT) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2372 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2373 "quic unsupported version: 0x%xD", pkt->version);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2374 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2375 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2376
8624 340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2377 if (pkt->level != ssl_encryption_application) {
8688 a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2378
8624 340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2379 if (pkt->version != qc->version) {
340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2380 ngx_log_error(NGX_LOG_INFO, c->log, 0,
340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2381 "quic version mismatch: 0x%xD", pkt->version);
340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2382 return NGX_DECLINED;
340cd26158fb QUIC: preparatory changes for multiple QUIC versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8623 diff changeset	2383 }
8688 a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2384
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2385 if (ngx_quic_check_csid(qc, pkt) != NGX_OK) {
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2386 return NGX_DECLINED;
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	2387 }
b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	2388
8688 a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2389 } else {
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2390
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2391 if (ngx_quic_process_stateless_reset(c, pkt) == NGX_OK) {
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2392 ngx_log_error(NGX_LOG_INFO, c->log, 0,
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2393 "quic stateless reset packet detected");
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2394
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2395 qc->draining = 1;
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2396 ngx_quic_close_connection(c, NGX_OK);
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2397
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2398 return NGX_OK;
a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2399 }
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2400 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2401
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2402 return ngx_quic_process_payload(c, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2403 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2404
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2405 /* packet does not belong to a connection */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2406
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2407 if (rc == NGX_ABORT) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2408 return ngx_quic_negotiate_version(c, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2409 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2410
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2411 if (pkt->level == ssl_encryption_application) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2412 return ngx_quic_send_stateless_reset(c, conf, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2413 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2414
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2415 if (pkt->level != ssl_encryption_initial) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2416 return NGX_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2417 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2418
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2419 c->log->action = "processing initial packet";
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2420
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2421 if (pkt->dcid.len < NGX_QUIC_CID_LEN_MIN) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2422 /* 7.2. Negotiating Connection IDs */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2423 ngx_log_error(NGX_LOG_INFO, c->log, 0,
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2424 "quic too short dcid in initial"
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2425 " packet: len:%i", pkt->dcid.len);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2426 return NGX_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2427 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2428
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2429 /* process retry and initialize connection IDs */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2430
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2431 if (pkt->token.len) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2432
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	2433 rc = ngx_quic_validate_token(c, conf->av_token_key, pkt);
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2434
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2435 if (rc == NGX_ERROR) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2436 /* internal error */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2437 return NGX_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2438
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2439 } else if (rc == NGX_ABORT) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2440 /* token cannot be decrypted */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2441 return ngx_quic_send_early_cc(c, pkt,
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2442 NGX_QUIC_ERR_INVALID_TOKEN,
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2443 "cannot decrypt token");
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2444 } else if (rc == NGX_DECLINED) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2445 /* token is invalid */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2446
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2447 if (pkt->retried) {
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	2448 /* invalid address validation token */
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2449 return ngx_quic_send_early_cc(c, pkt,
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2450 NGX_QUIC_ERR_INVALID_TOKEN,
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	2451 "invalid address validation token");
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2452 } else if (conf->retry) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2453 /* invalid NEW_TOKEN */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2454 return ngx_quic_send_retry(c, conf, pkt);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2455 }
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2456 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2457
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2458 /* NGX_OK */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2459
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2460 } else if (conf->retry) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2461 return ngx_quic_send_retry(c, conf, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2462
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2463 } else {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2464 pkt->odcid = pkt->dcid;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2465 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2466
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2467 if (ngx_terminate \|\| ngx_exiting) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2468 if (conf->retry) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2469 return ngx_quic_send_retry(c, conf, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2470 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2471
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2472 return NGX_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2473 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2474
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2475 c->log->action = "creating quic connection";
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2476
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2477 qc = ngx_quic_new_connection(c, conf, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2478 if (qc == NULL) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2479 return NGX_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2480 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2481
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2482 return ngx_quic_process_payload(c, pkt);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2483 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2484
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2485
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2486 static ngx_int_t
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2487 ngx_quic_process_payload(ngx_connection_t c, ngx_quic_header_t pkt)
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2488 {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2489 ngx_int_t rc;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2490 ngx_quic_send_ctx_t *ctx;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2491 ngx_quic_connection_t *qc;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2492 static u_char buf[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2493
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2494 qc = ngx_quic_get_connection(c);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2495
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2496 qc->error = 0;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2497 qc->error_reason = 0;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2498
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2499 c->log->action = "decrypting packet";
eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2500
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2501 if (!ngx_quic_keys_available(qc->keys, pkt->level)) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2502 ngx_log_error(NGX_LOG_INFO, c->log, 0,
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2503 "quic no level %d keys yet, ignoring packet", pkt->level);
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2504 return NGX_DECLINED;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2505 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2506
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2507 pkt->keys = qc->keys;
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2508 pkt->key_phase = qc->key_phase;
8383 7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2509 pkt->plaintext = buf;
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2510
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2511 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
7ea34e13937f Address validation using Retry packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8382 diff changeset	2512
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2513 rc = ngx_quic_decrypt(pkt, &ctx->largest_pn);
8536 c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	2514 if (rc != NGX_OK) {
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	2515 qc->error = pkt->error;
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	2516 qc->error_reason = "failed to decrypt packet";
c6b963de0c00 QUIC: pass return code from ngx_quic_decrypt() to the caller. Vladimir Homutov <vl@nginx.com> parents: 8535 diff changeset	2517 return rc;
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	2518 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	2519
8580 07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2520 pkt->decrypted = 1;
07971f870879 QUIC: added debug message with final packet processing status. Vladimir Homutov <vl@nginx.com> parents: 8579 diff changeset	2521
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2522 if (c->ssl == NULL) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2523 if (ngx_quic_init_connection(c) != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2524 return NGX_ERROR;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2525 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2526 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2527
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2528 if (pkt->level == ssl_encryption_handshake) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2529 /*
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2530 * 4.10.1. The successful use of Handshake packets indicates
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2531 * that no more Initial packets need to be exchanged
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2532 */
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2533 ngx_quic_discard_ctx(c, ssl_encryption_initial);
8611 e2086d8181fa QUIC: added push event afer the address was validated. Vladimir Homutov <vl@nginx.com> parents: 8610 diff changeset	2534
e2086d8181fa QUIC: added push event afer the address was validated. Vladimir Homutov <vl@nginx.com> parents: 8610 diff changeset	2535 if (qc->validated == 0) {
e2086d8181fa QUIC: added push event afer the address was validated. Vladimir Homutov <vl@nginx.com> parents: 8610 diff changeset	2536 qc->validated = 1;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2537 ngx_post_event(&qc->push, &ngx_posted_events);
8611 e2086d8181fa QUIC: added push event afer the address was validated. Vladimir Homutov <vl@nginx.com> parents: 8610 diff changeset	2538 }
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2539 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2540
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2541 if (qc->closing) {
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2542 /*
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2543 * 10.1 Closing and Draining Connection States
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2544 * ... delayed or reordered packets are properly discarded.
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2545 *
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2546 * An endpoint retains only enough information to generate
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2547 * a packet containing a CONNECTION_CLOSE frame and to identify
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2548 * packets as belonging to the connection.
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2549 */
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2550
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2551 qc->error_level = pkt->level;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2552 qc->error = NGX_QUIC_ERR_NO_ERROR;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2553 qc->error_reason = "connection is closing, packet discarded";
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2554 qc->error_ftype = 0;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2555 qc->error_app = 0;
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2556
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2557 return ngx_quic_send_cc(c);
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2558 }
1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2559
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	2560 pkt->received = ngx_current_msec;
8574 1d4417e4f2d0 QUIC: fixed measuring ACK Delay against 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8573 diff changeset	2561
8576 eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2562 c->log->action = "handling payload";
eacca87c476e QUIC: updated c->log->action strings to reflect proper state. Vladimir Homutov <vl@nginx.com> parents: 8575 diff changeset	2563
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2564 if (pkt->level != ssl_encryption_application) {
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2565 return ngx_quic_handle_frames(c, pkt);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2566 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2567
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2568 if (!pkt->key_update) {
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2569 return ngx_quic_handle_frames(c, pkt);
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2570 }
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2571
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2572 /* switch keys and generate next on Key Phase change */
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2573
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2574 qc->key_phase ^= 1;
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2575 ngx_quic_keys_switch(c, qc->keys);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2576
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2577 rc = ngx_quic_handle_frames(c, pkt);
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2578 if (rc != NGX_OK) {
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2579 return rc;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2580 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2581
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2582 return ngx_quic_keys_update(c, qc->keys);
8223 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	2583 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	2584
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 8222 diff changeset	2585
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2586 static ngx_int_t
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2587 ngx_quic_send_early_cc(ngx_connection_t c, ngx_quic_header_t inpkt,
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2588 ngx_uint_t err, const char *reason)
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2589 {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2590 ssize_t len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2591 ngx_str_t res;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2592 ngx_quic_frame_t frame;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2593 ngx_quic_header_t pkt;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2594
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2595 static u_char src[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2596 static u_char dst[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2597
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2598 ngx_memzero(&frame, sizeof(ngx_quic_frame_t));
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2599 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2600
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2601 frame.level = inpkt->level;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2602 frame.type = NGX_QUIC_FT_CONNECTION_CLOSE;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2603 frame.u.close.error_code = err;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2604
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2605 frame.u.close.reason.data = (u_char *) reason;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2606 frame.u.close.reason.len = ngx_strlen(reason);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2607
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2608 len = ngx_quic_create_frame(NULL, &frame);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2609 if (len > NGX_QUIC_MAX_UDP_PAYLOAD_SIZE) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2610 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2611 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2612
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2613 ngx_quic_log_frame(c->log, &frame, 1);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2614
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2615 len = ngx_quic_create_frame(src, &frame);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2616 if (len == -1) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2617 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2618 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2619
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2620 pkt.keys = ngx_quic_keys_new(c->pool);
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2621 if (pkt.keys == NULL) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2622 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2623 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2624
8710 44b4c6180106 QUIC: multiple versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8709 diff changeset	2625 if (ngx_quic_keys_set_initial_secret(c->pool, pkt.keys, &inpkt->dcid,
44b4c6180106 QUIC: multiple versions support. Sergey Kandaurov <pluknet@nginx.com> parents: 8709 diff changeset	2626 inpkt->version)
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2627 != NGX_OK)
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2628 {
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2629 return NGX_ERROR;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2630 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2631
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2632 pkt.flags = NGX_QUIC_PKT_FIXED_BIT \| NGX_QUIC_PKT_LONG
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2633 \| NGX_QUIC_PKT_INITIAL;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2634
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2635 pkt.num_len = 1;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2636 /*
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2637 * pkt.num = 0;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2638 * pkt.trunc = 0;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2639 */
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2640
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2641 pkt.version = inpkt->version;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2642 pkt.log = c->log;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2643 pkt.level = inpkt->level;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2644 pkt.dcid = inpkt->scid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2645 pkt.scid = inpkt->dcid;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2646 pkt.payload.data = src;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2647 pkt.payload.len = len;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2648
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2649 res.data = dst;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2650
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2651 if (ngx_quic_encrypt(&pkt, &res) != NGX_OK) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2652 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2653 }
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2654
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2655 if (ngx_quic_send(c, res.data, res.len) == NGX_ERROR) {
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2656 return NGX_ERROR;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	2657 }
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2658
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2659 return NGX_OK;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2660 }
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2661
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	2662
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2663 static void
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2664 ngx_quic_discard_ctx(ngx_connection_t *c, enum ssl_encryption_level_t level)
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2665 {
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2666 ngx_queue_t *q;
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2667 ngx_quic_frame_t *f;
8339 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 8338 diff changeset	2668 ngx_quic_send_ctx_t *ctx;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2669 ngx_quic_connection_t *qc;
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	2670
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2671 qc = ngx_quic_get_connection(c);
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2672
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2673 if (!ngx_quic_keys_available(qc->keys, level)) {
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2674 return;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2675 }
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2676
8621 9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2677 ngx_quic_keys_discard(qc->keys, level);
9c3be23ddbe7 QUIC: refactored key handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8620 diff changeset	2678
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2679 qc->pto_count = 0;
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2680
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2681 ctx = ngx_quic_get_send_ctx(qc, level);
8507 7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2682
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2683 while (!ngx_queue_empty(&ctx->sent)) {
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2684 q = ngx_queue_head(&ctx->sent);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2685 ngx_queue_remove(q);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2686
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2687 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2688 ngx_quic_congestion_ack(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2689 ngx_quic_free_frame(c, f);
7f9938cbcd12 QUIC: fixed leak of bytes_in_flight on keys discard. Sergey Kandaurov <pluknet@nginx.com> parents: 8506 diff changeset	2690 }
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2691
8612 b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2692 while (!ngx_queue_empty(&ctx->frames)) {
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2693 q = ngx_queue_head(&ctx->frames);
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2694 ngx_queue_remove(q);
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2695
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2696 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2697 ngx_quic_congestion_ack(c, f);
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2698 ngx_quic_free_frame(c, f);
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2699 }
b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	2700
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2701 if (level == ssl_encryption_initial) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2702 ngx_quic_clear_temp_server_ids(c);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2703 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2704
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2705 ctx->send_ack = 0;
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	2706
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	2707 ngx_quic_set_lost_timer(c);
8304 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2708 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2709
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2710
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 8303 diff changeset	2711 static ngx_int_t
8688 a346905c359f QUIC: fixed stateless reset recognition and send. Roman Arutyunyan <arut@nginx.com> parents: 8687 diff changeset	2712 ngx_quic_check_csid(ngx_quic_connection_t qc, ngx_quic_header_t pkt)
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	2713 {
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2714 ngx_queue_t *q;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2715 ngx_quic_client_id_t *cid;
8381 6e100d8c138a Preserve original DCID and unbreak parsing 0-RTT packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8380 diff changeset	2716
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2717 for (q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2718 q != ngx_queue_sentinel(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2719 q = ngx_queue_next(q))
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2720 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2721 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2722
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2723 if (pkt->scid.len == cid->len
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2724 && ngx_memcmp(pkt->scid.data, cid->id, cid->len) == 0)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2725 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2726 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2727 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2728 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2729
8560 d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2730 ngx_log_error(NGX_LOG_INFO, pkt->log, 0, "quic unexpected quic scid");
d0d3fc0697a0 QUIC: packet processing refactoring. Vladimir Homutov <vl@nginx.com> parents: 8559 diff changeset	2731 return NGX_ERROR;
8182 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 8180 diff changeset	2732 }
8171 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	2733
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	2734
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2735 static ngx_int_t
8687 1c6343bd7933 QUIC: refactored packet processing. Roman Arutyunyan <arut@nginx.com> parents: 8686 diff changeset	2736 ngx_quic_handle_frames(ngx_connection_t c, ngx_quic_header_t pkt)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2737 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2738 u_char end, p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2739 ssize_t len;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2740 ngx_buf_t buf;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2741 ngx_uint_t do_close;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2742 ngx_chain_t chain;
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2743 ngx_quic_frame_t frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2744 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2745
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2746 qc = ngx_quic_get_connection(c);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2747
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2748 p = pkt->payload.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2749 end = p + pkt->payload.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2750
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2751 do_close = 0;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2752
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2753 while (p < end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2754
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2755 c->log->action = "parsing frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2756
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2757 ngx_memzero(&buf, sizeof(ngx_buf_t));
8659 d9f673d18e9b QUIC: set the temporary flag for input frame buffers. Roman Arutyunyan <arut@nginx.com> parents: 8658 diff changeset	2758 buf.temporary = 1;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2759
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2760 chain.buf = &buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2761 chain.next = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2762 frame.data = &chain;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2763
8240 1f002206a59b Added boundaries checks into frame parser. Vladimir Homutov <vl@nginx.com> parents: 8239 diff changeset	2764 len = ngx_quic_parse_frame(pkt, p, end, &frame);
8251 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 8247 diff changeset	2765
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2766 if (len < 0) {
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2767 qc->error = pkt->error;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2768 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2769 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2770
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	2771 ngx_quic_log_frame(c->log, &frame, 0);
b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	2772
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2773 c->log->action = "handling frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	2774
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2775 p += len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2776
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2777 switch (frame.type) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2778
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2779 case NGX_QUIC_FT_ACK:
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	2780 if (ngx_quic_handle_ack_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2781 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2782 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2783
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2784 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2785
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2786 case NGX_QUIC_FT_PADDING:
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2787 /* no action required */
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2788 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2789
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2790 case NGX_QUIC_FT_CONNECTION_CLOSE:
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	2791 case NGX_QUIC_FT_CONNECTION_CLOSE_APP:
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2792 do_close = 1;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2793 continue;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2794 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2795
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2796 /* got there with ack-eliciting packet */
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2797 pkt->need_ack = 1;
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2798
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2799 switch (frame.type) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2800
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2801 case NGX_QUIC_FT_CRYPTO:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2802
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	2803 if (ngx_quic_handle_crypto_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2804 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2805 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2806
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2807 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2808
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2809 case NGX_QUIC_FT_PING:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2810 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2811
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2812 case NGX_QUIC_FT_STREAM0:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2813 case NGX_QUIC_FT_STREAM1:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2814 case NGX_QUIC_FT_STREAM2:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2815 case NGX_QUIC_FT_STREAM3:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2816 case NGX_QUIC_FT_STREAM4:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2817 case NGX_QUIC_FT_STREAM5:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2818 case NGX_QUIC_FT_STREAM6:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2819 case NGX_QUIC_FT_STREAM7:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2820
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	2821 if (ngx_quic_handle_stream_frame(c, pkt, &frame) != NGX_OK) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2822 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2823 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2824
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2825 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2826
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2827 case NGX_QUIC_FT_MAX_DATA:
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2828
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2829 if (ngx_quic_handle_max_data_frame(c, &frame.u.max_data) != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2830 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2831 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2832 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2833
8237 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2834 break;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8236 diff changeset	2835
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2836 case NGX_QUIC_FT_STREAMS_BLOCKED:
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2837 case NGX_QUIC_FT_STREAMS_BLOCKED2:
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2838
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2839 if (ngx_quic_handle_streams_blocked_frame(c, pkt,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2840 &frame.u.streams_blocked)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2841 != NGX_OK)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2842 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2843 return NGX_ERROR;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2844 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	2845
8236 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2846 break;
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 8235 diff changeset	2847
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2848 case NGX_QUIC_FT_STREAM_DATA_BLOCKED:
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2849
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2850 if (ngx_quic_handle_stream_data_blocked_frame(c, pkt,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2851 &frame.u.stream_data_blocked)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2852 != NGX_OK)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2853 {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2854 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2855 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2856
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2857 break;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	2858
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2859 case NGX_QUIC_FT_MAX_STREAM_DATA:
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2860
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2861 if (ngx_quic_handle_max_stream_data_frame(c, pkt,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2862 &frame.u.max_stream_data)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2863 != NGX_OK)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2864 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2865 return NGX_ERROR;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2866 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2867
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2868 break;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	2869
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2870 case NGX_QUIC_FT_RESET_STREAM:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2871
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2872 if (ngx_quic_handle_reset_stream_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2873 &frame.u.reset_stream)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2874 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2875 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2876 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2877 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2878
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2879 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2880
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2881 case NGX_QUIC_FT_STOP_SENDING:
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2882
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2883 if (ngx_quic_handle_stop_sending_frame(c, pkt,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2884 &frame.u.stop_sending)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2885 != NGX_OK)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2886 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2887 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2888 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2889
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2890 break;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	2891
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2892 case NGX_QUIC_FT_MAX_STREAMS:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2893 case NGX_QUIC_FT_MAX_STREAMS2:
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2894
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2895 if (ngx_quic_handle_max_streams_frame(c, pkt, &frame.u.max_streams)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2896 != NGX_OK)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2897 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2898 return NGX_ERROR;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2899 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2900
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2901 break;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	2902
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2903 case NGX_QUIC_FT_PATH_CHALLENGE:
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2904
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2905 if (ngx_quic_handle_path_challenge_frame(c, pkt,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2906 &frame.u.path_challenge)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2907 != NGX_OK)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2908 {
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2909 return NGX_ERROR;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2910 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2911
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2912 break;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	2913
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2914 case NGX_QUIC_FT_NEW_CONNECTION_ID:
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2915
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2916 if (ngx_quic_handle_new_connection_id_frame(c, pkt, &frame.u.ncid)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2917 != NGX_OK)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2918 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2919 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2920 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2921
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2922 break;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	2923
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2924 case NGX_QUIC_FT_RETIRE_CONNECTION_ID:
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2925
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2926 if (ngx_quic_handle_retire_connection_id_frame(c, pkt,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2927 &frame.u.retire_cid)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2928 != NGX_OK)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2929 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2930 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2931 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2932
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2933 break;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	2934
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2935 case NGX_QUIC_FT_PATH_RESPONSE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2936
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2937 /* TODO: handle */
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2938 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2939 "quic frame handler not implemented");
8325 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2940 break;
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 8322 diff changeset	2941
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2942 default:
8346 4e4485793418 Added MAX_STREAM_DATA stub handler. Vladimir Homutov <vl@nginx.com> parents: 8345 diff changeset	2943 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	2944 "quic missing frame handler");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2945 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2946 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2947 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2948
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2949 if (p != end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2950 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	2951 "quic trailing garbage in payload:%ui bytes", end - p);
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2952
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	2953 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2954 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2955 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2956
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2957 if (do_close) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2958 qc->draining = 1;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	2959 ngx_quic_close_connection(c, NGX_OK);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2960 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	2961
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2962 if (ngx_quic_ack_packet(c, pkt) != NGX_OK) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2963 return NGX_ERROR;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2964 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2965
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2966 return NGX_OK;
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2967 }
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2968
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2969
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	2970 static ngx_int_t
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2971 ngx_quic_ack_packet(ngx_connection_t c, ngx_quic_header_t pkt)
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2972 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2973 uint64_t base, largest, smallest, gs, ge, gap, range, pn;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2974 uint64_t prev_pending;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2975 ngx_uint_t i, nr;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2976 ngx_quic_send_ctx_t *ctx;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2977 ngx_quic_ack_range_t *r;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2978 ngx_quic_connection_t *qc;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2979
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2980 c->log->action = "preparing ack";
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2981
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2982 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2983
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2984 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2985
8599 c01964fd7b8b QUIC: fixed dropping output ack ranges on input ack. Vladimir Homutov <vl@nginx.com> parents: 8598 diff changeset	2986 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	2987 "quic ngx_quic_ack_packet pn:%uL largest %L fr:%uL"
8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	2988 " nranges:%ui", pkt->pn, (int64_t) ctx->largest_range,
8599 c01964fd7b8b QUIC: fixed dropping output ack ranges on input ack. Vladimir Homutov <vl@nginx.com> parents: 8598 diff changeset	2989 ctx->first_range, ctx->nranges);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2990
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2991 prev_pending = ctx->pending_ack;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2992
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2993 if (pkt->need_ack) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2994
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	2995 ngx_post_event(&qc->push, &ngx_posted_events);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	2996
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	2997 if (ctx->send_ack == 0) {
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	2998 ctx->ack_delay_start = ngx_current_msec;
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	2999 }
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3000
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3001 ctx->send_ack++;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3002
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3003 if (ctx->pending_ack == NGX_QUIC_UNSET_PN
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3004 \|\| ctx->pending_ack < pkt->pn)
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3005 {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3006 ctx->pending_ack = pkt->pn;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3007 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3008 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3009
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3010 base = ctx->largest_range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3011 pn = pkt->pn;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3012
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3013 if (base == NGX_QUIC_UNSET_PN) {
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3014 ctx->largest_range = pn;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3015 ctx->largest_received = pkt->received;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3016 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3017 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3018
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3019 if (base == pn) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3020 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3021 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3022
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3023 largest = base;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3024 smallest = largest - ctx->first_range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3025
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3026 if (pn > base) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3027
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3028 if (pn - base == 1) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3029 ctx->first_range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3030 ctx->largest_range = pn;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3031 ctx->largest_received = pkt->received;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3032
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3033 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3034
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3035 } else {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3036 /* new gap in front of current largest */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3037
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3038 /* no place for new range, send current range as is */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3039 if (ctx->nranges == NGX_QUIC_MAX_RANGES) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3040
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3041 if (prev_pending != NGX_QUIC_UNSET_PN) {
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3042 if (ngx_quic_send_ack(c, ctx) != NGX_OK) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3043 return NGX_ERROR;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3044 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3045 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3046
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3047 if (prev_pending == ctx->pending_ack \|\| !pkt->need_ack) {
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3048 ctx->pending_ack = NGX_QUIC_UNSET_PN;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3049 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3050 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3051
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3052 gap = pn - base - 2;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3053 range = ctx->first_range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3054
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3055 ctx->first_range = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3056 ctx->largest_range = pn;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3057 ctx->largest_received = pkt->received;
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3058
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3059 /* packet is out of order, force send */
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3060 if (pkt->need_ack) {
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3061 ctx->send_ack = NGX_QUIC_MAX_ACK_GAP;
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3062 }
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3063
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3064 i = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3065
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3066 goto insert;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3067 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3068 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3069
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3070 /* pn < base, perform lookup in existing ranges */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3071
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3072 /* packet is out of order */
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3073 if (pkt->need_ack) {
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3074 ctx->send_ack = NGX_QUIC_MAX_ACK_GAP;
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3075 }
c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3076
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3077 if (pn >= smallest && pn <= largest) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3078 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3079 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3080
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3081 #if (NGX_SUPPRESS_WARN)
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3082 r = NULL;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3083 #endif
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3084
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3085 for (i = 0; i < ctx->nranges; i++) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3086 r = &ctx->ranges[i];
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3087
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3088 ge = smallest - 1;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3089 gs = ge - r->gap;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3090
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3091 if (pn >= gs && pn <= ge) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3092
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3093 if (gs == ge) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3094 /* gap size is exactly one packet, now filled */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3095
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3096 /* data moves to previous range, current is removed */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3097
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3098 if (i == 0) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3099 ctx->first_range += r->range + 2;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3100
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3101 } else {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3102 ctx->ranges[i - 1].range += r->range + 2;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3103 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3104
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3105 nr = ctx->nranges - i - 1;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3106 if (nr) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3107 ngx_memmove(&ctx->ranges[i], &ctx->ranges[i + 1],
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3108 sizeof(ngx_quic_ack_range_t) * nr);
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3109 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3110
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3111 ctx->nranges--;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3112
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3113 } else if (pn == gs) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3114 /* current gap shrinks from tail (current range grows) */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3115 r->gap--;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3116 r->range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3117
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3118 } else if (pn == ge) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3119 /* current gap shrinks from head (previous range grows) */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3120 r->gap--;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3121
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3122 if (i == 0) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3123 ctx->first_range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3124
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3125 } else {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3126 ctx->ranges[i - 1].range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3127 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3128
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3129 } else {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3130 /* current gap is split into two parts */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3131
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3132 gap = ge - pn - 1;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3133 range = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3134
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3135 if (ctx->nranges == NGX_QUIC_MAX_RANGES) {
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3136 if (prev_pending != NGX_QUIC_UNSET_PN) {
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3137 if (ngx_quic_send_ack(c, ctx) != NGX_OK) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3138 return NGX_ERROR;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3139 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3140 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3141
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3142 if (prev_pending == ctx->pending_ack \|\| !pkt->need_ack) {
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3143 ctx->pending_ack = NGX_QUIC_UNSET_PN;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3144 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3145 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3146
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3147 r->gap = pn - gs - 1;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3148 goto insert;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3149 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3150
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3151 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3152 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3153
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3154 largest = smallest - r->gap - 2;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3155 smallest = largest - r->range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3156
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3157 if (pn >= smallest && pn <= largest) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3158 /* this packet number is already known */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3159 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3160 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3161
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3162 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3163
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3164 if (pn == smallest - 1) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3165 /* extend first or last range */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3166
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3167 if (i == 0) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3168 ctx->first_range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3169
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3170 } else {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3171 r->range++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3172 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3173
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3174 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3175 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3176
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3177 /* nothing found, add new range at the tail */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3178
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3179 if (ctx->nranges == NGX_QUIC_MAX_RANGES) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3180 /* packet is too old to keep it */
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3181
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3182 if (pkt->need_ack) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3183 return ngx_quic_send_ack_range(c, ctx, pn, pn);
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3184 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3185
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3186 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3187 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3188
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3189 gap = smallest - 2 - pn;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3190 range = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3191
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3192 insert:
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3193
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3194 if (ctx->nranges < NGX_QUIC_MAX_RANGES) {
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3195 ctx->nranges++;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3196 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3197
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3198 ngx_memmove(&ctx->ranges[i + 1], &ctx->ranges[i],
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3199 sizeof(ngx_quic_ack_range_t) * (ctx->nranges - i - 1));
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3200
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3201 ctx->ranges[i].gap = gap;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3202 ctx->ranges[i].range = range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3203
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3204 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3205 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3206
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3207
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3208 static ngx_int_t
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3209 ngx_quic_send_ack_range(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3210 uint64_t smallest, uint64_t largest)
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	3211 {
c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	3212 ngx_quic_frame_t *frame;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3213
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3214 frame = ngx_quic_alloc_frame(c);
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	3215 if (frame == NULL) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3216 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3217 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3218
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3219 frame->level = ctx->level;
8367 c10e7d48aa85 Factored out sending ACK from payload handler. Sergey Kandaurov <pluknet@nginx.com> parents: 8365 diff changeset	3220 frame->type = NGX_QUIC_FT_ACK;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3221 frame->u.ack.largest = largest;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3222 frame->u.ack.delay = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3223 frame->u.ack.range_count = 0;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3224 frame->u.ack.first_range = largest - smallest;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3225
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3226 return NGX_OK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3227 }
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3228
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3229
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3230 static void
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3231 ngx_quic_drop_ack_ranges(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3232 uint64_t pn)
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3233 {
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3234 uint64_t base;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3235 ngx_uint_t i, smallest, largest;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3236 ngx_quic_ack_range_t *r;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3237
8599 c01964fd7b8b QUIC: fixed dropping output ack ranges on input ack. Vladimir Homutov <vl@nginx.com> parents: 8598 diff changeset	3238 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3239 "quic ngx_quic_drop_ack_ranges pn:%uL largest:%uL"
eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3240 " fr:%uL nranges:%ui", pn, ctx->largest_range,
8599 c01964fd7b8b QUIC: fixed dropping output ack ranges on input ack. Vladimir Homutov <vl@nginx.com> parents: 8598 diff changeset	3241 ctx->first_range, ctx->nranges);
c01964fd7b8b QUIC: fixed dropping output ack ranges on input ack. Vladimir Homutov <vl@nginx.com> parents: 8598 diff changeset	3242
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3243 base = ctx->largest_range;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3244
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3245 if (base == NGX_QUIC_UNSET_PN) {
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3246 return;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3247 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3248
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3249 if (ctx->pending_ack != NGX_QUIC_UNSET_PN && pn >= ctx->pending_ack) {
85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3250 ctx->pending_ack = NGX_QUIC_UNSET_PN;
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3251 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3252
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3253 largest = base;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3254 smallest = largest - ctx->first_range;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3255
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3256 if (pn >= largest) {
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3257 ctx->largest_range = NGX_QUIC_UNSET_PN;
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3258 ctx->first_range = 0;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3259 ctx->nranges = 0;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3260 return;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3261 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3262
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3263 if (pn >= smallest) {
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3264 ctx->first_range = largest - pn - 1;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3265 ctx->nranges = 0;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3266 return;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3267 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3268
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3269 for (i = 0; i < ctx->nranges; i++) {
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3270 r = &ctx->ranges[i];
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3271
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3272 largest = smallest - r->gap - 2;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3273 smallest = largest - r->range;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3274
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3275 if (pn >= largest) {
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3276 ctx->nranges = i;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3277 return;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3278 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3279 if (pn >= smallest) {
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3280 r->range = largest - pn - 1;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3281 ctx->nranges = i + 1;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3282 return;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3283 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3284 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3285 }
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3286
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3287
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3288 static ngx_int_t
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3289 ngx_quic_send_ack(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3290 {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3291 size_t len, left;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3292 uint64_t ack_delay;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3293 ngx_buf_t *b;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3294 ngx_uint_t i;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3295 ngx_chain_t cl, *ll;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3296 ngx_quic_frame_t *frame;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3297 ngx_quic_connection_t *qc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3298
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3299 qc = ngx_quic_get_connection(c);
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3300
8662 b9ac4752d0e6 QUIC: send and process ack_delay for Initial and Handshake levels. Roman Arutyunyan <arut@nginx.com> parents: 8661 diff changeset	3301 ack_delay = ngx_current_msec - ctx->largest_received;
b9ac4752d0e6 QUIC: send and process ack_delay for Initial and Handshake levels. Roman Arutyunyan <arut@nginx.com> parents: 8661 diff changeset	3302 ack_delay *= 1000;
8693 3956bbf91002 QUIC: use server ack_delay_exponent when sending ack. Roman Arutyunyan <arut@nginx.com> parents: 8692 diff changeset	3303 ack_delay >>= qc->tp.ack_delay_exponent;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3304
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3305 frame = ngx_quic_alloc_frame(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3306 if (frame == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3307 return NGX_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3308 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3309
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3310 ll = &frame->data;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3311 b = NULL;
8613 867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	3312
867c189f875d QUIC: unified range format for rx and tx ACK frames. Roman Arutyunyan <arut@nginx.com> parents: 8612 diff changeset	3313 for (i = 0; i < ctx->nranges; i++) {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3314 len = ngx_quic_create_ack_range(NULL, ctx->ranges[i].gap,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3315 ctx->ranges[i].range);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3316
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3317 left = b ? b->end - b->last : 0;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3318
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3319 if (left < len) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3320 cl = ngx_quic_alloc_buf(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3321 if (cl == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3322 return NGX_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3323 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3324
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3325 *ll = cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3326 ll = &cl->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3327
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3328 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3329 left = b->end - b->last;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3330
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3331 if (left < len) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3332 return NGX_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3333 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3334 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3335
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3336 b->last += ngx_quic_create_ack_range(b->last, ctx->ranges[i].gap,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3337 ctx->ranges[i].range);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3338
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3339 frame->u.ack.ranges_length += len;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3340 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3341
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3342 *ll = NULL;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3343
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3344 frame->level = ctx->level;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3345 frame->type = NGX_QUIC_FT_ACK;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3346 frame->u.ack.largest = ctx->largest_range;
8603 c5ea341f705a QUIC: optimized acknowledgement generation. Vladimir Homutov <vl@nginx.com> parents: 8602 diff changeset	3347 frame->u.ack.delay = ack_delay;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3348 frame->u.ack.range_count = ctx->nranges;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3349 frame->u.ack.first_range = ctx->first_range;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	3350
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3351 ngx_quic_queue_frame(qc, frame);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3352
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	3353 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3354 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3355
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3356
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3357 static ngx_int_t
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3358 ngx_quic_send_cc(ngx_connection_t *c)
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3359 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3360 ngx_quic_frame_t *frame;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3361 ngx_quic_connection_t *qc;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3362
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3363 qc = ngx_quic_get_connection(c);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3364
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3365 if (qc->draining) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3366 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3367 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3368
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3369 if (qc->closing
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3370 && ngx_current_msec - qc->last_cc < NGX_QUIC_CC_MIN_INTERVAL)
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3371 {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3372 /* dot not send CC too often */
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3373 return NGX_OK;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3374 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3375
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3376 frame = ngx_quic_alloc_frame(c);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3377 if (frame == NULL) {
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3378 return NGX_ERROR;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3379 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3380
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3381 frame->level = qc->error_level;
8692 0697294f79a4 QUIC: removed redundant "app" flag from ngx_quic_close_frame_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8688 diff changeset	3382 frame->type = qc->error_app ? NGX_QUIC_FT_CONNECTION_CLOSE_APP
0697294f79a4 QUIC: removed redundant "app" flag from ngx_quic_close_frame_t. Sergey Kandaurov <pluknet@nginx.com> parents: 8688 diff changeset	3383 : NGX_QUIC_FT_CONNECTION_CLOSE;
8458 e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3384 frame->u.close.error_code = qc->error;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3385 frame->u.close.frame_type = qc->error_ftype;
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3386
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3387 if (qc->error_reason) {
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3388 frame->u.close.reason.len = ngx_strlen(qc->error_reason);
e0f92f68e018 QUIC: Introduced ngx_quic_finalize_connection(). Roman Arutyunyan <arut@nginx.com> parents: 8450 diff changeset	3389 frame->u.close.reason.data = (u_char *) qc->error_reason;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	3390 }
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	3391
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3392 ngx_quic_queue_frame(qc, frame);
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3393
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3394 qc->last_cc = ngx_current_msec;
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3395
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3396 return ngx_quic_output(c);
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3397 }
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3398
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3399
ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	3400 static ngx_int_t
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3401 ngx_quic_send_new_token(ngx_connection_t *c)
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3402 {
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	3403 time_t expires;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3404 ngx_str_t token;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3405 ngx_quic_frame_t *frame;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3406 ngx_quic_connection_t *qc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3407
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3408 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3409
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3410 if (!qc->conf->retry) {
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3411 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3412 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3413
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	3414 expires = ngx_time() + NGX_QUIC_NEW_TOKEN_LIFETIME;
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	3415
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	3416 if (ngx_quic_new_token(c, qc->conf->av_token_key, &token, NULL, expires, 0)
8686 dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	3417 != NGX_OK)
dffb66fb783b QUIC: stateless retry. Vladimir Homutov <vl@nginx.com> parents: 8676 diff changeset	3418 {
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3419 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3420 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3421
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3422 frame = ngx_quic_alloc_frame(c);
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3423 if (frame == NULL) {
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3424 return NGX_ERROR;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3425 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3426
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3427 frame->level = ssl_encryption_application;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3428 frame->type = NGX_QUIC_FT_NEW_TOKEN;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3429 frame->u.token.length = token.len;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3430 frame->u.token.data = token.data;
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	3431
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3432 ngx_quic_queue_frame(qc, frame);
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3433
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3434 return NGX_OK;
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3435 }
52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3436
8450 a62849b6463c Style. Vladimir Homutov <vl@nginx.com> parents: 8447 diff changeset	3437
8384 52d0c4832570 Address validation using NEW_TOKEN frame. Sergey Kandaurov <pluknet@nginx.com> parents: 8383 diff changeset	3438 static ngx_int_t
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3439 ngx_quic_handle_ack_frame(ngx_connection_t c, ngx_quic_header_t pkt,
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3440 ngx_quic_frame_t *f)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3441 {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3442 ssize_t n;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3443 u_char pos, end;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3444 uint64_t min, max, gap, range;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3445 ngx_msec_t send_time;
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3446 ngx_uint_t i;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3447 ngx_quic_send_ctx_t *ctx;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3448 ngx_quic_ack_frame_t *ack;
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3449 ngx_quic_connection_t *qc;
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3450
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3451 qc = ngx_quic_get_connection(c);
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3452
9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3453 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3454
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3455 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3456 "quic ngx_quic_handle_ack_frame level:%d", pkt->level);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3457
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3458 ack = &f->u.ack;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3459
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3460 /*
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3461 * If any computed packet number is negative, an endpoint MUST
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3462 * generate a connection error of type FRAME_ENCODING_ERROR.
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3463 * (19.3.1)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3464 */
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3465
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3466 if (ack->first_range > ack->largest) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3467 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3468 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	3469 "quic invalid first range in ack frame");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3470 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3471 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3472
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3473 min = ack->largest - ack->first_range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3474 max = ack->largest;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3475
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3476 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3477 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3478 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3479 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3480 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3481
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3482 /* 13.2.3. Receiver Tracking of ACK Frames */
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	3483 if (ctx->largest_ack < max \|\| ctx->largest_ack == NGX_QUIC_UNSET_PN) {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3484 ctx->largest_ack = max;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3485 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3486 "quic updated largest received ack:%uL", max);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3487
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3488 /*
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3489 * An endpoint generates an RTT sample on receiving an
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3490 * ACK frame that meets the following two conditions:
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3491 *
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3492 * - the largest acknowledged packet number is newly acknowledged
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3493 * - at least one of the newly acknowledged packets was ack-eliciting.
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3494 */
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3495
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3496 if (send_time != NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3497 ngx_quic_rtt_sample(c, ack, pkt->level, send_time);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3498 }
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3499 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3500
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3501 if (f->data) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3502 pos = f->data->buf->pos;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3503 end = f->data->buf->last;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3504
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3505 } else {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3506 pos = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3507 end = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3508 }
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3509
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3510 for (i = 0; i < ack->range_count; i++) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3511
8604 b3d9e57d0f62 QUIC: single function for frame debug logging. Vladimir Homutov <vl@nginx.com> parents: 8603 diff changeset	3512 n = ngx_quic_parse_ack_range(pkt->log, pos, end, &gap, &range);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3513 if (n == NGX_ERROR) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3514 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3515 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3516 pos += n;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3517
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3518 if (gap + 2 > min) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3519 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3520 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3521 "quic invalid range:%ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3522 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3523 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3524
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3525 max = min - gap - 2;
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3526
69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3527 if (range > max) {
8471 9ed4c12ec948 QUIC: caching c->quic in the ngx_quic_handle_ack_frame() function. Vladimir Homutov <vl@nginx.com> parents: 8470 diff changeset	3528 qc->error = NGX_QUIC_ERR_FRAME_ENCODING_ERROR;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3529 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3530 "quic invalid range:%ui in ack frame", i);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3531 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3532 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3533
8502 69033a50c3ae QUIC: fixed ACK Ranges processing. Sergey Kandaurov <pluknet@nginx.com> parents: 8501 diff changeset	3534 min = max - range;
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3535
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3536 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max, &send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3537 != NGX_OK)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3538 {
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3539 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3540 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3541 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3542
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	3543 return ngx_quic_detect_lost(c);
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3544 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3545
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3546
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3547 static ngx_int_t
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3548 ngx_quic_handle_ack_frame_range(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3549 uint64_t min, uint64_t max, ngx_msec_t *send_time)
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3550 {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3551 ngx_uint_t found;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3552 ngx_queue_t *q;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3553 ngx_quic_frame_t *f;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3554 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3555
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3556 qc = ngx_quic_get_connection(c);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3557
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3558 *send_time = NGX_TIMER_INFINITE;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3559 found = 0;
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3560
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3561 q = ngx_queue_last(&ctx->sent);
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3562
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	3563 while (q != ngx_queue_sentinel(&ctx->sent)) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3564
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3565 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3566 q = ngx_queue_prev(q);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3567
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3568 if (f->pnum >= min && f->pnum <= max) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3569 ngx_quic_congestion_ack(c, f);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3570
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3571 switch (f->type) {
8600 06af25901b1a QUIC: restored proper usage of ngx_quic_drop_ack_ranges(). Sergey Kandaurov <pluknet@nginx.com> parents: 8599 diff changeset	3572 case NGX_QUIC_FT_ACK:
06af25901b1a QUIC: restored proper usage of ngx_quic_drop_ack_ranges(). Sergey Kandaurov <pluknet@nginx.com> parents: 8599 diff changeset	3573 case NGX_QUIC_FT_ACK_ECN:
06af25901b1a QUIC: restored proper usage of ngx_quic_drop_ack_ranges(). Sergey Kandaurov <pluknet@nginx.com> parents: 8599 diff changeset	3574 ngx_quic_drop_ack_ranges(c, ctx, f->u.ack.largest);
06af25901b1a QUIC: restored proper usage of ngx_quic_drop_ack_ranges(). Sergey Kandaurov <pluknet@nginx.com> parents: 8599 diff changeset	3575 break;
8597 0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3576
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3577 case NGX_QUIC_FT_STREAM0:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3578 case NGX_QUIC_FT_STREAM1:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3579 case NGX_QUIC_FT_STREAM2:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3580 case NGX_QUIC_FT_STREAM3:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3581 case NGX_QUIC_FT_STREAM4:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3582 case NGX_QUIC_FT_STREAM5:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3583 case NGX_QUIC_FT_STREAM6:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3584 case NGX_QUIC_FT_STREAM7:
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3585 ngx_quic_handle_stream_ack(c, f);
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3586 break;
0351fcf52a03 QUIC: drop acknowledged ranges. Vladimir Homutov <vl@nginx.com> parents: 8596 diff changeset	3587 }
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3588
8663 1823e2152fc4 QUIC: always calculate rtt for largest acknowledged packet. Roman Arutyunyan <arut@nginx.com> parents: 8662 diff changeset	3589 if (f->pnum == max) {
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3590 *send_time = f->last;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3591 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3592
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3593 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3594 ngx_quic_free_frame(c, f);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3595 found = 1;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3596 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3597 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3598
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3599 if (!found) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3600
8437 4e75267865de QUIC: fixed off-by-one in frame range handler. Vladimir Homutov <vl@nginx.com> parents: 8436 diff changeset	3601 if (max < ctx->pnum) {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3602 /* duplicate ACK or ACK for non-ack-eliciting frame */
8326 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 8325 diff changeset	3603 return NGX_OK;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3604 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3605
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3606 ngx_log_error(NGX_LOG_INFO, c->log, 0,
8401 d3aa54242c37 Style. Vladimir Homutov <vl@nginx.com> parents: 8400 diff changeset	3607 "quic ACK for the packet not sent");
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3608
fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3609 qc->error = NGX_QUIC_ERR_PROTOCOL_VIOLATION;
8399 ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	3610 qc->error_ftype = NGX_QUIC_FT_ACK;
ffd362e87eb2 Added more context to CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 8398 diff changeset	3611 qc->error_reason = "unknown packet number";
8385 fb7422074258 Added generation of CC frames with error on connection termination. Vladimir Homutov <vl@nginx.com> parents: 8384 diff changeset	3612
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3613 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3614 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	3615
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3616 if (!qc->push.timer_set) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3617 ngx_post_event(&qc->push, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3618 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3619
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3620 qc->pto_count = 0;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3621
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3622 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3623 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3624
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3625
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3626 static void
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3627 ngx_quic_rtt_sample(ngx_connection_t c, ngx_quic_ack_frame_t ack,
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3628 enum ssl_encryption_level_t level, ngx_msec_t send_time)
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3629 {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3630 ngx_msec_t latest_rtt, ack_delay, adjusted_rtt, rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3631 ngx_quic_connection_t *qc;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3632
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3633 qc = ngx_quic_get_connection(c);
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3634
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3635 latest_rtt = ngx_current_msec - send_time;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3636 qc->latest_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3637
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3638 if (qc->min_rtt == NGX_TIMER_INFINITE) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3639 qc->min_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3640 qc->avg_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3641 qc->rttvar = latest_rtt / 2;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3642
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3643 } else {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3644 qc->min_rtt = ngx_min(qc->min_rtt, latest_rtt);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3645
8662 b9ac4752d0e6 QUIC: send and process ack_delay for Initial and Handshake levels. Roman Arutyunyan <arut@nginx.com> parents: 8661 diff changeset	3646 ack_delay = ack->delay * (1 << qc->ctp.ack_delay_exponent) / 1000;
b9ac4752d0e6 QUIC: send and process ack_delay for Initial and Handshake levels. Roman Arutyunyan <arut@nginx.com> parents: 8661 diff changeset	3647
b9ac4752d0e6 QUIC: send and process ack_delay for Initial and Handshake levels. Roman Arutyunyan <arut@nginx.com> parents: 8661 diff changeset	3648 if (c->ssl->handshaked) {
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3649 ack_delay = ngx_min(ack_delay, qc->ctp.max_ack_delay);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3650 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3651
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3652 adjusted_rtt = latest_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3653
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3654 if (qc->min_rtt + ack_delay < latest_rtt) {
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3655 adjusted_rtt -= ack_delay;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3656 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3657
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3658 qc->avg_rtt = 0.875 * qc->avg_rtt + 0.125 * adjusted_rtt;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3659 rttvar_sample = ngx_abs((ngx_msec_int_t) (qc->avg_rtt - adjusted_rtt));
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3660 qc->rttvar = 0.75 * qc->rttvar + 0.25 * rttvar_sample;
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3661 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3662
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3663 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3664 "quic rtt sample latest:%M min:%M avg:%M var:%M",
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3665 latest_rtt, qc->min_rtt, qc->avg_rtt, qc->rttvar);
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3666 }
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3667
3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3668
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3669 static ngx_inline ngx_msec_t
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3670 ngx_quic_pto(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3671 {
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3672 ngx_msec_t duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3673 ngx_quic_connection_t *qc;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3674
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3675 qc = ngx_quic_get_connection(c);
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3676
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3677 /* PTO calculation: quic-recovery, Appendix 8 */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3678 duration = qc->avg_rtt;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3679
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3680 duration += ngx_max(4 * qc->rttvar, NGX_QUIC_TIME_GRANULARITY);
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3681 duration <<= qc->pto_count;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3682
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3683 if (qc->congestion.in_flight == 0) { /* no in-flight packets */
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3684 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3685 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3686
8661 49efd27dace6 QUIC: use client max_ack_delay when computing pto timeout. Roman Arutyunyan <arut@nginx.com> parents: 8660 diff changeset	3687 if (ctx->level == ssl_encryption_application && c->ssl->handshaked) {
49efd27dace6 QUIC: use client max_ack_delay when computing pto timeout. Roman Arutyunyan <arut@nginx.com> parents: 8660 diff changeset	3688 duration += qc->ctp.max_ack_delay << qc->pto_count;
8475 b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3689 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3690
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3691 return duration;
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3692 }
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3693
b276833111cf QUIC: implemented probe timeout (PTO) calculation. Vladimir Homutov <vl@nginx.com> parents: 8474 diff changeset	3694
8469 3b107aadc9f6 QUIC: added rtt estimation. Vladimir Homutov <vl@nginx.com> parents: 8458 diff changeset	3695 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3696 ngx_quic_handle_stream_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3697 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3698 uint64_t sent, unacked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3699 ngx_event_t *wev;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3700 ngx_quic_stream_t *sn;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3701 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3702
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3703 qc = ngx_quic_get_connection(c);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3704
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3705 sn = ngx_quic_find_stream(&qc->streams.tree, f->u.stream.stream_id);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3706 if (sn == NULL) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3707 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3708 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3709
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3710 wev = sn->c->write;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3711 sent = sn->c->sent;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3712 unacked = sent - sn->acked;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3713
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3714 if (unacked >= NGX_QUIC_STREAM_BUFSIZE && wev->active) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3715 wev->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3716 ngx_post_event(wev, &ngx_posted_events);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3717 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3718
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3719 sn->acked += f->u.stream.length;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3720
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3721 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, sn->c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3722 "quic stream ack len:%uL acked:%uL unacked:%uL",
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3723 f->u.stream.length, sn->acked, sent - sn->acked);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3724 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3725
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	3726
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3727 static ngx_int_t
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3728 ngx_quic_handle_ordered_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	3729 ngx_quic_frame_t frame, ngx_quic_frame_handler_pt handler, void data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3730 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3731 size_t full_len;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3732 ngx_int_t rc;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3733 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3734 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3735
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3736 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3737
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3738 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3739 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	3740 "quic out-of-order frame: expecting:%uL got:%uL",
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3741 fs->received, f->offset);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3742
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3743 return ngx_quic_buffer_frame(c, fs, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3744 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3745
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3746 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3747
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3748 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3749 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3750 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3751 /* old/duplicate data range */
8566 9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3752 return handler == ngx_quic_crypto_input ? NGX_DECLINED : NGX_OK;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3753 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3754
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3755 /* intersecting data range, frame modified */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3756 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3757
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3758 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3759
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	3760 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3761 if (rc == NGX_ERROR) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3762 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3763
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3764 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3765 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3766 return NGX_OK;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3767 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	3768
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3769 /* rc == NGX_OK */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3770
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3771 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3772
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3773 /* now check the queue if we can continue with buffered frames */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3774
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3775 do {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3776 q = ngx_queue_head(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3777 if (q == ngx_queue_sentinel(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3778 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3779 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3780
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3781 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3782 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3783
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3784 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3785 /* gap found, nothing more to do */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3786 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3787 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3788
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3789 full_len = f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3790
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3791 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3792
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3793 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3794 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3795 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3796 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3797 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3798 fs->total -= f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3799
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3800 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3801 "quic skipped buffered frame, total:%ui",
d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3802 fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3803 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3804 continue;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3805 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3806
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3807 /* frame was adjusted, proceed to input */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3808 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3809
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3810 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3811
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	3812 rc = handler(c, frame, data);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3813
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3814 if (rc == NGX_ERROR) {
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3815 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3816
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3817 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3818 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	3819 return NGX_OK;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3820 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3821
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3822 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3823 fs->total -= full_len;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3824
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3825 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3826
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3827 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3828 "quic consumed buffered frame, total:%ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3829
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3830 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3831
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3832 } while (1);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3833
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3834 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3835 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3836
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3837
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3838 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3839 ngx_quic_adjust_frame_offset(ngx_connection_t c, ngx_quic_frame_t frame,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3840 uint64_t offset_in)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3841 {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3842 size_t tail, n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3843 ngx_buf_t *b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3844 ngx_chain_t *cl;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3845 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3846
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3847 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3848
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3849 tail = offset_in - f->offset;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3850
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3851 if (tail >= f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3852 /* range preceeding already received data or duplicate, ignore */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3853
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3854 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3855 "quic old or duplicate data in ordered frame, ignored");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3856 return NGX_DONE;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3857 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3858
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3859 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3860 "quic adjusted ordered frame data start to expected offset");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3861
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3862 /* intersecting range: adjust data size */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3863
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3864 f->offset += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3865 f->length -= tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3866
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3867 for (cl = frame->data; cl; cl = cl->next) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3868 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3869 n = ngx_buf_size(b);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3870
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3871 if (n >= tail) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3872 b->pos += tail;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3873 break;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3874 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3875
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3876 cl->buf->pos = cl->buf->last;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3877 tail -= n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3878 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3879
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3880 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3881 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3882
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3883
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3884 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3885 ngx_quic_buffer_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3886 ngx_quic_frame_t *frame)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3887 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3888 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3889 ngx_quic_frame_t dst, item;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3890 ngx_quic_ordered_frame_t f, df;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3891
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3892 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	3893 "quic ngx_quic_buffer_frame");
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3894
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3895 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3896
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3897 /* frame start offset is in the future, buffer it */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3898
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3899 dst = ngx_quic_alloc_frame(c);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3900 if (dst == NULL) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3901 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3902 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3903
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3904 ngx_memcpy(dst, frame, sizeof(ngx_quic_frame_t));
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3905
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3906 dst->data = ngx_quic_copy_chain(c, frame->data, 0);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3907 if (dst->data == NGX_CHAIN_ERROR) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3908 return NGX_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3909 }
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3910
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3911 df = &dst->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3912
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3913 fs->total += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3914
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3915 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8702 d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3916 "quic ordered frame with unexpected offset:"
d4e02b3b734f QUIC: fixed indentation. Sergey Kandaurov <pluknet@nginx.com> parents: 8701 diff changeset	3917 " buffered total:%ui", fs->total);
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3918
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3919 if (ngx_queue_empty(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3920 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3921 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3922 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3923
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3924 for (q = ngx_queue_last(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3925 q != ngx_queue_sentinel(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3926 q = ngx_queue_prev(q))
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3927 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3928 item = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3929 f = &item->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3930
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3931 if (f->offset < df->offset) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3932 ngx_queue_insert_after(q, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3933 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3934 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3935 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3936
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3937 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3938
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3939 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3940 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3941
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3942
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3943 static ngx_int_t
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3944 ngx_quic_handle_crypto_frame(ngx_connection_t c, ngx_quic_header_t pkt,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3945 ngx_quic_frame_t *frame)
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3946 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3947 uint64_t last;
8566 9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3948 ngx_int_t rc;
8573 6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3949 ngx_quic_send_ctx_t *ctx;
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3950 ngx_quic_connection_t *qc;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3951 ngx_quic_crypto_frame_t *f;
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3952 ngx_quic_frames_stream_t *fs;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3953
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3954 qc = ngx_quic_get_connection(c);
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3955 fs = &qc->crypto[pkt->level];
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3956 f = &frame->u.crypto;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3957
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3958 /* no overflow since both values are 62-bit */
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3959 last = f->offset + f->length;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3960
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3961 if (last > fs->received && last - fs->received > NGX_QUIC_MAX_BUFFERED) {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	3962 qc->error = NGX_QUIC_ERR_CRYPTO_BUFFER_EXCEEDED;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3963 return NGX_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	3964 }
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3965
8566 9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3966 rc = ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_crypto_input,
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3967 NULL);
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3968 if (rc != NGX_DECLINED) {
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3969 return rc;
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3970 }
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3971
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3972 /* speeding up handshake completion */
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3973
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3974 if (pkt->level == ssl_encryption_initial) {
8573 6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3975 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3976
6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3977 if (!ngx_queue_empty(&ctx->sent)) {
6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3978 ngx_quic_resend_frames(c, ctx);
8660 6201cef77b1d QUIC: resend handshake packets along with initial. Roman Arutyunyan <arut@nginx.com> parents: 8659 diff changeset	3979
6201cef77b1d QUIC: resend handshake packets along with initial. Roman Arutyunyan <arut@nginx.com> parents: 8659 diff changeset	3980 ctx = ngx_quic_get_send_ctx(qc, ssl_encryption_handshake);
6201cef77b1d QUIC: resend handshake packets along with initial. Roman Arutyunyan <arut@nginx.com> parents: 8659 diff changeset	3981 while (!ngx_queue_empty(&ctx->sent)) {
6201cef77b1d QUIC: resend handshake packets along with initial. Roman Arutyunyan <arut@nginx.com> parents: 8659 diff changeset	3982 ngx_quic_resend_frames(c, ctx);
6201cef77b1d QUIC: resend handshake packets along with initial. Roman Arutyunyan <arut@nginx.com> parents: 8659 diff changeset	3983 }
8573 6226f834b420 QUIC: do not resend empty queue when speeding up handshake. Sergey Kandaurov <pluknet@nginx.com> parents: 8572 diff changeset	3984 }
8566 9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3985 }
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3986
9588a2782c62 QUIC: speeding up handshake completion. Sergey Kandaurov <pluknet@nginx.com> parents: 8565 diff changeset	3987 return NGX_OK;
8335 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3988 }
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3989
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3990
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 8334 diff changeset	3991 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	3992 ngx_quic_crypto_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3993 {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3994 int n, sslerr;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3995 ngx_buf_t *b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3996 ngx_chain_t *cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3997 ngx_ssl_conn_t *ssl_conn;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	3998 ngx_quic_connection_t *qc;
8333 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 8332 diff changeset	3999
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4000 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4001
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4002 ssl_conn = c->ssl->connection;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4003
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4004 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	4005 "quic SSL_quic_read_level:%d SSL_quic_write_level:%d",
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4006 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4007 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4008
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4009 for (cl = frame->data; cl; cl = cl->next) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4010 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4011
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4012 if (!SSL_provide_quic_data(ssl_conn, SSL_quic_read_level(ssl_conn),
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4013 b->pos, b->last - b->pos))
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4014 {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4015 ngx_ssl_error(NGX_LOG_INFO, c->log, 0,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4016 "SSL_provide_quic_data() failed");
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4017 return NGX_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4018 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4019 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4020
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4021 n = SSL_do_handshake(ssl_conn);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4022
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4023 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4024 "quic SSL_quic_read_level:%d SSL_quic_write_level:%d",
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4025 (int) SSL_quic_read_level(ssl_conn),
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4026 (int) SSL_quic_write_level(ssl_conn));
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4027
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4028 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_do_handshake: %d", n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4029
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4030 if (n <= 0) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4031 sslerr = SSL_get_error(ssl_conn, n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4032
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4033 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_get_error: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4034 sslerr);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4035
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	4036 if (sslerr != SSL_ERROR_WANT_READ) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4037 ngx_ssl_error(NGX_LOG_ERR, c->log, 0, "SSL_do_handshake() failed");
8300 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 8299 diff changeset	4038 return NGX_ERROR;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4039 }
8263 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 8260 diff changeset	4040
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4041 return NGX_OK;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4042 }
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4043
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4044 if (SSL_in_init(ssl_conn)) {
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4045 return NGX_OK;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4046 }
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4047
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4048 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4049 "quic ssl cipher:%s", SSL_get_cipher(ssl_conn));
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4050
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4051 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4052 "quic handshake completed successfully");
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4053
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4054 c->ssl->handshaked = 1;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4055
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4056 frame = ngx_quic_alloc_frame(c);
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4057 if (frame == NULL) {
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4058 return NGX_ERROR;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4059 }
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4060
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4061 /* 12.4 Frames and frame types, figure 8 */
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4062 frame->level = ssl_encryption_application;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4063 frame->type = NGX_QUIC_FT_HANDSHAKE_DONE;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4064 ngx_quic_queue_frame(qc, frame);
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4065
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4066 if (ngx_quic_send_new_token(c) != NGX_OK) {
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4067 return NGX_ERROR;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4068 }
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4069
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4070 /*
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4071 * Generating next keys before a key update is received.
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4072 * See quic-tls 9.4 Header Protection Timing Side-Channels.
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4073 */
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4074
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4075 if (ngx_quic_keys_update(c, qc->keys) != NGX_OK) {
8620 d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4076 return NGX_ERROR;
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4077 }
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4078
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4079 /*
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4080 * 4.10.2 An endpoint MUST discard its handshake keys
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4081 * when the TLS handshake is confirmed
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4082 */
d10118e38943 QUIC: refactored SSL_do_handshake() handling. Sergey Kandaurov <pluknet@nginx.com> parents: 8619 diff changeset	4083 ngx_quic_discard_ctx(c, ssl_encryption_handshake);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4084
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4085 if (ngx_quic_issue_server_ids(c) != NGX_OK) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4086 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4087 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4088
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4089 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4090 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4091
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4092
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4093 static ngx_int_t
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4094 ngx_quic_handle_stream_frame(ngx_connection_t c, ngx_quic_header_t pkt,
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4095 ngx_quic_frame_t *frame)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4096 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4097 size_t window;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4098 uint64_t last;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4099 ngx_buf_t *b;
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4100 ngx_pool_t *pool;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4101 ngx_connection_t *sc;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4102 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4103 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4104 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4105 ngx_quic_frames_stream_t *fs;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4106
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4107 qc = ngx_quic_get_connection(c);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4108 f = &frame->u.stream;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4109
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4110 if ((f->stream_id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4111 && (f->stream_id & NGX_QUIC_STREAM_SERVER_INITIATED))
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4112 {
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4113 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4114 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4115 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4116
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4117 /* no overflow since both values are 62-bit */
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4118 last = f->offset + f->length;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4119
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4120 sn = ngx_quic_find_stream(&qc->streams.tree, f->stream_id);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4121
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4122 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4123 sn = ngx_quic_create_client_stream(c, f->stream_id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4124
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4125 if (sn == NULL) {
8427 d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4126 return NGX_ERROR;
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4127 }
d437ee1ce81e Reject invalid STREAM ID with STREAM_STATE_ERROR connection error. Sergey Kandaurov <pluknet@nginx.com> parents: 8424 diff changeset	4128
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4129 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4130 return NGX_OK;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	4131 }
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4132
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4133 sc = sn->c;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4134 fs = &sn->fs;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4135 b = sn->b;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4136 window = b->end - b->last;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4137
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4138 if (last > window) {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4139 qc->error = NGX_QUIC_ERR_FLOW_CONTROL_ERROR;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4140 goto cleanup;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4141 }
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4142
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4143 if (ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4144 sn)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4145 != NGX_OK)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4146 {
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4147 goto cleanup;
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4148 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4149
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4150 sc->listening->handler(sc);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4151
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4152 return NGX_OK;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4153 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4154
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4155 fs = &sn->fs;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4156 b = sn->b;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4157 window = (b->pos - b->start) + (b->end - b->last);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4158
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4159 if (last > fs->received && last - fs->received > window) {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4160 qc->error = NGX_QUIC_ERR_FLOW_CONTROL_ERROR;
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4161 return NGX_ERROR;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4162 }
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4163
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	4164 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input,
81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	4165 sn);
8530 f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4166
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4167 cleanup:
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4168
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4169 pool = sc->pool;
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4170
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4171 ngx_close_connection(sc);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4172 ngx_destroy_pool(pool);
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4173
f882b1784f30 QUIC: enforce flow control on incoming STREAM and CRYPTO frames. Roman Arutyunyan <arut@nginx.com> parents: 8528 diff changeset	4174 return NGX_ERROR;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4175 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4176
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4177
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4178 static ngx_int_t
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	4179 ngx_quic_stream_input(ngx_connection_t c, ngx_quic_frame_t frame, void *data)
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4180 {
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	4181 uint64_t id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4182 ngx_buf_t *b;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4183 ngx_event_t *rev;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4184 ngx_chain_t *cl;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4185 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4186 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4187 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4188
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4189 qc = ngx_quic_get_connection(c);
8378 81a4f98a2556 Cleaned up reordering code. Vladimir Homutov <vl@nginx.com> parents: 8377 diff changeset	4190 sn = data;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4191
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4192 f = &frame->u.stream;
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	4193 id = f->stream_id;
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4194
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4195 b = sn->b;
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4196
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4197 if ((size_t) ((b->pos - b->start) + (b->end - b->last)) < f->length) {
8361 336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	4198 ngx_log_error(NGX_LOG_INFO, c->log, 0,
336d527ca031 Error messages cleanup. Vladimir Homutov <vl@nginx.com> parents: 8360 diff changeset	4199 "quic no space in stream buffer");
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4200 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4201 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4202
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4203 if ((size_t) (b->end - b->last) < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4204 b->last = ngx_movemem(b->start, b->pos, b->last - b->pos);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4205 b->pos = b->start;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4206 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4207
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4208 for (cl = frame->data; cl; cl = cl->next) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4209 b->last = ngx_cpymem(b->last, cl->buf->pos,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4210 cl->buf->last - cl->buf->pos);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4211 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4212
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4213 rev = sn->c->read;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4214 rev->ready = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4215
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4216 if (f->fin) {
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4217 rev->pending_eof = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	4218 }
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4219
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4220 if (rev->active) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4221 rev->handler(rev);
8314 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	4222 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 8312 diff changeset	4223
8337 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 8336 diff changeset	4224 /* check if stream was destroyed by handler */
8501 fc16e303003a QUIC: fixed possible use-after-free on stream cleanup. Sergey Kandaurov <pluknet@nginx.com> parents: 8500 diff changeset	4225 if (ngx_quic_find_stream(&qc->streams.tree, id) == NULL) {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4226 return NGX_DONE;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4227 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	4228
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4229 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4230 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4231
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4232
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4233 static ngx_int_t
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4234 ngx_quic_handle_max_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4235 ngx_quic_max_data_frame_t *f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4236 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4237 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4238 ngx_rbtree_t *tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4239 ngx_rbtree_node_t *node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4240 ngx_quic_stream_t *qs;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4241 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4242
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4243 qc = ngx_quic_get_connection(c);
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4244 tree = &qc->streams.tree;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4245
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4246 if (f->max_data <= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4247 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4248 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4249
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4250 if (qc->streams.sent >= qc->streams.send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4251
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4252 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4253 node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4254 node = ngx_rbtree_next(tree, node))
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4255 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4256 qs = (ngx_quic_stream_t *) node;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4257 wev = qs->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4258
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4259 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4260 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4261 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4262 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4263 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4264 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4265
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4266 qc->streams.send_max_data = f->max_data;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4267
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4268 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4269 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4270
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4271
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4272 static ngx_int_t
8245 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4273 ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4274 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4275 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4276 return NGX_OK;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4277 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4278
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 8241 diff changeset	4279
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4280 static ngx_int_t
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4281 ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4282 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4283 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4284 size_t n;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4285 ngx_buf_t *b;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4286 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4287 ngx_quic_stream_t *sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	4288 ngx_quic_connection_t *qc;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4289
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4290 qc = ngx_quic_get_connection(c);
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4291
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4292 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4293 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4294 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4295 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4296 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4297 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4298
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4299 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4300
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4301 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4302 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4303
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4304 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4305 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4306 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4307
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4308 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4309 return NGX_OK;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4310 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4311
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4312 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4313 n = b->end - b->last;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4314
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4315 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4316
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4317 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4318 b = sn->b;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4319 n = sn->fs.received + (b->pos - b->start) + (b->end - b->last);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4320 }
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4321
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4322 frame = ngx_quic_alloc_frame(c);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4323 if (frame == NULL) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4324 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4325 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4326
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4327 frame->level = pkt->level;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4328 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4329 frame->u.max_stream_data.id = f->id;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4330 frame->u.max_stream_data.limit = n;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4331
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4332 ngx_quic_queue_frame(qc, frame);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4333
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4334 return NGX_OK;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4335 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4336
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	4337
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4338 static ngx_int_t
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4339 ngx_quic_handle_max_stream_data_frame(ngx_connection_t *c,
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4340 ngx_quic_header_t pkt, ngx_quic_max_stream_data_frame_t f)
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4341 {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4342 uint64_t sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4343 ngx_event_t *wev;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4344 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4345 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4346
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4347 qc = ngx_quic_get_connection(c);
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4348
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4349 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4350 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4351 {
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4352 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4353 return NGX_ERROR;
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4354 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4355
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4356 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4357
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4358 if (sn == NULL) {
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4359 sn = ngx_quic_create_client_stream(c, f->id);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4360
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4361 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4362 return NGX_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4363 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4364
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4365 if (sn == NGX_QUIC_STREAM_GONE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4366 return NGX_OK;
8429 8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4367 }
8fc9fcf18608 Stream ID handling in MAX_STREAM_DATA and STREAM_DATA_BLOCKED. Sergey Kandaurov <pluknet@nginx.com> parents: 8428 diff changeset	4368
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4369 if (f->limit > sn->send_max_data) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4370 sn->send_max_data = f->limit;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4371 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4372
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4373 sn->c->listening->handler(sn->c);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4374
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	4375 return NGX_OK;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4376 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4377
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4378 if (f->limit <= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4379 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4380 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4381
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4382 sent = sn->c->sent;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4383
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4384 if (sent >= sn->send_max_data) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4385 wev = sn->c->write;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4386
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4387 if (wev->active) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4388 wev->ready = 1;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4389 ngx_post_event(wev, &ngx_posted_events);
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4390 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4391 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4392
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4393 sn->send_max_data = f->limit;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4394
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4395 return NGX_OK;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4396 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4397
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	4398
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4399 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4400 ngx_quic_handle_reset_stream_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4401 ngx_quic_header_t pkt, ngx_quic_reset_stream_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4402 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4403 ngx_event_t *rev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4404 ngx_connection_t *sc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4405 ngx_quic_stream_t *sn;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4406 ngx_quic_connection_t *qc;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4407
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4408 qc = ngx_quic_get_connection(c);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4409
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4410 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4411 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED))
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4412 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4413 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4414 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4415 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4416
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4417 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4418
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4419 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4420 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4421
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4422 if (sn == NULL) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4423 return NGX_ERROR;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4424 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4425
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4426 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4427 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4428 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4429
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4430 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4431
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4432 rev = sc->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4433 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4434 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4435
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4436 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4437
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4438 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4439 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4440
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4441 rev = sn->c->read;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4442 rev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4443 rev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4444
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4445 if (rev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4446 rev->handler(rev);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4447 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4448
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4449 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4450 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4451
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4452
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4453 static ngx_int_t
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4454 ngx_quic_handle_stop_sending_frame(ngx_connection_t *c,
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4455 ngx_quic_header_t pkt, ngx_quic_stop_sending_frame_t f)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4456 {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4457 ngx_event_t *wev;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4458 ngx_connection_t *sc;
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4459 ngx_quic_stream_t *sn;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4460 ngx_quic_connection_t *qc;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4461
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4462 qc = ngx_quic_get_connection(c);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4463
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4464 if ((f->id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4465 && (f->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0)
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4466 {
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4467 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4468 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4469 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4470
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4471 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4472
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4473 if (sn == NULL) {
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4474 sn = ngx_quic_create_client_stream(c, f->id);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4475
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4476 if (sn == NULL) {
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4477 return NGX_ERROR;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4478 }
8505 240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4479
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4480 if (sn == NGX_QUIC_STREAM_GONE) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4481 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4482 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4483
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4484 sc = sn->c;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4485
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4486 wev = sc->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4487 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4488 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4489
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4490 sc->listening->handler(sc);
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4491
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4492 return NGX_OK;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4493 }
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4494
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4495 wev = sn->c->write;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4496 wev->error = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4497 wev->ready = 1;
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4498
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4499 if (wev->active) {
240931629995 QUIC: handle client RESET_STREAM and STOP_SENDING. Roman Arutyunyan <arut@nginx.com> parents: 8504 diff changeset	4500 wev->handler(wev);
8428 953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4501 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4502
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4503 return NGX_OK;
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4504 }
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4505
953cf44708b0 Stream ID handling in RESET_STREAM and STOP_SENDING frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8427 diff changeset	4506
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4507 static ngx_int_t
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4508 ngx_quic_handle_max_streams_frame(ngx_connection_t *c,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4509 ngx_quic_header_t pkt, ngx_quic_max_streams_frame_t f)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4510 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4511 ngx_quic_connection_t *qc;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4512
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4513 qc = ngx_quic_get_connection(c);
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4514
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4515 if (f->bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4516 if (qc->streams.server_max_streams_bidi < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4517 qc->streams.server_max_streams_bidi = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4518
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4519 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4520 "quic max_streams_bidi:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4521 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4522
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4523 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4524 if (qc->streams.server_max_streams_uni < f->limit) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4525 qc->streams.server_max_streams_uni = f->limit;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4526
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4527 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4528 "quic max_streams_uni:%uL", f->limit);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4529 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4530 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4531
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4532 return NGX_OK;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4533 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4534
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	4535
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4536 static ngx_int_t
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4537 ngx_quic_handle_path_challenge_frame(ngx_connection_t *c,
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4538 ngx_quic_header_t pkt, ngx_quic_path_challenge_frame_t f)
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4539 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4540 ngx_quic_frame_t *frame;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4541 ngx_quic_connection_t *qc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4542
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4543 qc = ngx_quic_get_connection(c);
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4544
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4545 frame = ngx_quic_alloc_frame(c);
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4546 if (frame == NULL) {
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4547 return NGX_ERROR;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4548 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4549
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4550 frame->level = pkt->level;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4551 frame->type = NGX_QUIC_FT_PATH_RESPONSE;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4552 frame->u.path_response = *f;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4553
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4554 ngx_quic_queue_frame(qc, frame);
8531 4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4555
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4556 return NGX_OK;
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4557 }
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4558
4ff2a0b747d1 QUIC: handle PATH_CHALLENGE frame. Roman Arutyunyan <arut@nginx.com> parents: 8530 diff changeset	4559
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4560 static ngx_int_t
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4561 ngx_quic_handle_new_connection_id_frame(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4562 ngx_quic_header_t pkt, ngx_quic_new_conn_id_frame_t f)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4563 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4564 ngx_queue_t *q;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4565 ngx_quic_client_id_t cid, item;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4566 ngx_quic_connection_t *qc;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4567
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4568 qc = ngx_quic_get_connection(c);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4569
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4570 if (f->seqnum < qc->max_retired_seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4571 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4572 * An endpoint that receives a NEW_CONNECTION_ID frame with
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4573 * a sequence number smaller than the Retire Prior To field
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4574 * of a previously received NEW_CONNECTION_ID frame MUST send
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4575 * a corresponding RETIRE_CONNECTION_ID frame that retires
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4576 * the newly received connection ID, unless it has already
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4577 * done so for that sequence number.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4578 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4579
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4580 if (ngx_quic_retire_connection_id(c, pkt->level, f->seqnum) != NGX_OK) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4581 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4582 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4583
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4584 goto retire;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4585 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4586
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4587 cid = NULL;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4588
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4589 for (q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4590 q != ngx_queue_sentinel(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4591 q = ngx_queue_next(q))
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4592 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4593 item = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4594
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4595 if (item->seqnum == f->seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4596 cid = item;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4597 break;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4598 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4599 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4600
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4601 if (cid) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4602 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4603 * Transmission errors, timeouts and retransmissions might cause the
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4604 * same NEW_CONNECTION_ID frame to be received multiple times
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4605 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4606
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4607 if (cid->len != f->len
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4608 \|\| ngx_strncmp(cid->id, f->cid, f->len) != 0
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	4609 \|\| ngx_strncmp(cid->sr_token, f->srt, NGX_QUIC_SR_TOKEN_LEN) != 0)
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4610 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4611 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4612 * ..a sequence number is used for different connection IDs,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4613 * the endpoint MAY treat that receipt as a connection error
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4614 * of type PROTOCOL_VIOLATION.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4615 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4616 qc->error = NGX_QUIC_ERR_PROTOCOL_VIOLATION;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4617 qc->error_reason = "seqnum refers to different connection id/token";
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4618 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4619 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4620
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4621 } else {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4622
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	4623 cid = ngx_quic_alloc_client_id(c, qc);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4624 if (cid == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4625 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4626 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4627
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4628 cid->seqnum = f->seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4629 cid->len = f->len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4630 ngx_memcpy(cid->id, f->cid, f->len);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4631
8562 b31c02454539 QUIC: added stateless reset support. Vladimir Homutov <vl@nginx.com> parents: 8561 diff changeset	4632 ngx_memcpy(cid->sr_token, f->srt, NGX_QUIC_SR_TOKEN_LEN);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4633
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4634 ngx_queue_insert_tail(&qc->client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4635 qc->nclient_ids++;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4636
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4637 /* always use latest available connection id */
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	4638 if (f->seqnum > qc->client_seqnum) {
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4639 qc->scid.len = cid->len;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4640 qc->scid.data = cid->id;
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	4641 qc->client_seqnum = f->seqnum;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4642 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4643 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4644
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4645 retire:
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4646
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4647 if (qc->max_retired_seqnum && f->retire <= qc->max_retired_seqnum) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4648 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4649 * Once a sender indicates a Retire Prior To value, smaller values sent
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4650 * in subsequent NEW_CONNECTION_ID frames have no effect. A receiver
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4651 * MUST ignore any Retire Prior To fields that do not increase the
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4652 * largest received Retire Prior To value.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4653 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4654 goto done;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4655 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4656
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4657 qc->max_retired_seqnum = f->retire;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4658
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4659 q = ngx_queue_head(&qc->client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4660
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4661 while (q != ngx_queue_sentinel(&qc->client_ids)) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4662
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4663 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4664 q = ngx_queue_next(q);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4665
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4666 if (cid->seqnum >= f->retire) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4667 continue;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4668 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4669
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4670 /* this connection id must be retired */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4671
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4672 if (ngx_quic_retire_connection_id(c, pkt->level, cid->seqnum)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4673 != NGX_OK)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4674 {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4675 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4676 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4677
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4678 ngx_queue_remove(&cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4679 ngx_queue_insert_head(&qc->free_client_ids, &cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4680 qc->nclient_ids--;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4681 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4682
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4683 done:
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4684
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4685 if (qc->nclient_ids > qc->tp.active_connection_id_limit) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4686 /*
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4687 * After processing a NEW_CONNECTION_ID frame and
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4688 * adding and retiring active connection IDs, if the number of active
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4689 * connection IDs exceeds the value advertised in its
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4690 * active_connection_id_limit transport parameter, an endpoint MUST
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4691 * close the connection with an error of type CONNECTION_ID_LIMIT_ERROR.
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4692 */
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4693 qc->error = NGX_QUIC_ERR_CONNECTION_ID_LIMIT_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4694 qc->error_reason = "too many connection ids received";
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4695 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4696 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4697
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4698 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4699 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4700
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4701
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4702 static ngx_int_t
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4703 ngx_quic_retire_connection_id(ngx_connection_t *c,
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4704 enum ssl_encryption_level_t level, uint64_t seqnum)
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4705 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4706 ngx_quic_frame_t *frame;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4707 ngx_quic_connection_t *qc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4708
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4709 qc = ngx_quic_get_connection(c);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4710
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4711 frame = ngx_quic_alloc_frame(c);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4712 if (frame == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4713 return NGX_ERROR;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4714 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4715
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4716 frame->level = level;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4717 frame->type = NGX_QUIC_FT_RETIRE_CONNECTION_ID;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4718 frame->u.retire_cid.sequence_number = seqnum;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4719
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4720 ngx_quic_queue_frame(qc, frame);
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4721
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4722 return NGX_OK;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4723 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4724
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4725
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4726 static ngx_int_t
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4727 ngx_quic_handle_retire_connection_id_frame(ngx_connection_t *c,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4728 ngx_quic_header_t pkt, ngx_quic_retire_cid_frame_t f)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4729 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4730 ngx_queue_t *q;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4731 ngx_quic_server_id_t *sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4732 ngx_quic_connection_t *qc;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4733
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4734 qc = ngx_quic_get_connection(c);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4735
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4736 for (q = ngx_queue_head(&qc->server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4737 q != ngx_queue_sentinel(&qc->server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4738 q = ngx_queue_next(q))
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4739 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4740 sid = ngx_queue_data(q, ngx_quic_server_id_t, queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4741
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4742 if (sid->seqnum == f->sequence_number) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4743 ngx_queue_remove(q);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4744 ngx_queue_insert_tail(&qc->free_server_ids, &sid->queue);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4745 ngx_rbtree_delete(&c->listening->rbtree, &sid->udp.node);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4746 qc->nserver_ids--;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4747 break;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4748 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4749 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4750
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4751 return ngx_quic_issue_server_ids(c);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4752 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4753
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4754
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4755 static ngx_int_t
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4756 ngx_quic_issue_server_ids(ngx_connection_t *c)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4757 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4758 ngx_str_t dcid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4759 ngx_uint_t n;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4760 ngx_quic_frame_t *frame;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4761 ngx_quic_server_id_t *sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4762 ngx_quic_connection_t *qc;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4763 u_char id[NGX_QUIC_SERVER_CID_LEN];
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4764
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4765 qc = ngx_quic_get_connection(c);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4766
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4767 n = ngx_min(NGX_QUIC_MAX_SERVER_IDS, qc->ctp.active_connection_id_limit);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4768
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4769 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4770 "quic issue server ids has:%ui max:%ui", qc->nserver_ids, n);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4771
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4772 while (qc->nserver_ids < n) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4773 if (ngx_quic_create_server_id(c, id) != NGX_OK) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4774 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4775 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4776
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4777 dcid.len = NGX_QUIC_SERVER_CID_LEN;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4778 dcid.data = id;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4779
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4780 sid = ngx_quic_insert_server_id(c, &dcid);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4781 if (sid == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4782 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4783 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4784
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	4785 frame = ngx_quic_alloc_frame(c);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4786 if (frame == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4787 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4788 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4789
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4790 frame->level = ssl_encryption_application;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4791 frame->type = NGX_QUIC_FT_NEW_CONNECTION_ID;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4792 frame->u.ncid.seqnum = sid->seqnum;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4793 frame->u.ncid.retire = 0;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4794 frame->u.ncid.len = NGX_QUIC_SERVER_CID_LEN;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4795 ngx_memcpy(frame->u.ncid.cid, id, NGX_QUIC_SERVER_CID_LEN);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4796
8694 cef042935003 QUIC: the "quic_host_key" directive. Vladimir Homutov <vl@nginx.com> parents: 8693 diff changeset	4797 if (ngx_quic_new_sr_token(c, &dcid, qc->conf->sr_token_key,
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4798 frame->u.ncid.srt)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4799 != NGX_OK)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4800 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4801 return NGX_ERROR;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4802 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4803
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4804 ngx_quic_queue_frame(qc, frame);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4805 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4806
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4807 return NGX_OK;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4808 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4809
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4810
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4811 static void
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4812 ngx_quic_clear_temp_server_ids(ngx_connection_t *c)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4813 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4814 ngx_queue_t q, next;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4815 ngx_quic_server_id_t *sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4816 ngx_quic_connection_t *qc;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4817
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4818 qc = ngx_quic_get_connection(c);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4819
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4820 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4821 "quic clear temp server ids");
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4822
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4823 for (q = ngx_queue_head(&qc->server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4824 q != ngx_queue_sentinel(&qc->server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4825 q = next)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4826 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4827 next = ngx_queue_next(q);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4828 sid = ngx_queue_data(q, ngx_quic_server_id_t, queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4829
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4830 if (sid->seqnum != NGX_QUIC_UNSET_PN) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4831 continue;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4832 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4833
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4834 ngx_queue_remove(q);
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4835 ngx_queue_insert_tail(&qc->free_server_ids, &sid->queue);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4836 ngx_rbtree_delete(&c->listening->rbtree, &sid->udp.node);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4837 qc->nserver_ids--;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4838 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4839 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4840
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4841
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4842 static ngx_quic_server_id_t *
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4843 ngx_quic_insert_server_id(ngx_connection_t c, ngx_str_t id)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4844 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4845 ngx_str_t dcid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4846 ngx_quic_server_id_t *sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4847 ngx_quic_connection_t *qc;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4848
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4849 qc = ngx_quic_get_connection(c);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4850
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4851 sid = ngx_quic_alloc_server_id(c, qc);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4852 if (sid == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4853 return NULL;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4854 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4855
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4856 sid->seqnum = qc->server_seqnum;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4857
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4858 if (qc->server_seqnum != NGX_QUIC_UNSET_PN) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4859 qc->server_seqnum++;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4860 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4861
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4862 sid->len = id->len;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4863 ngx_memcpy(sid->id, id->data, id->len);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4864
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4865 ngx_queue_insert_tail(&qc->server_ids, &sid->queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4866 qc->nserver_ids++;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4867
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4868 dcid.data = sid->id;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4869 dcid.len = sid->len;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4870
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4871 ngx_insert_udp_connection(c, &sid->udp, &dcid);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4872
8651 dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	4873 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	4874 "quic insert server id seqnum:%uL id len:%uz %xV",
dbad2d6d1898 QUIC: removed ngx_quic_hexdump() macro. Vladimir Homutov <vl@nginx.com> parents: 8642 diff changeset	4875 sid->seqnum, id->len, id);
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4876
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4877 return sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4878 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4879
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4880
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4881 static ngx_quic_client_id_t *
8627 405b6e8eb523 QUIC: renamed field and function related to client ids. Roman Arutyunyan <arut@nginx.com> parents: 8626 diff changeset	4882 ngx_quic_alloc_client_id(ngx_connection_t c, ngx_quic_connection_t qc)
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4883 {
8561 b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	4884 ngx_queue_t *q;
b4ef79ef1c23 QUIC: refined the "c->quic->initialized" flag usage. Vladimir Homutov <vl@nginx.com> parents: 8560 diff changeset	4885 ngx_quic_client_id_t *cid;
8538 3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4886
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4887 if (!ngx_queue_empty(&qc->free_client_ids)) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4888
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4889 q = ngx_queue_head(&qc->free_client_ids);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4890 cid = ngx_queue_data(q, ngx_quic_client_id_t, queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4891
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4892 ngx_queue_remove(&cid->queue);
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4893
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4894 ngx_memzero(cid, sizeof(ngx_quic_client_id_t));
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4895
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4896 } else {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4897
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4898 cid = ngx_pcalloc(c->pool, sizeof(ngx_quic_client_id_t));
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4899 if (cid == NULL) {
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4900 return NULL;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4901 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4902 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4903
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4904 return cid;
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4905 }
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4906
3afaaaa930ab QUIC: added support for multiple connection IDs. Vladimir Homutov <vl@nginx.com> parents: 8536 diff changeset	4907
8628 45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4908 static ngx_quic_server_id_t *
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4909 ngx_quic_alloc_server_id(ngx_connection_t c, ngx_quic_connection_t qc)
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4910 {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4911 ngx_queue_t *q;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4912 ngx_quic_server_id_t *sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4913
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4914 if (!ngx_queue_empty(&qc->free_server_ids)) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4915
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4916 q = ngx_queue_head(&qc->free_server_ids);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4917 sid = ngx_queue_data(q, ngx_quic_server_id_t, queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4918
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4919 ngx_queue_remove(&sid->queue);
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4920
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4921 ngx_memzero(sid, sizeof(ngx_quic_server_id_t));
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4922
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4923 } else {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4924
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4925 sid = ngx_pcalloc(c->pool, sizeof(ngx_quic_server_id_t));
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4926 if (sid == NULL) {
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4927 return NULL;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4928 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4929 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4930
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4931 return sid;
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4932 }
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4933
45db1b5c1706 QUIC: connection multiplexing per port. Roman Arutyunyan <arut@nginx.com> parents: 8627 diff changeset	4934
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4935 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4936 ngx_quic_queue_frame(ngx_quic_connection_t qc, ngx_quic_frame_t frame)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4937 {
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	4938 ngx_quic_send_ctx_t *ctx;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	4939
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	4940 ctx = ngx_quic_get_send_ctx(qc, frame->level);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	4941
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	4942 ngx_queue_insert_tail(&ctx->frames, &frame->queue);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	4943
8476 f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4944 frame->len = ngx_quic_create_frame(NULL, frame);
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4945 /* always succeeds */
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4946
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4947 if (qc->closing) {
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4948 return;
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4949 }
f9fbeb4ee0de QUIC: added limit of queued data. Vladimir Homutov <vl@nginx.com> parents: 8475 diff changeset	4950
8517 924882f42dea QUIC: do not artificially delay sending queued frames. Sergey Kandaurov <pluknet@nginx.com> parents: 8516 diff changeset	4951 ngx_post_event(&qc->push, &ngx_posted_events);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4952 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4953
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4954
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4955 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4956 ngx_quic_output(ngx_connection_t *c)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4957 {
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4958 off_t max;
8708 98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	4959 size_t len, min, in_flight;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4960 ssize_t n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4961 u_char *p;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4962 ngx_uint_t i, pad;
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	4963 ngx_quic_send_ctx_t *ctx;
8708 98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	4964 ngx_quic_congestion_t *cg;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4965 ngx_quic_connection_t *qc;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4966 static u_char dst[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	4967
8275 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	4968 c->log->action = "sending frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 8274 diff changeset	4969
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	4970 qc = ngx_quic_get_connection(c);
8708 98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	4971 cg = &qc->congestion;
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	4972
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	4973 in_flight = cg->in_flight;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	4974
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4975 for ( ;; ) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4976 p = dst;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4977
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4978 len = ngx_min(qc->ctp.max_udp_payload_size,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4979 NGX_QUIC_MAX_UDP_PAYLOAD_SIZE);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4980
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4981 if (!qc->validated) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4982 max = qc->received * 3;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4983 max = (c->sent >= max) ? 0 : max - c->sent;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4984 len = ngx_min(len, (size_t) max);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4985 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4986
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4987 pad = ngx_quic_get_padding_level(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4988
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4989 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4990
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4991 ctx = &qc->send_ctx[i];
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4992
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4993 if (ngx_quic_generate_ack(c, ctx) != NGX_OK) {
8596 38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	4994 return NGX_ERROR;
38c7dd720774 QUIC: added ACK frame range support. Vladimir Homutov <vl@nginx.com> parents: 8595 diff changeset	4995 }
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4996
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4997 min = (i == pad && p - dst < NGX_QUIC_MIN_INITIAL_SIZE)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4998 ? NGX_QUIC_MIN_INITIAL_SIZE - (p - dst) : 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	4999
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5000 n = ngx_quic_output_packet(c, ctx, p, len, min);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5001 if (n == NGX_ERROR) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5002 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5003 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5004
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5005 p += n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5006 len -= n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5007 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5008
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5009 len = p - dst;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5010 if (len == 0) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5011 break;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5012 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5013
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5014 n = ngx_quic_send(c, dst, len);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5015 if (n == NGX_ERROR) {
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5016 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5017 }
8708 98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	5018 }
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	5019
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	5020 if (in_flight != cg->in_flight && !qc->send_timer_set && !qc->closing) {
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	5021 qc->send_timer_set = 1;
98bacfc65c61 QUIC: set idle timer when sending an ack-eliciting packet. Roman Arutyunyan <arut@nginx.com> parents: 8703 diff changeset	5022 ngx_add_timer(c->read, qc->tp.max_idle_timeout);
8271 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	5023 }
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 8270 diff changeset	5024
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5025 ngx_quic_set_lost_timer(c);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5026
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5027 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5028 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5029
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5030
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5031 static ngx_uint_t
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5032 ngx_quic_get_padding_level(ngx_connection_t *c)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5033 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5034 ngx_queue_t *q;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5035 ngx_quic_frame_t *f;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5036 ngx_quic_send_ctx_t *ctx;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5037 ngx_quic_connection_t *qc;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5038
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5039 /*
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5040 * 14.1. Initial Datagram Size
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5041 *
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5042 * Similarly, a server MUST expand the payload of all UDP datagrams
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5043 * carrying ack-eliciting Initial packets to at least the smallest
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5044 * allowed maximum datagram size of 1200 bytes
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5045 */
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5046
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5047 qc = ngx_quic_get_connection(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5048 ctx = ngx_quic_get_send_ctx(qc, ssl_encryption_initial);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5049
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5050 for (q = ngx_queue_head(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5051 q != ngx_queue_sentinel(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5052 q = ngx_queue_next(q))
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5053 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5054 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5055
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5056 if (f->need_ack) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5057 ctx = ngx_quic_get_send_ctx(qc, ssl_encryption_handshake);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5058
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5059 if (ngx_queue_empty(&ctx->frames)) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5060 return 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5061 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5062
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5063 return 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5064 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5065 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5066
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5067 return NGX_QUIC_SEND_CTX_LAST;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5068 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5069
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5070
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5071 static ngx_int_t
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5072 ngx_quic_generate_ack(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5073 {
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5074 ngx_msec_t delay;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5075 ngx_quic_connection_t *qc;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5076
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5077 if (!ctx->send_ack) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5078 return NGX_OK;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5079 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5080
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5081 if (ctx->level == ssl_encryption_application) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5082
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5083 delay = ngx_current_msec - ctx->ack_delay_start;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5084 qc = ngx_quic_get_connection(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5085
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5086 if (ctx->send_ack < NGX_QUIC_MAX_ACK_GAP
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5087 && delay < qc->tp.max_ack_delay)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5088 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5089 if (!qc->push.timer_set && !qc->closing) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5090 ngx_add_timer(&qc->push,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5091 qc->tp.max_ack_delay - delay);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5092 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5093
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5094 return NGX_OK;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5095 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5096 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5097
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5098 if (ngx_quic_send_ack(c, ctx) != NGX_OK) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5099 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5100 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5101
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5102 ctx->send_ack = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5103
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5104 return NGX_OK;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5105 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5106
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5107
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5108 static ssize_t
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5109 ngx_quic_output_packet(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5110 u_char *data, size_t max, size_t min)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5111 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5112 size_t len, hlen, pad_len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5113 u_char *p;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5114 ssize_t flen;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5115 ngx_str_t out, res;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5116 ngx_int_t rc;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5117 ngx_uint_t nframes;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5118 ngx_msec_t now;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5119 ngx_queue_t *q;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5120 ngx_quic_frame_t *f;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5121 ngx_quic_header_t pkt;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	5122 ngx_quic_congestion_t *cg;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5123 ngx_quic_connection_t *qc;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5124 static u_char src[NGX_QUIC_MAX_UDP_PAYLOAD_SIZE];
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5125
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5126 if (ngx_queue_empty(&ctx->frames)) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5127 return 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5128 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5129
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5130 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5131 "quic output %s packet max:%uz min:%uz",
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5132 ngx_quic_level_name(ctx->level), max, min);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5133
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5134 qc = ngx_quic_get_connection(c);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	5135 cg = &qc->congestion;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5136
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5137 hlen = (ctx->level == ssl_encryption_application)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5138 ? NGX_QUIC_MAX_SHORT_HEADER
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5139 : NGX_QUIC_MAX_LONG_HEADER;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5140
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5141 hlen += EVP_GCM_TLS_TAG_LEN;
8590 44991d728899 QUIC: account packet header length in amplification limit. Vladimir Homutov <vl@nginx.com> parents: 8589 diff changeset	5142 hlen -= NGX_QUIC_MAX_CID_LEN - qc->scid.len;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5143
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5144 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5145
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5146 now = ngx_current_msec;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5147 nframes = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5148 p = src;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5149 len = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5150
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5151 for (q = ngx_queue_head(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5152 q != ngx_queue_sentinel(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5153 q = ngx_queue_next(q))
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5154 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5155 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5156
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5157 if (!pkt.need_ack && f->need_ack && max > cg->window) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5158 max = cg->window;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5159 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5160
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5161 if (hlen + len >= max) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5162 break;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5163 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5164
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5165 if (hlen + len + f->len > max) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5166 rc = ngx_quic_split_frame(c, f, max - hlen - len);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5167
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5168 if (rc == NGX_ERROR) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5169 return NGX_ERROR;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5170 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5171
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5172 if (rc == NGX_DECLINED) {
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	5173 break;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	5174 }
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5175 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5176
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5177 if (f->need_ack) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5178 pkt.need_ack = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5179 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5180
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5181 ngx_quic_log_frame(c->log, f, 1);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5182
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5183 flen = ngx_quic_create_frame(p, f);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5184 if (flen == -1) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5185 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5186 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5187
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5188 len += flen;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5189 p += flen;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5190
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5191 f->pnum = ctx->pnum;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5192 f->first = now;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5193 f->last = now;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5194 f->plen = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5195
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5196 nframes++;
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5197
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5198 if (f->flush) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5199 break;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5200 }
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5201 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5202
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5203 if (nframes == 0) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5204 return 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5205 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5206
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5207 out.data = src;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5208 out.len = len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5209
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5210 pkt.keys = qc->keys;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5211 pkt.flags = NGX_QUIC_PKT_FIXED_BIT;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5212
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5213 if (ctx->level == ssl_encryption_initial) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5214 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_INITIAL;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5215
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5216 } else if (ctx->level == ssl_encryption_handshake) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5217 pkt.flags \|= NGX_QUIC_PKT_LONG \| NGX_QUIC_PKT_HANDSHAKE;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5218
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5219 } else {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5220 if (qc->key_phase) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5221 pkt.flags \|= NGX_QUIC_PKT_KPHASE;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5222 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5223 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5224
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5225 ngx_quic_set_packet_number(&pkt, ctx);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5226
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5227 pkt.version = qc->version;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5228 pkt.log = c->log;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5229 pkt.level = ctx->level;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5230 pkt.dcid = qc->scid;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5231 pkt.scid = qc->dcid;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5232
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5233 pad_len = 4;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5234
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5235 if (min) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5236 hlen = EVP_GCM_TLS_TAG_LEN
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5237 + ngx_quic_create_header(&pkt, NULL, out.len, NULL);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5238
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5239 if (min > hlen + pad_len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5240 pad_len = min - hlen;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5241 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5242 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5243
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5244 if (out.len < pad_len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5245 ngx_memset(p, NGX_QUIC_FT_PADDING, pad_len - out.len);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5246 out.len = pad_len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5247 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5248
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5249 pkt.payload = out;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5250
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5251 res.data = data;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5252
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5253 ngx_log_debug6(NGX_LOG_DEBUG_EVENT, c->log, 0,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5254 "quic packet tx %s bytes:%ui"
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5255 " need_ack:%d number:%L encoded nl:%d trunc:0x%xD",
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5256 ngx_quic_level_name(ctx->level), out.len, pkt.need_ack,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5257 pkt.number, pkt.num_len, pkt.trunc);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5258
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5259 if (ngx_quic_encrypt(&pkt, &res) != NGX_OK) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5260 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5261 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5262
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5263 ctx->pnum++;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5264
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5265 if (pkt.need_ack) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5266 /* move frames into the sent queue to wait for ack */
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5267
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5268 if (!qc->closing) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5269 q = ngx_queue_head(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5270 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5271 f->plen = res.len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5272
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5273 do {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5274 q = ngx_queue_head(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5275 ngx_queue_remove(q);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5276 ngx_queue_insert_tail(&ctx->sent, q);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5277 } while (--nframes);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5278 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5279
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5280 cg->in_flight += res.len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5281
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5282 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5283 "quic congestion send if:%uz", cg->in_flight);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5284 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5285
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5286 while (nframes--) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5287 q = ngx_queue_head(&ctx->frames);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5288 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5289
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5290 ngx_queue_remove(q);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5291 ngx_quic_free_frame(c, f);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5292 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5293
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5294 return res.len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5295 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5296
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5297
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5298 static ngx_int_t
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5299 ngx_quic_split_frame(ngx_connection_t c, ngx_quic_frame_t f, size_t len)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5300 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5301 size_t shrink;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5302 ngx_quic_frame_t *nf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5303 ngx_quic_ordered_frame_t of, onf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5304
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5305 switch (f->type) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5306 case NGX_QUIC_FT_CRYPTO:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5307 case NGX_QUIC_FT_STREAM0:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5308 case NGX_QUIC_FT_STREAM1:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5309 case NGX_QUIC_FT_STREAM2:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5310 case NGX_QUIC_FT_STREAM3:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5311 case NGX_QUIC_FT_STREAM4:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5312 case NGX_QUIC_FT_STREAM5:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5313 case NGX_QUIC_FT_STREAM6:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5314 case NGX_QUIC_FT_STREAM7:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5315 break;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5316
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5317 default:
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5318 return NGX_DECLINED;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5319 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5320
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5321 if ((size_t) f->len <= len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5322 return NGX_OK;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5323 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5324
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5325 shrink = f->len - len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5326
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5327 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5328 "quic split frame now:%uz need:%uz shrink:%uz",
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5329 f->len, len, shrink);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5330
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5331 of = &f->u.ord;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5332
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5333 if (of->length <= shrink) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5334 return NGX_DECLINED;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5335 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5336
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5337 of->length -= shrink;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5338 f->len = ngx_quic_create_frame(NULL, f);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5339
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5340 if ((size_t) f->len > len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5341 ngx_log_error(NGX_LOG_ERR, c->log, 0, "could not split QUIC frame");
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5342 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5343 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5344
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5345 nf = ngx_quic_alloc_frame(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5346 if (nf == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5347 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5348 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5349
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5350 nf = f;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5351 onf = &nf->u.ord;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5352 onf->offset += of->length;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5353 onf->length = shrink;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5354 nf->len = ngx_quic_create_frame(NULL, nf);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5355
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5356 nf->data = ngx_quic_split_bufs(c, f->data, of->length);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5357 if (nf->data == NGX_CHAIN_ERROR) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5358 return NGX_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5359 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5360
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	5361 ngx_queue_insert_after(&f->queue, &nf->queue);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5362
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5363 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5364 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5365
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5366
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5367 static void
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5368 ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5369 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5370 ngx_queue_t *q;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5371 ngx_quic_frame_t *f;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5372
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5373 do {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5374 q = ngx_queue_head(frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5375
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5376 if (q == ngx_queue_sentinel(frames)) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5377 break;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5378 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5379
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5380 ngx_queue_remove(q);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5381
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5382 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5383
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5384 ngx_quic_free_frame(c, f);
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5385 } while (1);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5386 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5387
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5388
8656 43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5389 static ssize_t
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5390 ngx_quic_send(ngx_connection_t c, u_char buf, size_t len)
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5391 {
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5392 ngx_buf_t b;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5393 ngx_chain_t cl, *res;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5394
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5395 ngx_memzero(&b, sizeof(ngx_buf_t));
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5396
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5397 b.pos = b.start = buf;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5398 b.last = b.end = buf + len;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5399 b.last_buf = 1;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5400 b.temporary = 1;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5401
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5402 cl.buf = &b;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5403 cl.next= NULL;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5404
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5405 res = c->send_chain(c, &cl, 0);
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5406 if (res == NGX_CHAIN_ERROR) {
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5407 return NGX_ERROR;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5408 }
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5409
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5410 return len;
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5411 }
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5412
43f3574b3e6f QUIC: fixed handling of clients connected to wildcard address. Vladimir Homutov <vl@nginx.com> parents: 8655 diff changeset	5413
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5414 static void
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5415 ngx_quic_set_packet_number(ngx_quic_header_t pkt, ngx_quic_send_ctx_t ctx)
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5416 {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5417 uint64_t delta;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5418
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5419 delta = ctx->pnum - ctx->largest_ack;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5420 pkt->number = ctx->pnum;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5421
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5422 if (delta <= 0x7F) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5423 pkt->num_len = 1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5424 pkt->trunc = ctx->pnum & 0xff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5425
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5426 } else if (delta <= 0x7FFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5427 pkt->num_len = 2;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5428 pkt->flags \|= 0x1;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5429 pkt->trunc = ctx->pnum & 0xffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5430
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5431 } else if (delta <= 0x7FFFFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5432 pkt->num_len = 3;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5433 pkt->flags \|= 0x2;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5434 pkt->trunc = ctx->pnum & 0xffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5435
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5436 } else {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5437 pkt->num_len = 4;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5438 pkt->flags \|= 0x3;
8331 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 8328 diff changeset	5439 pkt->trunc = ctx->pnum & 0xffffffff;
8315 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5440 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5441 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5442
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5443
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 8314 diff changeset	5444 static void
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	5445 ngx_quic_pto_handler(ngx_event_t *ev)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5446 {
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5447 ngx_uint_t i;
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5448 ngx_msec_t now;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5449 ngx_queue_t q, next;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5450 ngx_connection_t *c;
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5451 ngx_quic_frame_t *f;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5452 ngx_quic_send_ctx_t *ctx;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5453 ngx_quic_connection_t *qc;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5454
8472 3b15732ac03f QUIC: renaming. Vladimir Homutov <vl@nginx.com> parents: 8471 diff changeset	5455 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic pto timer");
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5456
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5457 c = ev->data;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5458 qc = ngx_quic_get_connection(c);
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5459 now = ngx_current_msec;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5460
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5461 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5462
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5463 ctx = &qc->send_ctx[i];
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5464
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5465 if (ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5466 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5467 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5468
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5469 q = ngx_queue_head(&ctx->sent);
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5470 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5471
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5472 if (f->pnum <= ctx->largest_ack
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	5473 && ctx->largest_ack != NGX_QUIC_UNSET_PN)
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5474 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5475 continue;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5476 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5477
8698 9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5478 if ((ngx_msec_int_t) (f->last + ngx_quic_pto(c, ctx) - now) > 0) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5479 continue;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5480 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5481
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5482 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5483 "quic pto %s pto_count:%ui",
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5484 ngx_quic_level_name(ctx->level), qc->pto_count);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5485
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5486 for (q = ngx_queue_head(&ctx->frames);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5487 q != ngx_queue_sentinel(&ctx->frames);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5488 /* void */)
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5489 {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5490 next = ngx_queue_next(q);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5491 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5492
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5493 if (f->type == NGX_QUIC_FT_PING) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5494 ngx_queue_remove(q);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5495 ngx_quic_free_frame(c, f);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5496 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5497
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5498 q = next;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5499 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5500
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5501 for (q = ngx_queue_head(&ctx->sent);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5502 q != ngx_queue_sentinel(&ctx->sent);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5503 /* void */)
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5504 {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5505 next = ngx_queue_next(q);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5506 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5507
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5508 if (f->type == NGX_QUIC_FT_PING) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5509 ngx_quic_congestion_lost(c, f);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5510 ngx_queue_remove(q);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5511 ngx_quic_free_frame(c, f);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5512 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5513
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5514 q = next;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5515 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5516
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5517 /* enforce 2 udp datagrams */
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5518
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5519 f = ngx_quic_alloc_frame(c);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5520 if (f == NULL) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5521 break;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5522 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5523
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5524 f->level = ctx->level;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5525 f->type = NGX_QUIC_FT_PING;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5526 f->flush = 1;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5527
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5528 ngx_quic_queue_frame(qc, f);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5529
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5530 f = ngx_quic_alloc_frame(c);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5531 if (f == NULL) {
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5532 break;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5533 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5534
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5535 f->level = ctx->level;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5536 f->type = NGX_QUIC_FT_PING;
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5537
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5538 ngx_quic_queue_frame(qc, f);
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5539 }
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5540
9ed95726b99b QUIC: send PING frames on PTO expiration. Roman Arutyunyan <arut@nginx.com> parents: 8697 diff changeset	5541 qc->pto_count++;
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5542
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5543 ngx_quic_connstate_dbg(c);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5544 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5545
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5546
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5547 static void
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5548 ngx_quic_push_handler(ngx_event_t *ev)
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5549 {
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	5550 ngx_connection_t *c;
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5551
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	5552 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic push timer");
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5553
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5554 c = ev->data;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5555
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5556 if (ngx_quic_output(c) != NGX_OK) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	5557 ngx_quic_close_connection(c, NGX_ERROR);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5558 return;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5559 }
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5560
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5561 ngx_quic_connstate_dbg(c);
8309 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5562 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5563
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 8308 diff changeset	5564
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5565 static
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5566 void ngx_quic_lost_handler(ngx_event_t *ev)
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5567 {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5568 ngx_connection_t *c;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5569
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5570 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "quic lost timer");
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5571
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5572 c = ev->data;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5573
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5574 if (ngx_quic_detect_lost(c) != NGX_OK) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5575 ngx_quic_close_connection(c, NGX_ERROR);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5576 }
8607 21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5577
21b7dac9de3b QUIC: added connection state debug to event handlers. Vladimir Homutov <vl@nginx.com> parents: 8606 diff changeset	5578 ngx_quic_connstate_dbg(c);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5579 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5580
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5581
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5582 static ngx_int_t
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5583 ngx_quic_detect_lost(ngx_connection_t *c)
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5584 {
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5585 ngx_uint_t i;
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5586 ngx_msec_t now, wait, thr;
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5587 ngx_queue_t *q;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5588 ngx_quic_frame_t *start;
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5589 ngx_quic_send_ctx_t *ctx;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5590 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5591
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5592 qc = ngx_quic_get_connection(c);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5593 now = ngx_current_msec;
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5594 thr = ngx_quic_lost_threshold(qc);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5595
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5596 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5597
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5598 ctx = &qc->send_ctx[i];
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5599
8598 85a550047eb5 QUIC: added macro for unset packet number. Vladimir Homutov <vl@nginx.com> parents: 8597 diff changeset	5600 if (ctx->largest_ack == NGX_QUIC_UNSET_PN) {
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5601 continue;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5602 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5603
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5604 while (!ngx_queue_empty(&ctx->sent)) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5605
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5606 q = ngx_queue_head(&ctx->sent);
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5607 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5608
8515 4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5609 if (start->pnum > ctx->largest_ack) {
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5610 break;
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5611 }
4e3a71621c9a QUIC: do not arm loss detection timer for succeeding packets. Sergey Kandaurov <pluknet@nginx.com> parents: 8514 diff changeset	5612
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5613 wait = start->last + thr - now;
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5614
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5615 ngx_log_debug4(NGX_LOG_DEBUG_EVENT, c->log, 0,
8519 de7d6d943f68 QUIC: fixed format specifiers. Sergey Kandaurov <pluknet@nginx.com> parents: 8518 diff changeset	5616 "quic detect_lost pnum:%uL thr:%M wait:%i level:%d",
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5617 start->pnum, thr, (ngx_int_t) wait, start->level);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5618
8516 355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	5619 if ((ngx_msec_int_t) wait > 0
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	5620 && ctx->largest_ack - start->pnum < NGX_QUIC_PKT_THR)
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	5621 {
355e079c5eee QUIC: do not arm loss detection timer on packet threshold. Sergey Kandaurov <pluknet@nginx.com> parents: 8515 diff changeset	5622 break;
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5623 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	5624
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5625 ngx_quic_resend_frames(c, ctx);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5626 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5627 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5628
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5629 ngx_quic_set_lost_timer(c);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5630
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5631 return NGX_OK;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5632 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5633
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5634
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5635 static void
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5636 ngx_quic_set_lost_timer(ngx_connection_t *c)
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5637 {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5638 ngx_uint_t i;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5639 ngx_msec_t now;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5640 ngx_queue_t *q;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5641 ngx_msec_int_t lost, pto, w;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5642 ngx_quic_frame_t *f;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5643 ngx_quic_send_ctx_t *ctx;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5644 ngx_quic_connection_t *qc;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5645
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5646 qc = ngx_quic_get_connection(c);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5647 now = ngx_current_msec;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5648
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5649 lost = -1;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5650 pto = -1;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5651
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5652 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5653 ctx = &qc->send_ctx[i];
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5654
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5655 if (ngx_queue_empty(&ctx->sent)) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5656 continue;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5657 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5658
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5659 if (ctx->largest_ack != NGX_QUIC_UNSET_PN) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5660 q = ngx_queue_head(&ctx->sent);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5661 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5662 w = (ngx_msec_int_t) (f->last + ngx_quic_lost_threshold(qc) - now);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5663
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5664 if (f->pnum <= ctx->largest_ack) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5665 if (w < 0 \|\| ctx->largest_ack - f->pnum >= NGX_QUIC_PKT_THR) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5666 w = 0;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5667 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5668
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5669 if (lost == -1 \|\| w < lost) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5670 lost = w;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5671 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5672 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5673 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5674
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5675 q = ngx_queue_last(&ctx->sent);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5676 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5677 w = (ngx_msec_int_t) (f->last + ngx_quic_pto(c, ctx) - now);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5678
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5679 if (w < 0) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5680 w = 0;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5681 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5682
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5683 if (pto == -1 \|\| w < pto) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5684 pto = w;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5685 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5686 }
8474 909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5687
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5688 if (qc->pto.timer_set) {
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5689 ngx_del_timer(&qc->pto);
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5690 }
909b989ec088 QUIC: reworked retransmission mechanism. Vladimir Homutov <vl@nginx.com> parents: 8473 diff changeset	5691
8697 faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5692 if (lost != -1) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5693 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5694 "quic lost timer lost:%M", lost);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5695
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5696 qc->pto.handler = ngx_quic_lost_handler;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5697 ngx_add_timer(&qc->pto, lost);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5698 return;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5699 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5700
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5701 if (pto != -1) {
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5702 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5703 "quic lost timer pto:%M", pto);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5704
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5705 qc->pto.handler = ngx_quic_pto_handler;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5706 ngx_add_timer(&qc->pto, pto);
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5707 return;
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5708 }
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5709
faa3201ff351 QUIC: improved setting the lost timer. Roman Arutyunyan <arut@nginx.com> parents: 8696 diff changeset	5710 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic lost timer unset");
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5711 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5712
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5713
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5714 static void
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5715 ngx_quic_resend_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5716 {
8617 69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5717 size_t n;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5718 ngx_buf_t *b;
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5719 ngx_queue_t *q;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5720 ngx_quic_frame_t f, start;
8617 69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5721 ngx_quic_stream_t *sn;
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5722 ngx_quic_connection_t *qc;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5723
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5724 qc = ngx_quic_get_connection(c);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5725 q = ngx_queue_head(&ctx->sent);
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5726 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5727
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5728 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5729 "quic resend packet pnum:%uL", start->pnum);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5730
8616 64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5731 ngx_quic_congestion_lost(c, start);
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5732
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5733 do {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5734 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5735
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5736 if (f->pnum != start->pnum) {
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5737 break;
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5738 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5739
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5740 q = ngx_queue_next(q);
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5741
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5742 ngx_queue_remove(&f->queue);
8616 64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5743
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5744 switch (f->type) {
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5745 case NGX_QUIC_FT_ACK:
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5746 case NGX_QUIC_FT_ACK_ECN:
8696 88c9c868a7c9 QUIC: disabled non-immediate ACKs for Initial and Handshake. Roman Arutyunyan <arut@nginx.com> parents: 8695 diff changeset	5747 if (ctx->level == ssl_encryption_application) {
88c9c868a7c9 QUIC: disabled non-immediate ACKs for Initial and Handshake. Roman Arutyunyan <arut@nginx.com> parents: 8695 diff changeset	5748 /* force generation of most recent acknowledgment */
88c9c868a7c9 QUIC: disabled non-immediate ACKs for Initial and Handshake. Roman Arutyunyan <arut@nginx.com> parents: 8695 diff changeset	5749 ctx->send_ack = NGX_QUIC_MAX_ACK_GAP;
88c9c868a7c9 QUIC: disabled non-immediate ACKs for Initial and Handshake. Roman Arutyunyan <arut@nginx.com> parents: 8695 diff changeset	5750 }
88c9c868a7c9 QUIC: disabled non-immediate ACKs for Initial and Handshake. Roman Arutyunyan <arut@nginx.com> parents: 8695 diff changeset	5751
8616 64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5752 ngx_quic_free_frame(c, f);
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5753 break;
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5754
8617 69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5755 case NGX_QUIC_FT_PING:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5756 case NGX_QUIC_FT_PATH_RESPONSE:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5757 case NGX_QUIC_FT_CONNECTION_CLOSE:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5758 ngx_quic_free_frame(c, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5759 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5760
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5761 case NGX_QUIC_FT_MAX_DATA:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5762 f->u.max_data.max_data = qc->streams.recv_max_data;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5763 ngx_quic_queue_frame(qc, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5764 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5765
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5766 case NGX_QUIC_FT_MAX_STREAMS:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5767 case NGX_QUIC_FT_MAX_STREAMS2:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5768 f->u.max_streams.limit = f->u.max_streams.bidi
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5769 ? qc->streams.client_max_streams_bidi
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5770 : qc->streams.client_max_streams_uni;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5771 ngx_quic_queue_frame(qc, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5772 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5773
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5774 case NGX_QUIC_FT_MAX_STREAM_DATA:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5775 sn = ngx_quic_find_stream(&qc->streams.tree,
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5776 f->u.max_stream_data.id);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5777 if (sn == NULL) {
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5778 ngx_quic_free_frame(c, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5779 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5780 }
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5781
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5782 b = sn->b;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5783 n = sn->fs.received + (b->pos - b->start) + (b->end - b->last);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5784
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5785 if (f->u.max_stream_data.limit < n) {
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5786 f->u.max_stream_data.limit = n;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5787 }
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5788
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5789 ngx_quic_queue_frame(qc, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5790 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5791
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5792 case NGX_QUIC_FT_STREAM0:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5793 case NGX_QUIC_FT_STREAM1:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5794 case NGX_QUIC_FT_STREAM2:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5795 case NGX_QUIC_FT_STREAM3:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5796 case NGX_QUIC_FT_STREAM4:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5797 case NGX_QUIC_FT_STREAM5:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5798 case NGX_QUIC_FT_STREAM6:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5799 case NGX_QUIC_FT_STREAM7:
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5800 sn = ngx_quic_find_stream(&qc->streams.tree, f->u.stream.stream_id);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5801
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5802 if (sn && sn->c->write->error) {
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5803 /* RESET_STREAM was sent */
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5804 ngx_quic_free_frame(c, f);
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5805 break;
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5806 }
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5807
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5808 /* fall through */
69dc750cf66f QUIC: handle more frames in ngx_quic_resend_frames(). Roman Arutyunyan <arut@nginx.com> parents: 8616 diff changeset	5809
8616 64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5810 default:
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5811 ngx_queue_insert_tail(&ctx->frames, &f->queue);
64405f970f6f QUIC: avoided retransmission of stale ack frames. Vladimir Homutov <vl@nginx.com> parents: 8615 diff changeset	5812 }
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5813
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5814 } while (q != ngx_queue_sentinel(&ctx->sent));
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5815
8556 b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5816 if (qc->closing) {
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5817 return;
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5818 }
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5819
b383120afca3 QUIC: resend frames by moving them to output queue. Roman Arutyunyan <arut@nginx.com> parents: 8553 diff changeset	5820 ngx_post_event(&qc->push, &ngx_posted_events);
8513 38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5821 }
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5822
38f1be6c603f QUIC: sending probe packets on PTO timer expiration. Sergey Kandaurov <pluknet@nginx.com> parents: 8512 diff changeset	5823
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5824 ngx_connection_t *
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5825 ngx_quic_open_stream(ngx_connection_t *c, ngx_uint_t bidi)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5826 {
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5827 size_t rcvbuf_size;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5828 uint64_t id;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5829 ngx_quic_stream_t qs, sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5830 ngx_quic_connection_t *qc;
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5831
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	5832 qs = c->quic;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5833 qc = ngx_quic_get_connection(qs->parent);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5834
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5835 if (bidi) {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5836 if (qc->streams.server_streams_bidi
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5837 >= qc->streams.server_max_streams_bidi)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5838 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5839 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5840 "quic too many server bidi streams:%uL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5841 qc->streams.server_streams_bidi);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5842 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5843 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5844
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5845 id = (qc->streams.server_streams_bidi << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5846 \| NGX_QUIC_STREAM_SERVER_INITIATED;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5847
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5848 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5849 "quic creating server bidi stream"
eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5850 " streams:%uL max:%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5851 qc->streams.server_streams_bidi,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5852 qc->streams.server_max_streams_bidi, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5853
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5854 qc->streams.server_streams_bidi++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5855 rcvbuf_size = qc->tp.initial_max_stream_data_bidi_local;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5856
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5857 } else {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5858 if (qc->streams.server_streams_uni
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5859 >= qc->streams.server_max_streams_uni)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5860 {
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5861 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5862 "quic too many server uni streams:%uL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5863 qc->streams.server_streams_uni);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5864 return NULL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5865 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5866
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5867 id = (qc->streams.server_streams_uni << 2)
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5868 \| NGX_QUIC_STREAM_SERVER_INITIATED
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5869 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5870
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5871 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5872 "quic creating server uni stream"
eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5873 " streams:%uL max:%uL id:0x%xL",
8495 455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5874 qc->streams.server_streams_uni,
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5875 qc->streams.server_max_streams_uni, id);
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5876
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5877 qc->streams.server_streams_uni++;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5878 rcvbuf_size = 0;
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5879 }
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5880
455a8536eaa7 QUIC: limited the number of server-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8486 diff changeset	5881 sn = ngx_quic_create_stream(qs->parent, id, rcvbuf_size);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5882 if (sn == NULL) {
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5883 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5884 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5885
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	5886 return sn->c;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5887 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5888
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5889
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5890 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5891 ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5892 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5893 {
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5894 ngx_rbtree_node_t **p;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5895 ngx_quic_stream_t qn, qnt;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5896
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5897 for ( ;; ) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5898 qn = (ngx_quic_stream_t *) node;
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5899 qnt = (ngx_quic_stream_t *) temp;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5900
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5901 p = (qn->id < qnt->id) ? &temp->left : &temp->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5902
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5903 if (*p == sentinel) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5904 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5905 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5906
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5907 temp = *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5908 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5909
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5910 *p = node;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5911 node->parent = temp;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5912 node->left = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5913 node->right = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5914 ngx_rbt_red(node);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5915 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5916
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5917
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5918 static ngx_quic_stream_t *
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5919 ngx_quic_find_stream(ngx_rbtree_t *rbtree, uint64_t id)
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5920 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5921 ngx_rbtree_node_t node, sentinel;
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5922 ngx_quic_stream_t *qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5923
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5924 node = rbtree->root;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5925 sentinel = rbtree->sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5926
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5927 while (node != sentinel) {
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5928 qn = (ngx_quic_stream_t *) node;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5929
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5930 if (id == qn->id) {
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5931 return qn;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5932 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5933
8284 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 8282 diff changeset	5934 node = (id < qn->id) ? node->left : node->right;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5935 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5936
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5937 return NULL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5938 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5939
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	5940
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	5941 static ngx_quic_stream_t *
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5942 ngx_quic_create_client_stream(ngx_connection_t *c, uint64_t id)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5943 {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5944 size_t n;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5945 uint64_t min_id;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5946 ngx_quic_stream_t *sn;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5947 ngx_quic_connection_t *qc;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5948
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5949 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	5950 "quic stream id:0x%xL is new", id);
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5951
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	5952 qc = ngx_quic_get_connection(c);
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5953
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	5954 if (qc->shutdown) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	5955 return NGX_QUIC_STREAM_GONE;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	5956 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	5957
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5958 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5959
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5960 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5961 if ((id >> 2) < qc->streams.server_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5962 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5963 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5964
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5965 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5966 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5967 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5968
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5969 if ((id >> 2) < qc->streams.client_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5970 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5971 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5972
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5973 if ((id >> 2) >= qc->streams.client_max_streams_uni) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5974 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5975 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5976 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5977
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5978 min_id = (qc->streams.client_streams_uni << 2)
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5979 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5980 qc->streams.client_streams_uni = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5981 n = qc->tp.initial_max_stream_data_uni;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5982
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5983 } else {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5984
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5985 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5986 if ((id >> 2) < qc->streams.server_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5987 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5988 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5989
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5990 qc->error = NGX_QUIC_ERR_STREAM_STATE_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5991 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5992 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5993
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5994 if ((id >> 2) < qc->streams.client_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5995 return NGX_QUIC_STREAM_GONE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5996 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5997
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5998 if ((id >> 2) >= qc->streams.client_max_streams_bidi) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	5999 qc->error = NGX_QUIC_ERR_STREAM_LIMIT_ERROR;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6000 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6001 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6002
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6003 min_id = (qc->streams.client_streams_bidi << 2);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6004 qc->streams.client_streams_bidi = (id >> 2) + 1;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6005 n = qc->tp.initial_max_stream_data_bidi_remote;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6006 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6007
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6008 if (n < NGX_QUIC_STREAM_BUFSIZE) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6009 n = NGX_QUIC_STREAM_BUFSIZE;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6010 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6011
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6012 /*
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6013 * 2.1. Stream Types and Identifiers
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6014 *
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6015 * Within each type, streams are created with numerically increasing
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6016 * stream IDs. A stream ID that is used out of order results in all
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6017 * streams of that type with lower-numbered stream IDs also being
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6018 * opened.
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6019 */
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6020
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6021 for ( /* void */ ; min_id < id; min_id += 0x04) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6022
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6023 sn = ngx_quic_create_stream(c, min_id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6024 if (sn == NULL) {
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6025 return NULL;
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6026 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6027
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6028 sn->c->listening->handler(sn->c);
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6029
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6030 if (qc->shutdown) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6031 return NGX_QUIC_STREAM_GONE;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6032 }
8504 d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6033 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6034
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6035 return ngx_quic_create_stream(c, id, n);
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6036 }
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6037
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6038
d277e25e37fc QUIC: create streams for STREAM_DATA_BLOCKED and MAX_STREAM_DATA. Roman Arutyunyan <arut@nginx.com> parents: 8503 diff changeset	6039 static ngx_quic_stream_t *
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6040 ngx_quic_create_stream(ngx_connection_t *c, uint64_t id, size_t rcvbuf_size)
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6041 {
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6042 ngx_log_t *log;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6043 ngx_pool_t *pool;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6044 ngx_quic_stream_t *sn;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6045 ngx_pool_cleanup_t *cln;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6046 ngx_quic_connection_t *qc;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6047
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6048 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6049 "quic stream id:0x%xL create", id);
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6050
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6051 qc = ngx_quic_get_connection(c);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6052
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6053 pool = ngx_create_pool(NGX_DEFAULT_POOL_SIZE, c->log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6054 if (pool == NULL) {
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6055 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6056 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6057
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6058 sn = ngx_pcalloc(pool, sizeof(ngx_quic_stream_t));
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6059 if (sn == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6060 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6061 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6062 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6063
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6064 sn->node.key = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6065 sn->parent = c;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6066 sn->id = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6067
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6068 sn->b = ngx_create_temp_buf(pool, rcvbuf_size);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6069 if (sn->b == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6070 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6071 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6072 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6073
8334 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	6074 ngx_queue_init(&sn->fs.frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 8333 diff changeset	6075
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6076 log = ngx_palloc(pool, sizeof(ngx_log_t));
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6077 if (log == NULL) {
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6078 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6079 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6080 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6081
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6082 log = c->log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6083 pool->log = log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6084
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6085 sn->c = ngx_get_connection(-1, log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6086 if (sn->c == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6087 ngx_destroy_pool(pool);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6088 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6089 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6090
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	6091 sn->c->quic = sn;
8482 893b3313f53c QUIC: added "quic" listen parameter in Stream. Roman Arutyunyan <arut@nginx.com> parents: 8481 diff changeset	6092 sn->c->type = SOCK_STREAM;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6093 sn->c->pool = pool;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6094 sn->c->ssl = c->ssl;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6095 sn->c->sockaddr = c->sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6096 sn->c->listening = c->listening;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6097 sn->c->addr_text = c->addr_text;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6098 sn->c->local_sockaddr = c->local_sockaddr;
8579 d57cfdebe301 QUIC: set local_socklen in stream connections. Roman Arutyunyan <arut@nginx.com> parents: 8578 diff changeset	6099 sn->c->local_socklen = c->local_socklen;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6100 sn->c->number = ngx_atomic_fetch_add(ngx_connection_counter, 1);
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6101
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6102 sn->c->recv = ngx_quic_stream_recv;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6103 sn->c->send = ngx_quic_stream_send;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6104 sn->c->send_chain = ngx_quic_stream_send_chain;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6105
8479 b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	6106 sn->c->read->log = log;
b250b515e5b6 QUIC: fixed stream read event log. Roman Arutyunyan <arut@nginx.com> parents: 8478 diff changeset	6107 sn->c->write->log = log;
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6108
8362 44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	6109 log->connection = sn->c->number;
44cac24aaa44 Assign connection number to every QUIC stream log. Roman Arutyunyan <arut@nginx.com> parents: 8361 diff changeset	6110
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6111 if ((id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6112 \|\| (id & NGX_QUIC_STREAM_SERVER_INITIATED))
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6113 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6114 sn->c->write->ready = 1;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6115 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6116
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6117 if (id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6118 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6119 sn->send_max_data = qc->ctp.initial_max_stream_data_uni;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6120 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6121
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6122 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6123 if (id & NGX_QUIC_STREAM_SERVER_INITIATED) {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6124 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_remote;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6125 } else {
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6126 sn->send_max_data = qc->ctp.initial_max_stream_data_bidi_local;
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6127 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6128 }
fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6129
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6130 cln = ngx_pool_cleanup_add(pool, 0);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6131 if (cln == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6132 ngx_close_connection(sn->c);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6133 ngx_destroy_pool(pool);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6134 return NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6135 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6136
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6137 cln->handler = ngx_quic_stream_cleanup_handler;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6138 cln->data = sn->c;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6139
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6140 ngx_rbtree_insert(&qc->streams.tree, &sn->node);
8282 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 8281 diff changeset	6141
8229 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6142 return sn;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6143 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6144
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 8225 diff changeset	6145
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6146 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6147 ngx_quic_stream_recv(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6148 {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6149 ssize_t len;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6150 ngx_buf_t *b;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6151 ngx_event_t *rev;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6152 ngx_connection_t *pc;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6153 ngx_quic_frame_t *frame;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6154 ngx_quic_stream_t *qs;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6155 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6156
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	6157 qs = c->quic;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6158 b = qs->b;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6159 pc = qs->parent;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6160 qc = ngx_quic_get_connection(pc);
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6161 rev = c->read;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6162
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6163 if (rev->error) {
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6164 return NGX_ERROR;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6165 }
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6166
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6167 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6168 "quic stream recv id:0x%xL eof:%d avail:%z",
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6169 qs->id, rev->pending_eof, b->last - b->pos);
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6170
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6171 if (b->pos == b->last) {
8279 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6172 rev->ready = 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6173
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6174 if (rev->pending_eof) {
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6175 rev->eof = 1;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6176 return 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6177 }
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8278 diff changeset	6178
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6179 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6180 "quic stream id:0x%xL recv() not ready", qs->id);
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6181 return NGX_AGAIN;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6182 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6183
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6184 len = ngx_min(b->last - b->pos, (ssize_t) size);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6185
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6186 ngx_memcpy(buf, b->pos, len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6187
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6188 b->pos += len;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6189 qc->streams.received += len;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6190
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6191 if (b->pos == b->last) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6192 b->pos = b->start;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6193 b->last = b->start;
8294 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 8293 diff changeset	6194 rev->ready = rev->pending_eof;
8266 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6195 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8265 diff changeset	6196
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6197 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6198 "quic stream id:0x%xL recv len:%z of size:%uz",
eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6199 qs->id, len, size);
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6200
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6201 if (!rev->pending_eof) {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6202 frame = ngx_quic_alloc_frame(pc);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6203 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6204 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6205 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6206
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6207 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6208 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6209 frame->u.max_stream_data.id = qs->id;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6210 frame->u.max_stream_data.limit = qs->fs.received + (b->pos - b->start)
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6211 + (b->end - b->last);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6212
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6213 ngx_quic_queue_frame(qc, frame);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6214 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6215
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6216 if ((qc->streams.recv_max_data / 2) < qc->streams.received) {
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6217
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6218 frame = ngx_quic_alloc_frame(pc);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6219
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6220 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6221 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6222 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6223
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6224 qc->streams.recv_max_data *= 2;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6225
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6226 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6227 frame->type = NGX_QUIC_FT_MAX_DATA;
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6228 frame->u.max_data.max_data = qc->streams.recv_max_data;
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6229
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6230 ngx_quic_queue_frame(qc, frame);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6231
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6232 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6233 "quic stream id:0x%xL recv: increased max_data:%uL",
8365 fab75acb1f72 Respect MAX_DATA and MAX_STREAM_DATA from QUIC client. Roman Arutyunyan <arut@nginx.com> parents: 8364 diff changeset	6234 qs->id, qc->streams.recv_max_data);
8338 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6235 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 8337 diff changeset	6236
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6237 return len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6238 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6239
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6240
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6241 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6242 ngx_quic_stream_send(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6243 {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6244 ngx_buf_t b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6245 ngx_chain_t cl;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6246
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6247 ngx_memzero(&b, sizeof(ngx_buf_t));
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6248
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6249 b.memory = 1;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6250 b.pos = buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6251 b.last = buf + size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6252
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6253 cl.buf = &b;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6254 cl.next = NULL;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6255
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6256 if (ngx_quic_stream_send_chain(c, &cl, 0) == NGX_CHAIN_ERROR) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6257 return NGX_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6258 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6259
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6260 if (b.pos == buf) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6261 return NGX_AGAIN;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6262 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6263
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6264 return b.pos - buf;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6265 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6266
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6267
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6268 static ngx_chain_t *
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6269 ngx_quic_stream_send_chain(ngx_connection_t c, ngx_chain_t in, off_t limit)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6270 {
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6271 size_t n, flow;
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6272 ngx_event_t *wev;
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6273 ngx_chain_t *cl;
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6274 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6275 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6276 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6277 ngx_quic_connection_t *qc;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6278
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	6279 qs = c->quic;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6280 pc = qs->parent;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6281 qc = ngx_quic_get_connection(pc);
8503 b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6282 wev = c->write;
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6283
b66a2a041d7e QUIC: fixed ngx_http_test_reading() for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 8502 diff changeset	6284 if (wev->error) {
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6285 return NGX_CHAIN_ERROR;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6286 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6287
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6288 flow = ngx_quic_max_stream_flow(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6289 if (flow == 0) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6290 wev->ready = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6291 return in;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6292 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6293
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6294 n = (limit && (size_t) limit < flow) ? (size_t) limit : flow;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6295
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6296 frame = ngx_quic_alloc_frame(pc);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6297 if (frame == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6298 return NGX_CHAIN_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6299 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6300
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6301 frame->data = ngx_quic_copy_chain(pc, in, n);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6302 if (frame->data == NGX_CHAIN_ERROR) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6303 return NGX_CHAIN_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6304 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6305
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6306 for (n = 0, cl = frame->data; cl; cl = cl->next) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6307 n += ngx_buf_size(cl->buf);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6308 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6309
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6310 while (in && ngx_buf_size(in->buf) == 0) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6311 in = in->next;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6312 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6313
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6314 frame->level = ssl_encryption_application;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6315 frame->type = NGX_QUIC_FT_STREAM6; /* OFF=1 LEN=1 FIN=0 */
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6316 frame->u.stream.off = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6317 frame->u.stream.len = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6318 frame->u.stream.fin = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6319
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6320 frame->u.stream.type = frame->type;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6321 frame->u.stream.stream_id = qs->id;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6322 frame->u.stream.offset = c->sent;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6323 frame->u.stream.length = n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6324
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6325 c->sent += n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6326 qc->streams.sent += n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6327
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6328 ngx_quic_queue_frame(qc, frame);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6329
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6330 wev->ready = (n < flow) ? 1 : 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6331
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6332 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6333 "quic send_chain sent:%uz", n);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6334
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6335 return in;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6336 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6337
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6338
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6339 static size_t
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6340 ngx_quic_max_stream_flow(ngx_connection_t *c)
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6341 {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6342 size_t size;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6343 uint64_t sent, unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6344 ngx_quic_stream_t *qs;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6345 ngx_quic_connection_t *qc;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6346
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	6347 qs = c->quic;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6348 qc = ngx_quic_get_connection(qs->parent);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6349
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6350 size = NGX_QUIC_STREAM_BUFSIZE;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6351 sent = c->sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6352 unacked = sent - qs->acked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6353
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6354 if (qc->streams.send_max_data == 0) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6355 qc->streams.send_max_data = qc->ctp.initial_max_data;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6356 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6357
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6358 if (unacked >= NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6359 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6360 "quic send flow hit buffer size");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6361 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6362 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6363
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6364 if (unacked + size > NGX_QUIC_STREAM_BUFSIZE) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6365 size = NGX_QUIC_STREAM_BUFSIZE - unacked;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6366 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6367
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6368 if (qc->streams.sent >= qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6369 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6370 "quic send flow hit MAX_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6371 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6372 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6373
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6374 if (qc->streams.sent + size > qc->streams.send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6375 size = qc->streams.send_max_data - qc->streams.sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6376 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6377
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6378 if (sent >= qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6379 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6380 "quic send flow hit MAX_STREAM_DATA");
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6381 return 0;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6382 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6383
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6384 if (sent + size > qs->send_max_data) {
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6385 size = qs->send_max_data - sent;
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6386 }
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6387
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6388 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6389 "quic send flow:%uz", size);
8509 bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6390
bce9e9643444 QUIC: coalesce neighbouring stream send buffers. Roman Arutyunyan <arut@nginx.com> parents: 8508 diff changeset	6391 return size;
8225 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6392 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6393
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 8224 diff changeset	6394
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6395 static void
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6396 ngx_quic_stream_cleanup_handler(void *data)
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6397 {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6398 ngx_connection_t *c = data;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6399
8280 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6400 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6401 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6402 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 8279 diff changeset	6403 ngx_quic_connection_t *qc;
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6404
8630 279ad36f2f4b QUIC: renamed c->qs to c->quic. Roman Arutyunyan <arut@nginx.com> parents: 8629 diff changeset	6405 qs = c->quic;
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6406 pc = qs->parent;
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6407 qc = ngx_quic_get_connection(pc);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6408
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6409 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6410 "quic stream id:0x%xL cleanup", qs->id);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6411
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6412 ngx_rbtree_delete(&qc->streams.tree, &qs->node);
8348 d42b50d239f4 Fixed memory leak with reordered stream frames. Vladimir Homutov <vl@nginx.com> parents: 8346 diff changeset	6413 ngx_quic_free_frames(pc, &qs->fs.frames);
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6414
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6415 if (qc->closing) {
8355 ad3a6f069498 Added proper handling of connection close phases. Vladimir Homutov <vl@nginx.com> parents: 8354 diff changeset	6416 /* schedule handler call to continue ngx_quic_close_connection() */
8281 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6417 ngx_post_event(pc->read, &ngx_posted_events);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6418 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6419 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 8280 diff changeset	6420
8528 97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6421 if ((qs->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6422 \|\| (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0)
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6423 {
8539 62db595a86b5 QUIC: do not send STOP_SENDING after STREAM fin. Roman Arutyunyan <arut@nginx.com> parents: 8538 diff changeset	6424 if (!c->read->pending_eof && !c->read->error) {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6425 frame = ngx_quic_alloc_frame(pc);
8528 97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6426 if (frame == NULL) {
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6427 goto done;
8528 97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6428 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6429
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6430 frame->level = ssl_encryption_application;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6431 frame->type = NGX_QUIC_FT_STOP_SENDING;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6432 frame->u.stop_sending.id = qs->id;
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6433 frame->u.stop_sending.error_code = 0x100; /* HTTP/3 no error */
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6434
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6435 ngx_quic_queue_frame(qc, frame);
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6436 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6437 }
97da6521657c QUIC: send STOP_SENDING on stream closure. Roman Arutyunyan <arut@nginx.com> parents: 8526 diff changeset	6438
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6439 if ((qs->id & NGX_QUIC_STREAM_SERVER_INITIATED) == 0) {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6440 frame = ngx_quic_alloc_frame(pc);
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6441 if (frame == NULL) {
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6442 goto done;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6443 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6444
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6445 frame->level = ssl_encryption_application;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6446 frame->type = NGX_QUIC_FT_MAX_STREAMS;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6447
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6448 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6449 frame->u.max_streams.limit = ++qc->streams.client_max_streams_uni;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6450 frame->u.max_streams.bidi = 0;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6451
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6452 } else {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6453 frame->u.max_streams.limit = ++qc->streams.client_max_streams_bidi;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6454 frame->u.max_streams.bidi = 1;
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6455 }
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6456
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6457 ngx_quic_queue_frame(qc, frame);
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6458
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6459 if (qs->id & NGX_QUIC_STREAM_UNIDIRECTIONAL) {
c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6460 /* do not send fin for client unidirectional streams */
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6461 goto done;
8496 c5324bb3a704 QUIC: limited the number of client-initiated streams. Roman Arutyunyan <arut@nginx.com> parents: 8495 diff changeset	6462 }
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6463 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6464
8703 d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	6465 if (c->write->error) {
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6466 goto done;
8703 d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	6467 }
d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	6468
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6469 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8605 eed49b83e18f QUIC: revised value separators in debug and error messages. Vladimir Homutov <vl@nginx.com> parents: 8604 diff changeset	6470 "quic stream id:0x%xL send fin", qs->id);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6471
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6472 frame = ngx_quic_alloc_frame(pc);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6473 if (frame == NULL) {
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6474 goto done;
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6475 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6476
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6477 frame->level = ssl_encryption_application;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6478 frame->type = NGX_QUIC_FT_STREAM7; /* OFF=1 LEN=1 FIN=1 */
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6479 frame->u.stream.off = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6480 frame->u.stream.len = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6481 frame->u.stream.fin = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6482
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6483 frame->u.stream.type = frame->type;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6484 frame->u.stream.stream_id = qs->id;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6485 frame->u.stream.offset = c->sent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6486 frame->u.stream.length = 0;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6487
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6488 ngx_quic_queue_frame(qc, frame);
8293 1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	6489
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6490 done:
8703 d710c457171c QUIC: added ability to reset a stream. Sergey Kandaurov <pluknet@nginx.com> parents: 8702 diff changeset	6491
8293 1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 8290 diff changeset	6492 (void) ngx_quic_output(pc);
8724 fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6493
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6494 if (qc->shutdown) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6495 ngx_quic_shutdown_quic(pc);
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6496 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6497 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6498
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6499
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6500 static void
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6501 ngx_quic_shutdown_quic(ngx_connection_t *c)
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6502 {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6503 ngx_rbtree_t *tree;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6504 ngx_rbtree_node_t *node;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6505 ngx_quic_stream_t *qs;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6506 ngx_quic_connection_t *qc;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6507
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6508 qc = ngx_quic_get_connection(c);
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6509
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6510 if (qc->closing) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6511 return;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6512 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6513
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6514 tree = &qc->streams.tree;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6515
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6516 if (tree->root != tree->sentinel) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6517 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6518 node;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6519 node = ngx_rbtree_next(tree, node))
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6520 {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6521 qs = (ngx_quic_stream_t *) node;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6522
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6523 if (!qs->cancelable) {
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6524 return;
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6525 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6526 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6527 }
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6528
fc64ab301bad QUIC: connection shutdown. Roman Arutyunyan <arut@nginx.com> parents: 8717 diff changeset	6529 ngx_quic_finalize_connection(c, qc->shutdown_code, qc->shutdown_reason);
8239 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6530 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6531
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 8237 diff changeset	6532
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6533 static ngx_quic_frame_t *
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6534 ngx_quic_alloc_frame(ngx_connection_t *c)
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6535 {
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6536 ngx_queue_t *q;
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6537 ngx_quic_frame_t *frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6538 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6539
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6540 qc = ngx_quic_get_connection(c);
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6541
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6542 if (!ngx_queue_empty(&qc->free_frames)) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6543
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6544 q = ngx_queue_head(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6545 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6546
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6547 ngx_queue_remove(&frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6548
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6549 #ifdef NGX_QUIC_DEBUG_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6550 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6551 "quic reuse frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6552 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6553
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6554 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6555 frame = ngx_pcalloc(c->pool, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6556 if (frame == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6557 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6558 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6559
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6560 #ifdef NGX_QUIC_DEBUG_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6561 ++qc->nframes;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6562
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6563 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6564 "quic alloc frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6565 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6566 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6567
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6568 ngx_memzero(frame, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6569
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6570 return frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6571 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6572
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6573
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6574 static void
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6575 ngx_quic_congestion_ack(ngx_connection_t c, ngx_quic_frame_t f)
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6576 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6577 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6578 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6579 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6580
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6581 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6582 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6583 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6584
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6585 qc = ngx_quic_get_connection(c);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6586 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6587
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6588 cg->in_flight -= f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6589
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6590 timer = f->last - cg->recovery_start;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6591
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6592 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6593 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	6594 "quic congestion ack recovery win:%uz ss:%z if:%uz",
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6595 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6596
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6597 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6598 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6599
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6600 if (cg->window < cg->ssthresh) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6601 cg->window += f->plen;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6602
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6603 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	6604 "quic congestion slow start win:%uz ss:%z if:%uz",
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6605 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6606
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6607 } else {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6608 cg->window += qc->tp.max_udp_payload_size * f->plen / cg->window;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6609
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6610 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	6611 "quic congestion avoidance win:%uz ss:%z if:%uz",
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6612 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6613 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6614
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6615 /* prevent recovery_start from wrapping */
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6616
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6617 timer = cg->recovery_start - ngx_current_msec + qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6618
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6619 if ((ngx_msec_int_t) timer < 0) {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6620 cg->recovery_start = ngx_current_msec - qc->tp.max_idle_timeout * 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6621 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6622 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6623
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6624
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6625 static void
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6626 ngx_quic_congestion_lost(ngx_connection_t c, ngx_quic_frame_t f)
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6627 {
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6628 ngx_msec_t timer;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6629 ngx_quic_congestion_t *cg;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6630 ngx_quic_connection_t *qc;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6631
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6632 if (f->plen == 0) {
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6633 return;
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6634 }
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6635
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6636 qc = ngx_quic_get_connection(c);
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6637 cg = &qc->congestion;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6638
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6639 cg->in_flight -= f->plen;
8612 b1676cd64dc9 QUIC: cleanup send context properly. Vladimir Homutov <vl@nginx.com> parents: 8611 diff changeset	6640 f->plen = 0;
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6641
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6642 timer = f->last - cg->recovery_start;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6643
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6644 if ((ngx_msec_int_t) timer <= 0) {
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6645 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	6646 "quic congestion lost recovery win:%uz ss:%z if:%uz",
8508 4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6647 cg->window, cg->ssthresh, cg->in_flight);
4604e6043657 QUIC: packet based bytes_in_flight accounting. Sergey Kandaurov <pluknet@nginx.com> parents: 8507 diff changeset	6648
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6649 return;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6650 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6651
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6652 cg->recovery_start = ngx_current_msec;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6653 cg->window /= 2;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6654
8415 125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	6655 if (cg->window < qc->tp.max_udp_payload_size * 2) {
125cbfa77013 Renamed max_packet_size to max_udp_payload_size, from draft-28. Sergey Kandaurov <pluknet@nginx.com> parents: 8413 diff changeset	6656 cg->window = qc->tp.max_udp_payload_size * 2;
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6657 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6658
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6659 cg->ssthresh = cg->window;
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6660
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6661 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
8623 8550b91e8e35 QUIC: added proper logging of special values. Vladimir Homutov <vl@nginx.com> parents: 8622 diff changeset	6662 "quic congestion lost win:%uz ss:%z if:%uz",
8364 eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6663 cg->window, cg->ssthresh, cg->in_flight);
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6664 }
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6665
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6666
eee307399229 QUIC basic congestion control. Roman Arutyunyan <arut@nginx.com> parents: 8363 diff changeset	6667 static void
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6668 ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6669 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6670 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6671
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6672 qc = ngx_quic_get_connection(c);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6673
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6674 if (frame->data) {
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6675 ngx_quic_free_bufs(c, frame->data);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6676 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6677
8308 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 8307 diff changeset	6678 ngx_queue_insert_head(&qc->free_frames, &frame->queue);
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6679
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6680 #ifdef NGX_QUIC_DEBUG_ALLOC
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6681 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
8359 2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6682 "quic free frame n:%ui", qc->nframes);
2f900ae486bc Debug cleanup. Vladimir Homutov <vl@nginx.com> parents: 8356 diff changeset	6683 #endif
8286 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 8285 diff changeset	6684 }
8626 e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6685
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6686
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6687 uint32_t
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6688 ngx_quic_version(ngx_connection_t *c)
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6689 {
8629 feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6690 uint32_t version;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6691 ngx_quic_connection_t *qc;
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6692
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6693 qc = ngx_quic_get_connection(c);
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6694
feec2cc762f6 QUIC: got rid of the c->quic field. Roman Arutyunyan <arut@nginx.com> parents: 8628 diff changeset	6695 version = qc->version;
8626 e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6696
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6697 return (version & 0xff000000) == 0xff000000 ? version & 0xff : version;
e0947c952d43 QUIC: multiple versions support in ALPN. Sergey Kandaurov <pluknet@nginx.com> parents: 8625 diff changeset	6698 }
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6699
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6700
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6701 static ngx_chain_t *
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6702 ngx_quic_alloc_buf(ngx_connection_t *c)
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6703 {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6704 ngx_buf_t *b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6705 ngx_chain_t *cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6706 ngx_quic_connection_t *qc;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6707
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6708 qc = ngx_quic_get_connection(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6709
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6710 if (qc->free_bufs) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6711 cl = qc->free_bufs;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6712 qc->free_bufs = cl->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6713
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6714 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6715 b->pos = b->start;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6716 b->last = b->start;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6717
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6718 #ifdef NGX_QUIC_DEBUG_ALLOC
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6719 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6720 "quic reuse buffer n:%ui", qc->nbufs);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6721 #endif
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6722
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6723 return cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6724 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6725
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6726 cl = ngx_alloc_chain_link(c->pool);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6727 if (cl == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6728 return NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6729 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6730
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6731 b = ngx_create_temp_buf(c->pool, NGX_QUIC_BUFFER_SIZE);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6732 if (b == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6733 return NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6734 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6735
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6736 b->tag = (ngx_buf_tag_t) &ngx_quic_alloc_buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6737
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6738 cl->buf = b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6739
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6740 #ifdef NGX_QUIC_DEBUG_ALLOC
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6741 ++qc->nbufs;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6742
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6743 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6744 "quic alloc buffer n:%ui", qc->nbufs);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6745 #endif
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6746
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6747 return cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6748 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6749
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6750
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6751 static void
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6752 ngx_quic_free_bufs(ngx_connection_t c, ngx_chain_t in)
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6753 {
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6754 ngx_buf_t b, shadow;
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6755 ngx_chain_t *cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6756 ngx_quic_connection_t *qc;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6757
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6758 qc = ngx_quic_get_connection(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6759
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6760 while (in) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6761 #ifdef NGX_QUIC_DEBUG_ALLOC
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6762 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6763 "quic free buffer n:%ui", qc->nbufs);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6764 #endif
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6765
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6766 cl = in;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6767 in = in->next;
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6768 b = cl->buf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6769
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6770 if (b->shadow) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6771 if (!b->last_shadow) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6772 b->recycled = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6773 ngx_free_chain(c->pool, cl);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6774 continue;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6775 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6776
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6777 do {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6778 shadow = b->shadow;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6779 b->shadow = qc->free_shadow_bufs;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6780 qc->free_shadow_bufs = b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6781 b = shadow;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6782 } while (b->recycled);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6783
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6784 if (b->shadow) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6785 b->last_shadow = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6786 ngx_free_chain(c->pool, cl);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6787 continue;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6788 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6789
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6790 cl->buf = b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6791 }
8657 2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6792
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6793 cl->next = qc->free_bufs;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6794 qc->free_bufs = cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6795 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6796 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6797
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6798
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6799 static ngx_chain_t *
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6800 ngx_quic_copy_buf(ngx_connection_t c, u_char data, size_t len)
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6801 {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6802 size_t n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6803 ngx_buf_t *b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6804 ngx_chain_t cl, out, **ll;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6805
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6806 out = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6807 ll = &out;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6808
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6809 while (len) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6810 cl = ngx_quic_alloc_buf(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6811 if (cl == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6812 return NGX_CHAIN_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6813 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6814
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6815 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6816 n = ngx_min((size_t) (b->end - b->last), len);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6817
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6818 b->last = ngx_cpymem(b->last, data, n);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6819
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6820 data += n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6821 len -= n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6822
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6823 *ll = cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6824 ll = &cl->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6825 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6826
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6827 *ll = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6828
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6829 return out;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6830 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6831
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6832
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6833 static ngx_chain_t *
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6834 ngx_quic_copy_chain(ngx_connection_t c, ngx_chain_t in, size_t limit)
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6835 {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6836 size_t n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6837 ngx_buf_t *b;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6838 ngx_chain_t cl, out, **ll;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6839
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6840 out = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6841 ll = &out;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6842
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6843 while (in) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6844 if (!ngx_buf_in_memory(in->buf) \|\| ngx_buf_size(in->buf) == 0) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6845 in = in->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6846 continue;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6847 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6848
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6849 cl = ngx_quic_alloc_buf(c);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6850 if (cl == NULL) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6851 return NGX_CHAIN_ERROR;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6852 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6853
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6854 *ll = cl;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6855 ll = &cl->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6856
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6857 b = cl->buf;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6858
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6859 while (in && b->last != b->end) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6860
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6861 n = ngx_min(in->buf->last - in->buf->pos, b->end - b->last);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6862
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6863 if (limit > 0 && n > limit) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6864 n = limit;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6865 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6866
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6867 b->last = ngx_cpymem(b->last, in->buf->pos, n);
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6868
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6869 in->buf->pos += n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6870 if (in->buf->pos == in->buf->last) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6871 in = in->next;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6872 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6873
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6874 if (limit > 0) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6875 if (limit == n) {
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6876 goto done;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6877 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6878
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6879 limit -= n;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6880 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6881 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6882
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6883 }
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6884
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6885 done:
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6886
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6887 *ll = NULL;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6888
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6889 return out;
2dfc5ef29973 QUIC: introduced QUIC buffers. Roman Arutyunyan <arut@nginx.com> parents: 8656 diff changeset	6890 }
8658 0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6891
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6892
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6893 static ngx_chain_t *
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6894 ngx_quic_split_bufs(ngx_connection_t c, ngx_chain_t in, size_t len)
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6895 {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6896 size_t n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6897 ngx_buf_t *b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6898 ngx_chain_t *out;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6899 ngx_quic_connection_t *qc;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6900
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6901 qc = ngx_quic_get_connection(c);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6902
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6903 while (in) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6904 n = ngx_buf_size(in->buf);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6905
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6906 if (n == len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6907 out = in->next;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6908 in->next = NULL;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6909 return out;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6910 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6911
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6912 if (n > len) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6913 break;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6914 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6915
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6916 len -= n;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6917 in = in->next;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6918 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6919
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6920 if (in == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6921 return NULL;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6922 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6923
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6924 /* split in->buf by creating shadow bufs which reference it */
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6925
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6926 if (in->buf->shadow == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6927 if (qc->free_shadow_bufs) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6928 b = qc->free_shadow_bufs;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6929 qc->free_shadow_bufs = b->shadow;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6930
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6931 } else {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6932 b = ngx_alloc_buf(c->pool);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6933 if (b == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6934 return NGX_CHAIN_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6935 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6936 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6937
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6938 b = in->buf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6939 b->shadow = in->buf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6940 b->last_shadow = 1;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6941 in->buf = b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6942 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6943
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6944 out = ngx_alloc_chain_link(c->pool);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6945 if (out == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6946 return NGX_CHAIN_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6947 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6948
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6949 if (qc->free_shadow_bufs) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6950 b = qc->free_shadow_bufs;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6951 qc->free_shadow_bufs = b->shadow;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6952
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6953 } else {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6954 b = ngx_alloc_buf(c->pool);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6955 if (b == NULL) {
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6956 ngx_free_chain(c->pool, out);
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6957 return NGX_CHAIN_ERROR;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6958 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6959 }
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6960
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6961 out->buf = b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6962 out->next = in->next;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6963 in->next = NULL;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6964
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6965 b = in->buf;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6966 b->last_shadow = 0;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6967 b->pos = b->pos + len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6968
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6969 in->buf->shadow = b;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6970 in->buf->last = in->buf->pos + len;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6971
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6972 return out;
0af4ec6d1f92 QUIC: coalesce output packets into a single UDP datagram. Roman Arutyunyan <arut@nginx.com> parents: 8657 diff changeset	6973 }

Mercurial > hg > nginx

annotate src/event/quic/ngx_event_quic.c @ 8734:c61fcdc1b8e3 quic