nginx-quic: src/event/ngx_event

annotate src/event/ngx_event_quic.c @ 7822:6481427ca3fc quic

Respecting maximum packet size. The header size macros for long and short packets were fixed to provide correct values in bytes. Currently the sending code limits frames so they don't exceed max_packet_size. But it does not account the case when a single frame can exceed the limit. As a result of this patch, big payload (CRYPTO and STREAM) will be split into a number of smaller frames that fit into advertised max_packet_size (which specifies final packet size, after encryption).

author	Vladimir Homutov <vl@nginx.com>
date	Mon, 20 Apr 2020 22:25:22 +0300
parents	e0abe17a2878
children	4e4485793418

rev	line source
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	2 /*
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	3 * Copyright (C) Nginx, Inc.
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	4 */
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	5
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	6
7637 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	7 #include <ngx_config.h>
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	8 #include <ngx_core.h>
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	9 #include <ngx_event.h>
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	10
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	11
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	12 /* 0-RTT and 1-RTT data exist in the same packet number space,
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	13 * so we have 3 packet number spaces:
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	14 *
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	15 * 0 - Initial
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	16 * 1 - Handshake
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	17 * 2 - 0-RTT and 1-RTT
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	18 */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	19 #define ngx_quic_get_send_ctx(qc, level) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	20 ((level) == ssl_encryption_initial) ? &((qc)->send_ctx[0]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	21 : (((level) == ssl_encryption_handshake) ? &((qc)->send_ctx[1]) \
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	22 : &((qc)->send_ctx[2]))
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	23
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	24 #define NGX_QUIC_SEND_CTX_LAST (NGX_QUIC_ENCRYPTION_LAST - 1)
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	25
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	26 #define NGX_QUIC_STREAMS_INC 16
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	27 #define NGX_QUIC_STREAMS_LIMIT (1ULL < 60)
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	28
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	29 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	30 * 7.4. Cryptographic Message Buffering
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	31 * Implementations MUST support buffering at least 4096 bytes of data
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	32 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	33 #define NGX_QUIC_MAX_BUFFERED 65535
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	34
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	35
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	36 typedef enum {
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	37 NGX_QUIC_ST_INITIAL, /* connection just created */
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	38 NGX_QUIC_ST_HANDSHAKE, /* handshake started */
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	39 NGX_QUIC_ST_EARLY_DATA, /* handshake in progress */
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	40 NGX_QUIC_ST_APPLICATION /* handshake complete */
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	41 } ngx_quic_state_t;
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	42
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	43
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	44 typedef struct {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	45 ngx_rbtree_t tree;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	46 ngx_rbtree_node_t sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	47 ngx_connection_handler_pt handler;
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	48
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	49 ngx_uint_t id_counter;
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	50
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	51 uint64_t total_received;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	52 uint64_t max_data;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	53 } ngx_quic_streams_t;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	54
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	55
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	56 /*
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	57 * 12.3. Packet Numbers
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	58 *
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	59 * Conceptually, a packet number space is the context in which a packet
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	60 * can be processed and acknowledged. Initial packets can only be sent
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	61 * with Initial packet protection keys and acknowledged in packets which
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	62 * are also Initial packets.
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	63 */
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	64 typedef struct {
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	65 ngx_quic_secret_t client_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	66 ngx_quic_secret_t server_secret;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	67
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	68 uint64_t pnum; /* packet number to send */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	69 uint64_t largest_ack; /* number received from peer */
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	70 uint64_t largest_pn; /* number received from peer */
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	71
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	72 ngx_queue_t frames;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	73 ngx_queue_t sent;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	74 } ngx_quic_send_ctx_t;
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	75
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	76
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	77 struct ngx_quic_connection_s {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	78 ngx_str_t scid;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	79 ngx_str_t dcid;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	80 ngx_str_t token;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	81
7726 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	82 ngx_uint_t client_tp_done;
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	83 ngx_quic_tp_t tp;
7731 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	84 ngx_quic_tp_t ctp;
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	85
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	86 ngx_quic_state_t state;
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	87
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	88 ngx_quic_send_ctx_t send_ctx[NGX_QUIC_SEND_CTX_LAST];
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	89 ngx_quic_secrets_t keys[NGX_QUIC_ENCRYPTION_LAST];
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	90 ngx_quic_secrets_t next_key;
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	91 ngx_quic_frames_stream_t crypto[NGX_QUIC_ENCRYPTION_LAST];
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	92
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	93 ngx_ssl_t *ssl;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	94
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	95 ngx_event_t push;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	96 ngx_event_t retry;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	97 ngx_queue_t free_frames;
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	98
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	99 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	100 ngx_uint_t nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	101 #endif
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	102
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	103 ngx_quic_streams_t streams;
7703 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	104 ngx_uint_t max_data;
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	105
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	106 uint64_t cur_streams;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	107 uint64_t max_streams;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	108
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	109 unsigned send_timer_set:1;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	110 unsigned closing:1;
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	111 unsigned key_phase:1;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	112 };
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	113
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	114
7812 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	115 typedef ngx_int_t (ngx_quic_frame_handler_pt)(ngx_connection_t c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	116 ngx_quic_frame_t *frame);
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	117
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	118
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	119 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	120 static int ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	121 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	122 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	123 static int ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	124 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	125 const uint8_t *secret, size_t secret_len);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	126 #else
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	127 static int ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	128 enum ssl_encryption_level_t level, const uint8_t *read_secret,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	129 const uint8_t *write_secret, size_t secret_len);
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	130 #endif
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	131
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	132 static int ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	133 enum ssl_encryption_level_t level, const uint8_t *data, size_t len);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	134 static int ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	135 static int ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	136 enum ssl_encryption_level_t level, uint8_t alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	137
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	138
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	139 static ngx_int_t ngx_quic_new_connection(ngx_connection_t c, ngx_ssl_t ssl,
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	140 ngx_quic_tp_t tp, ngx_quic_header_t pkt,
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	141 ngx_connection_handler_pt handler);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	142 static ngx_int_t ngx_quic_init_connection(ngx_connection_t *c);
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	143 static void ngx_quic_input_handler(ngx_event_t *rev);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	144 static void ngx_quic_close_connection(ngx_connection_t *c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	145
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	146 static ngx_int_t ngx_quic_input(ngx_connection_t c, ngx_buf_t b);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	147 static ngx_int_t ngx_quic_initial_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	148 ngx_quic_header_t *pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	149 static ngx_int_t ngx_quic_handshake_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	150 ngx_quic_header_t *pkt);
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	151 static ngx_int_t ngx_quic_early_input(ngx_connection_t *c,
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	152 ngx_quic_header_t *pkt);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	153 static ngx_int_t ngx_quic_app_input(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	154 ngx_quic_header_t *pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	155 static ngx_int_t ngx_quic_payload_handler(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	156 ngx_quic_header_t *pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	157
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	158 static ngx_int_t ngx_quic_handle_ack_frame(ngx_connection_t *c,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	159 ngx_quic_header_t pkt, ngx_quic_ack_frame_t f);
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	160 static ngx_int_t ngx_quic_handle_ack_frame_range(ngx_connection_t *c,
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	161 ngx_quic_send_ctx_t *ctx, uint64_t min, uint64_t max);
7812 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	162
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	163 static ngx_int_t ngx_quic_handle_ordered_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	164 ngx_quic_frames_stream_t fs, ngx_quic_frame_t frame,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	165 ngx_quic_frame_handler_pt handler);
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	166 static ngx_int_t ngx_quic_adjust_frame_offset(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	167 ngx_quic_frame_t *f, uint64_t offset_in);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	168 static ngx_int_t ngx_quic_buffer_frame(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	169 ngx_quic_frames_stream_t stream, ngx_quic_frame_t f);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	170
7812 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	171 static ngx_int_t ngx_quic_handle_crypto_frame(ngx_connection_t *c,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	172 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	173 static ngx_int_t ngx_quic_crypto_input(ngx_connection_t *c,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	174 ngx_quic_frame_t *frame);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	175 static ngx_int_t ngx_quic_handle_stream_frame(ngx_connection_t *c,
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	176 ngx_quic_header_t pkt, ngx_quic_frame_t frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	177 static ngx_int_t ngx_quic_stream_input(ngx_connection_t *c,
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	178 ngx_quic_frame_t *frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	179
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	180 static ngx_int_t ngx_quic_handle_max_streams(ngx_connection_t *c);
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	181 static ngx_int_t ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	182 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f);
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	183 static ngx_int_t ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	184 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	185
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	186 static void ngx_quic_queue_frame(ngx_quic_connection_t *qc,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	187 ngx_quic_frame_t *frame);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	188
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	189 static ngx_int_t ngx_quic_output(ngx_connection_t *c);
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	190 static ngx_int_t ngx_quic_output_frames(ngx_connection_t *c,
7809 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	191 ngx_quic_send_ctx_t *ctx);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	192 static void ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	193 static ngx_int_t ngx_quic_send_frames(ngx_connection_t c, ngx_queue_t frames);
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	194
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	195 static void ngx_quic_set_packet_number(ngx_quic_header_t *pkt,
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	196 ngx_quic_send_ctx_t *ctx);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	197 static void ngx_quic_retransmit_handler(ngx_event_t *ev);
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	198 static ngx_int_t ngx_quic_retransmit(ngx_connection_t *c,
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	199 ngx_quic_send_ctx_t ctx, ngx_msec_t waitp);
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	200 static void ngx_quic_push_handler(ngx_event_t *ev);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	201
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	202 static void ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	203 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel);
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	204 static ngx_quic_stream_t ngx_quic_find_stream(ngx_rbtree_t rbtree,
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	205 uint64_t id);
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	206 static ngx_quic_stream_t ngx_quic_create_stream(ngx_connection_t c,
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	207 uint64_t id, size_t rcvbuf_size);
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	208 static ssize_t ngx_quic_stream_recv(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	209 size_t size);
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	210 static ssize_t ngx_quic_stream_send(ngx_connection_t c, u_char buf,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	211 size_t size);
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	212 static void ngx_quic_stream_cleanup_handler(void *data);
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	213 static ngx_chain_t ngx_quic_stream_send_chain(ngx_connection_t c,
6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	214 ngx_chain_t *in, off_t limit);
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	215 static ngx_quic_frame_t ngx_quic_alloc_frame(ngx_connection_t c, size_t size);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	216 static void ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame);
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	217
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	218
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	219 static SSL_QUIC_METHOD quic_method = {
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	220 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	221 ngx_quic_set_read_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	222 ngx_quic_set_write_secret,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	223 #else
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	224 ngx_quic_set_encryption_secrets,
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	225 #endif
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	226 ngx_quic_add_handshake_data,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	227 ngx_quic_flush_flight,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	228 ngx_quic_send_alert,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	229 };
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	230
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	231
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	232 #if BORINGSSL_API_VERSION >= 10
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	233
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	234 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	235 ngx_quic_set_read_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	236 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	237 const uint8_t *rsecret, size_t secret_len)
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	238 {
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	239 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	240 ngx_quic_secrets_t *keys;
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	241
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	242 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	243
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	244 ngx_quic_hexdump(c->log, "level:%d read secret",
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	245 rsecret, secret_len, level);
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	246
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	247 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	248
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	249 if (level == ssl_encryption_early_data) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	250 c->quic->state = NGX_QUIC_ST_EARLY_DATA;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	251 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	252
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	253 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	254 rsecret, secret_len,
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	255 &keys->client);
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	256 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	257
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	258
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	259 static int
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	260 ngx_quic_set_write_secret(ngx_ssl_conn_t *ssl_conn,
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	261 enum ssl_encryption_level_t level, const SSL_CIPHER *cipher,
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	262 const uint8_t *wsecret, size_t secret_len)
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	263 {
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	264 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	265 ngx_quic_secrets_t *keys;
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	266
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	267 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	268
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	269 ngx_quic_hexdump(c->log, "level:%d write secret",
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	270 wsecret, secret_len, level);
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	271
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	272 keys = &c->quic->keys[level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	273
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	274 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	275 wsecret, secret_len,
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	276 &keys->server);
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	277 }
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	278
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	279 #else
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	280
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	281 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	282 ngx_quic_set_encryption_secrets(ngx_ssl_conn_t *ssl_conn,
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	283 enum ssl_encryption_level_t level, const uint8_t *rsecret,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	284 const uint8_t *wsecret, size_t secret_len)
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	285 {
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	286 ngx_int_t rc;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	287 ngx_connection_t *c;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	288 ngx_quic_secrets_t *keys;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	289
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	290 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	291
7688 bec4cd55361e Fixed a typo with OpenSSL. Vladimir Homutov <vl@nginx.com> parents: 7687 diff changeset	292 ngx_quic_hexdump(c->log, "level:%d read", rsecret, secret_len, level);
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	293
7793 0ae50d90658a Fixed build with OpenSSL using old callbacks API. Sergey Kandaurov <pluknet@nginx.com> parents: 7792 diff changeset	294 keys = &c->quic->keys[level];
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	295
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	296 rc = ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	297 rsecret, secret_len,
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	298 &keys->client);
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	299 if (rc != 1) {
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	300 return rc;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	301 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	302
7769 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	303 if (level == ssl_encryption_early_data) {
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	304 c->quic->state = NGX_QUIC_ST_EARLY_DATA;
7769 2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	305 return 1;
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	306 }
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	307
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	308 ngx_quic_hexdump(c->log, "level:%d write", wsecret, secret_len, level);
2ac03e80d013 TLS Early Data key derivation support. Sergey Kandaurov <pluknet@nginx.com> parents: 7768 diff changeset	309
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	310 return ngx_quic_set_encryption_secret(c->pool, ssl_conn, level,
69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	311 wsecret, secret_len,
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	312 &keys->server);
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	313 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	314
7670 9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	315 #endif
9e0c30e1f7fb Compatibility with BoringSSL revised QUIC encryption secret APIs. Sergey Kandaurov <pluknet@nginx.com> parents: 7669 diff changeset	316
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	317
7650 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	318 static int
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	319 ngx_quic_add_handshake_data(ngx_ssl_conn_t *ssl_conn,
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	320 enum ssl_encryption_level_t level, const uint8_t *data, size_t len)
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	321 {
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	322 u_char p, end;
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	323 size_t client_params_len, fsize, limit;
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	324 const uint8_t *client_params;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	325 ngx_quic_frame_t *frame;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	326 ngx_connection_t *c;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	327 ngx_quic_connection_t *qc;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	328 ngx_quic_frames_stream_t *fs;
7650 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	329
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	330 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	331 qc = c->quic;
ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	332
7652 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 7651 diff changeset	333 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 7651 diff changeset	334 "ngx_quic_add_handshake_data");
7650 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	335
7726 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	336 /* XXX: obtain client parameters after the handshake? */
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	337 if (!qc->client_tp_done) {
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	338
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	339 SSL_get_peer_quic_transport_params(ssl_conn, &client_params,
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	340 &client_params_len);
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	341
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	342 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	343 "SSL_get_peer_quic_transport_params(): params_len %ui",
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	344 client_params_len);
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	345
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	346 if (client_params_len != 0) {
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	347 p = (u_char *) client_params;
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	348 end = p + client_params_len;
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	349
7731 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	350 if (ngx_quic_parse_transport_params(p, end, &qc->ctp, c->log)
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	351 != NGX_OK)
7726 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	352 {
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	353 return NGX_ERROR;
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	354 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	355
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	356 if (qc->ctp.max_idle_timeout > 0
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	357 && qc->ctp.max_idle_timeout < qc->tp.max_idle_timeout)
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	358 {
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	359 qc->tp.max_idle_timeout = qc->ctp.max_idle_timeout;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	360 }
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	361
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	362 if (qc->ctp.max_packet_size < NGX_QUIC_MIN_INITIAL_SIZE
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	363 \|\| qc->ctp.max_packet_size > NGX_QUIC_DEFAULT_MAX_PACKET_SIZE)
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	364 {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	365 ngx_log_error(NGX_LOG_INFO, c->log, 0,
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	366 "maximum packet size is invalid");
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	367 return NGX_ERROR;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	368 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	369
7726 f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	370 qc->client_tp_done = 1;
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	371 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	372 }
f388c0ad3477 Added processing of client transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7725 diff changeset	373
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	374 /*
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	375 * we need to fit at least 1 frame into a packet, thus account head/tail;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	376 * 17 = 1 + 8x2 is max header for CRYPTO frame, with 1 byte for frame type
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	377 */
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	378 limit = qc->ctp.max_packet_size - NGX_QUIC_MAX_LONG_HEADER - 17
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	379 - EVP_GCM_TLS_TAG_LEN;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	380
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	381 fs = &qc->crypto[level];
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	382
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	383 p = (u_char *) data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	384 end = (u_char *) data + len;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	385
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	386 while (p < end) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	387
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	388 fsize = ngx_min(limit, (size_t) (end - p));
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	389
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	390 frame = ngx_quic_alloc_frame(c, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	391 if (frame == NULL) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	392 return 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	393 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	394
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	395 ngx_memcpy(frame->data, p, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	396
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	397 frame->level = level;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	398 frame->type = NGX_QUIC_FT_CRYPTO;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	399 frame->u.crypto.offset = fs->sent;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	400 frame->u.crypto.length = fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	401 frame->u.crypto.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	402
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	403 fs->sent += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	404 p += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	405
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	406 ngx_sprintf(frame->info, "crypto, generated by SSL len=%ui level=%d",
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	407 fsize, level);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	408
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	409 ngx_quic_queue_frame(qc, frame);
7652 0a2683df5f11 Implemented improved version of quic_output(). Vladimir Homutov <vl@nginx.com> parents: 7651 diff changeset	410 }
7650 ec1f84996990 Split frame and packet generation into separate steps. Vladimir Homutov <vl@nginx.com> parents: 7649 diff changeset	411
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	412 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	413 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	414
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	415
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	416 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	417 ngx_quic_flush_flight(ngx_ssl_conn_t *ssl_conn)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	418 {
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	419 ngx_connection_t *c;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	420
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	421 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	422
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	423 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "ngx_quic_flush_flight()");
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	424
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	425 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	426 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	427
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	428
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	429 static int
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	430 ngx_quic_send_alert(ngx_ssl_conn_t *ssl_conn, enum ssl_encryption_level_t level,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	431 uint8_t alert)
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	432 {
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	433 ngx_connection_t *c;
7701 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	434 ngx_quic_frame_t *frame;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	435
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	436 c = ngx_ssl_get_connection((ngx_ssl_conn_t *) ssl_conn);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	437
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	438 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	439 "ngx_quic_send_alert(), lvl=%d, alert=%d",
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	440 (int) level, (int) alert);
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	441
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	442 frame = ngx_quic_alloc_frame(c, 0);
7701 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	443 if (frame == NULL) {
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	444 return 0;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	445 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	446
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	447 frame->level = level;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	448 frame->type = NGX_QUIC_FT_CONNECTION_CLOSE;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	449 frame->u.close.error_code = 0x100 + alert;
7771 e35f824f644d Added missing debug description. Vladimir Homutov <vl@nginx.com> parents: 7770 diff changeset	450 ngx_sprintf(frame->info, "cc from send_alert level=%d", frame->level);
7701 552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	451
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	452 ngx_quic_queue_frame(c->quic, frame);
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	453
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	454 if (ngx_quic_output(c) != NGX_OK) {
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	455 return 0;
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	456 }
552d6868091b Implemented send_alert callback, CONNECTION_CLOSE writer. Sergey Kandaurov <pluknet@nginx.com> parents: 7700 diff changeset	457
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	458 return 1;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	459 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	460
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	461
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	462 void
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	463 ngx_quic_run(ngx_connection_t c, ngx_ssl_t ssl, ngx_quic_tp_t *tp,
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	464 ngx_connection_handler_pt handler)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	465 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	466 ngx_buf_t *b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	467 ngx_quic_header_t pkt;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	468
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	469 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic run");
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	470
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	471 c->log->action = "QUIC initialization";
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	472
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	473 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	474
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	475 b = c->buffer;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	476
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	477 pkt.log = c->log;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	478 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	479 pkt.data = b->start;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	480 pkt.len = b->last - b->start;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	481
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	482 if (ngx_quic_new_connection(c, ssl, tp, &pkt, handler) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	483 ngx_quic_close_connection(c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	484 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	485 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	486
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	487 ngx_add_timer(c->read, c->quic->tp.max_idle_timeout);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	488
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	489 c->read->handler = ngx_quic_input_handler;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	490
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	491 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	492 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	493
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	494
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	495 static ngx_int_t
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	496 ngx_quic_new_connection(ngx_connection_t c, ngx_ssl_t ssl, ngx_quic_tp_t *tp,
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	497 ngx_quic_header_t *pkt, ngx_connection_handler_pt handler)
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	498 {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	499 ngx_uint_t i;
7731 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	500 ngx_quic_tp_t *ctp;
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	501 ngx_quic_secrets_t *keys;
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	502 ngx_quic_send_ctx_t *ctx;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	503 ngx_quic_connection_t *qc;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	504 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	505
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	506 if (ngx_buf_size(pkt->raw) < NGX_QUIC_MIN_INITIAL_SIZE) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	507 ngx_log_error(NGX_LOG_INFO, c->log, 0, "too small UDP datagram");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	508 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	509 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	510
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	511 if (ngx_quic_parse_long_header(pkt) != NGX_OK) {
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	512 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	513 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	514
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	515 if (!ngx_quic_pkt_in(pkt->flags)) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	516 ngx_log_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	517 "invalid initial packet: 0x%xi", pkt->flags);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	518 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	519 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	520
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	521 if (ngx_quic_parse_initial_header(pkt) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	522 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	523 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	524
7741 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	525 c->log->action = "creating new quic connection";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	526
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	527 qc = ngx_pcalloc(c->pool, sizeof(ngx_quic_connection_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	528 if (qc == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	529 return NGX_ERROR;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	530 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	531
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	532 qc->state = NGX_QUIC_ST_INITIAL;
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	533
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	534 ngx_rbtree_init(&qc->streams.tree, &qc->streams.sentinel,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	535 ngx_quic_rbtree_insert_stream);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	536
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	537 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	538 ngx_queue_init(&qc->send_ctx[i].frames);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	539 ngx_queue_init(&qc->send_ctx[i].sent);
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	540 qc->send_ctx[i].largest_pn = (uint64_t) -1;
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	541 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	542
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	543 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	544 ngx_queue_init(&qc->crypto[i].frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	545 }
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	546
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	547 ngx_queue_init(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	548
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	549 qc->retry.log = c->log;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	550 qc->retry.data = c;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	551 qc->retry.handler = ngx_quic_retransmit_handler;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	552 qc->retry.cancelable = 1;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	553
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	554 qc->push.log = c->log;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	555 qc->push.data = c;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	556 qc->push.handler = ngx_quic_push_handler;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	557 qc->push.cancelable = 1;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	558
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	559 c->quic = qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	560 qc->ssl = ssl;
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	561 qc->tp = *tp;
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	562 qc->streams.handler = handler;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	563
7731 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	564 ctp = &qc->ctp;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	565 ctp->max_packet_size = NGX_QUIC_DEFAULT_MAX_PACKET_SIZE;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	566 ctp->ack_delay_exponent = NGX_QUIC_DEFAULT_ACK_DELAY_EXPONENT;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	567 ctp->max_ack_delay = NGX_QUIC_DEFAULT_MAX_ACK_DELAY;
d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	568
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	569 qc->streams.max_data = qc->tp.initial_max_data;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	570
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	571 qc->dcid.len = pkt->dcid.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	572 qc->dcid.data = ngx_pnalloc(c->pool, pkt->dcid.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	573 if (qc->dcid.data == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	574 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	575 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	576 ngx_memcpy(qc->dcid.data, pkt->dcid.data, qc->dcid.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	577
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	578 qc->scid.len = pkt->scid.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	579 qc->scid.data = ngx_pnalloc(c->pool, qc->scid.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	580 if (qc->scid.data == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	581 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	582 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	583 ngx_memcpy(qc->scid.data, pkt->scid.data, qc->scid.len);
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	584
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	585 qc->token.len = pkt->token.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	586 qc->token.data = ngx_pnalloc(c->pool, qc->token.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	587 if (qc->token.data == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	588 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	589 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	590 ngx_memcpy(qc->token.data, pkt->token.data, qc->token.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	591
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	592 keys = &c->quic->keys[ssl_encryption_initial];
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	593
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	594 if (ngx_quic_set_initial_secret(c->pool, &keys->client, &keys->server,
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	595 &qc->dcid)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	596 != NGX_OK)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	597 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	598 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	599 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	600
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	601 pkt->secret = &keys->client;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	602 pkt->level = ssl_encryption_initial;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	603 pkt->plaintext = buf;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	604
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	605 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	606
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	607 if (ngx_quic_decrypt(pkt, NULL, &ctx->largest_pn) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	608 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	609 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	610
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	611 if (ngx_quic_init_connection(c) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	612 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	613 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	614
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	615 if (ngx_quic_payload_handler(c, pkt) != NGX_OK) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	616 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	617 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	618
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	619 /* pos is at header end, adjust by actual packet length */
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	620 pkt->raw->pos += pkt->len;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	621
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	622 return ngx_quic_input(c, pkt->raw);
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	623 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	624
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	625
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	626 static ngx_int_t
7687 69345a26ba69 Split transport and crypto parts into separate files. Vladimir Homutov <vl@nginx.com> parents: 7686 diff changeset	627 ngx_quic_init_connection(ngx_connection_t *c)
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	628 {
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	629 int n, sslerr;
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	630 u_char *p;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	631 ssize_t len;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	632 ngx_ssl_conn_t *ssl_conn;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	633 ngx_quic_connection_t *qc;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	634
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	635 qc = c->quic;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	636
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	637 if (ngx_ssl_create_connection(qc->ssl, c, NGX_SSL_BUFFER) != NGX_OK) {
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	638 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	639 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	640
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	641 ssl_conn = c->ssl->connection;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	642
7698 253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	643 if (SSL_set_quic_method(ssl_conn, &quic_method) == 0) {
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	644 ngx_log_error(NGX_LOG_INFO, c->log, 0,
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	645 "SSL_set_quic_method() failed");
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	646 return NGX_ERROR;
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	647 }
253cf267f95a Moved setting QUIC methods to runtime. Roman Arutyunyan <arut@nginx.com> parents: 7697 diff changeset	648
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	649 #ifdef SSL_READ_EARLY_DATA_SUCCESS
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	650 if (SSL_CTX_get_max_early_data(qc->ssl->ctx)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	651 SSL_set_quic_early_data_enabled(ssl_conn, 1);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	652 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	653 #endif
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	654
7713 e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	655 len = ngx_quic_create_transport_params(NULL, NULL, &qc->tp);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	656 /* always succeeds */
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	657
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	658 p = ngx_pnalloc(c->pool, len);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	659 if (p == NULL) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	660 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	661 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	662
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	663 len = ngx_quic_create_transport_params(p, p + len, &qc->tp);
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	664 if (len < 0) {
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	665 return NGX_ERROR;
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	666 }
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	667
e9891e8ee975 Configurable transport parameters. Vladimir Homutov <vl@nginx.com> parents: 7712 diff changeset	668 if (SSL_set_quic_transport_params(ssl_conn, p, len) == 0) {
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	669 ngx_log_error(NGX_LOG_INFO, c->log, 0,
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	670 "SSL_set_quic_transport_params() failed");
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	671 return NGX_ERROR;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	672 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	673
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	674 qc->max_streams = qc->tp.initial_max_streams_bidi;
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	675 qc->state = NGX_QUIC_ST_HANDSHAKE;
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	676
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	677 n = SSL_do_handshake(ssl_conn);
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	678
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	679 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_do_handshake: %d", n);
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	680
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	681 if (n == -1) {
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	682 sslerr = SSL_get_error(ssl_conn, n);
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	683
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	684 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_get_error: %d",
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	685 sslerr);
7766 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	686
23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	687 if (sslerr != SSL_ERROR_WANT_READ) {
23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	688 ngx_ssl_error(NGX_LOG_ERR, c->log, 0, "SSL_do_handshake() failed");
23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	689 return NGX_ERROR;
23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	690 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	691 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	692
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	693 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	694 "SSL_quic_read_level: %d, SSL_quic_write_level: %d",
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	695 (int) SSL_quic_read_level(ssl_conn),
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	696 (int) SSL_quic_write_level(ssl_conn));
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	697
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	698 return NGX_OK;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	699 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	700
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	701
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	702 static void
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	703 ngx_quic_input_handler(ngx_event_t *rev)
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	704 {
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	705 ssize_t n;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	706 ngx_buf_t b;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	707 ngx_connection_t *c;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	708 ngx_quic_connection_t *qc;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	709 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	710
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	711 b.start = buf;
7731 d45325e90221 Limit output QUIC packets with client max_packet_size. Roman Arutyunyan <arut@nginx.com> parents: 7729 diff changeset	712 b.end = buf + sizeof(buf);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	713 b.pos = b.last = b.start;
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	714
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	715 c = rev->data;
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	716 qc = c->quic;
7677 6bc18966b8c1 Stream "connection" read/write methods. Vladimir Homutov <vl@nginx.com> parents: 7675 diff changeset	717
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	718 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, rev->log, 0, "quic input handler");
7678 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 7677 diff changeset	719
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	720 if (qc->closing) {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	721 ngx_quic_close_connection(c);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	722 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	723 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	724
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	725 if (rev->timedout) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	726 ngx_log_error(NGX_LOG_INFO, c->log, NGX_ETIMEDOUT, "client timed out");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	727 ngx_quic_close_connection(c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	728 return;
7678 e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 7677 diff changeset	729 }
e3c0b19a3a8a Implemented ngx_quic_stream_send_chain() method. Roman Arutyunyan <arut@nginx.com> parents: 7677 diff changeset	730
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	731 if (c->close) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	732 ngx_quic_close_connection(c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	733 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	734 }
7686 7ada2feeac18 Added processing of CONNECTION CLOSE frames. Vladimir Homutov <vl@nginx.com> parents: 7684 diff changeset	735
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	736 n = c->recv(c, b.start, b.end - b.start);
7681 38c0898b6df7 HTTP/3. Roman Arutyunyan <arut@nginx.com> parents: 7680 diff changeset	737
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	738 if (n == NGX_AGAIN) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	739 return;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	740 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	741
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	742 if (n == NGX_ERROR) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	743 c->read->eof = 1;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	744 ngx_quic_close_connection(c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	745 return;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	746 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	747
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	748 b.last += n;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	749
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	750 if (ngx_quic_input(c, &b) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	751 ngx_quic_close_connection(c);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	752 return;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	753 }
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	754
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	755 qc->send_timer_set = 0;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	756 ngx_add_timer(rev, qc->tp.max_idle_timeout);
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	757 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	758
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	759
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	760 static void
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	761 ngx_quic_close_connection(ngx_connection_t *c)
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	762 {
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	763 #if (NGX_DEBUG)
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	764 ngx_uint_t ns;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	765 #endif
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	766 ngx_uint_t i;
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	767 ngx_pool_t *pool;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	768 ngx_event_t *rev;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	769 ngx_rbtree_t *tree;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	770 ngx_rbtree_node_t *node;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	771 ngx_quic_stream_t *qs;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	772 ngx_quic_connection_t *qc;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	773
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	774 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "close quic connection");
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	775
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	776 qc = c->quic;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	777
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	778 if (qc) {
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	779
7788 d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	780 qc->closing = 1;
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	781 tree = &qc->streams.tree;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	782
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	783 if (tree->root != tree->sentinel) {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	784 if (c->read->timer_set) {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	785 ngx_del_timer(c->read);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	786 }
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	787
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	788 #if (NGX_DEBUG)
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	789 ns = 0;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	790 #endif
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	791
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	792 for (node = ngx_rbtree_min(tree->root, tree->sentinel);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	793 node;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	794 node = ngx_rbtree_next(tree, node))
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	795 {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	796 qs = (ngx_quic_stream_t *) node;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	797
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	798 rev = qs->c->read;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	799 rev->ready = 1;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	800 rev->pending_eof = 1;
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	801
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	802 ngx_post_event(rev, &ngx_posted_events);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	803
7788 d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	804 if (rev->timer_set) {
d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	805 ngx_del_timer(rev);
d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	806 }
d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	807
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	808 #if (NGX_DEBUG)
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	809 ns++;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	810 #endif
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	811 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	812
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	813 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	814 "quic connection has %ui active streams", ns);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	815
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	816 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	817 }
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	818
7813 739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	819 for (i = 0; i < NGX_QUIC_ENCRYPTION_LAST; i++) {
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	820 ngx_quic_free_frames(c, &qc->crypto[i].frames);
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	821 }
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	822
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	823 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	824 ngx_quic_free_frames(c, &qc->send_ctx[i].frames);
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	825 ngx_quic_free_frames(c, &qc->send_ctx[i].sent);
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	826 }
739f018225af Free remaining frames on connection close. Vladimir Homutov <vl@nginx.com> parents: 7812 diff changeset	827
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	828 if (qc->push.timer_set) {
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	829 ngx_del_timer(&qc->push);
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	830 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	831
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	832 if (qc->retry.timer_set) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	833 ngx_del_timer(&qc->retry);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	834 }
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	835 }
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	836
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	837 if (c->ssl) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	838 (void) ngx_ssl_shutdown(c);
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	839 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	840
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	841 #if (NGX_STAT_STUB)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	842 (void) ngx_atomic_fetch_add(ngx_stat_active, -1);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	843 #endif
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	844
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	845 c->destroyed = 1;
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	846
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	847 pool = c->pool;
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	848
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	849 ngx_close_connection(c);
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	850
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	851 ngx_destroy_pool(pool);
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	852 }
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	853
4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	854
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	855 static ngx_int_t
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	856 ngx_quic_input(ngx_connection_t c, ngx_buf_t b)
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	857 {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	858 u_char *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	859 ngx_int_t rc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	860 ngx_quic_header_t pkt;
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	861
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	862 p = b->pos;
7674 4ae9ac69ab93 HTTP/QUIC interface reworked. Vladimir Homutov <vl@nginx.com> parents: 7673 diff changeset	863
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	864 while (p < b->last) {
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	865 c->log->action = "processing quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	866
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	867 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	868 pkt.raw = b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	869 pkt.data = p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	870 pkt.len = b->last - p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	871 pkt.log = c->log;
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	872 pkt.flags = p[0];
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	873
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	874 if (pkt.flags == 0) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	875 /* XXX: no idea WTF is this, just ignore */
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	876 ngx_log_error(NGX_LOG_ALERT, c->log, 0, "FIREFOX: ZEROES");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	877 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	878 }
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	879
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	880 // TODO: check current state
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	881 if (ngx_quic_long_pkt(pkt.flags)) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	882
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	883 if (ngx_quic_pkt_in(pkt.flags)) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	884 rc = ngx_quic_initial_input(c, &pkt);
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	885
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	886 } else if (ngx_quic_pkt_hs(pkt.flags)) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	887 rc = ngx_quic_handshake_input(c, &pkt);
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	888
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	889 } else if (ngx_quic_pkt_zrtt(pkt.flags)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	890 rc = ngx_quic_early_input(c, &pkt);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	891
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	892 } else {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	893 ngx_log_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	894 "BUG: unknown quic state");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	895 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	896 }
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	897
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	898 } else {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	899 rc = ngx_quic_app_input(c, &pkt);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	900 }
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	901
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	902 if (rc == NGX_ERROR) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	903 return NGX_ERROR;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	904 }
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	905
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	906 /* NGX_OK \|\| NGX_DECLINED */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	907
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	908 /*
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	909 * we get NGX_DECLINED when there are no keys [yet] available
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	910 * to decrypt packet.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	911 * Instead of queueing it, we ignore it and rely on the sender's
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	912 * retransmission:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	913 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	914 * 12.2. Coalescing Packets:
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	915 *
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	916 * For example, if decryption fails (because the keys are
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	917 * not available or any other reason), the receiver MAY either
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	918 * discard or buffer the packet for later processing and MUST
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	919 * attempt to process the remaining packets.
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	920 */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	921
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	922 /* b->pos is at header end, adjust by actual packet length */
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	923 p = b->pos + pkt.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	924 b->pos = p; /* reset b->pos to the next packet start */
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	925 }
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	926
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	927 return NGX_OK;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	928 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	929
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	930
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	931 static ngx_int_t
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	932 ngx_quic_initial_input(ngx_connection_t c, ngx_quic_header_t pkt)
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	933 {
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	934 ngx_ssl_conn_t *ssl_conn;
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	935 ngx_quic_secrets_t *keys;
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	936 ngx_quic_send_ctx_t *ctx;
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	937 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	938
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	939 c->log->action = "processing initial quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	940
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	941 ssl_conn = c->ssl->connection;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	942
7690 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 7689 diff changeset	943 if (ngx_quic_parse_long_header(pkt) != NGX_OK) {
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	944 return NGX_ERROR;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	945 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	946
7690 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 7689 diff changeset	947 if (ngx_quic_parse_initial_header(pkt) != NGX_OK) {
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	948 return NGX_ERROR;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	949 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	950
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	951 keys = &c->quic->keys[ssl_encryption_initial];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	952
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	953 pkt->secret = &keys->client;
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	954 pkt->level = ssl_encryption_initial;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	955 pkt->plaintext = buf;
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	956
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	957 ctx = ngx_quic_get_send_ctx(c->quic, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	958
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	959 if (ngx_quic_decrypt(pkt, ssl_conn, &ctx->largest_pn) != NGX_OK) {
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	960 return NGX_ERROR;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	961 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	962
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	963 return ngx_quic_payload_handler(c, pkt);
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	964 }
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	965
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	966
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	967 static ngx_int_t
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	968 ngx_quic_handshake_input(ngx_connection_t c, ngx_quic_header_t pkt)
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	969 {
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	970 ngx_quic_secrets_t *keys;
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	971 ngx_quic_send_ctx_t *ctx;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	972 ngx_quic_connection_t *qc;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	973 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	974
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	975 c->log->action = "processing handshake quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	976
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	977 qc = c->quic;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	978
7787 e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	979 keys = &c->quic->keys[ssl_encryption_handshake];
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	980
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	981 if (keys->client.key.len == 0) {
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	982 ngx_log_error(NGX_LOG_INFO, c->log, 0,
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	983 "no read keys yet, packet ignored");
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	984 return NGX_DECLINED;
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	985 }
e45719a9b148 Discarding Handshake packets if no Handshake keys yet. Sergey Kandaurov <pluknet@nginx.com> parents: 7786 diff changeset	986
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	987 /* extract cleartext data into pkt */
7690 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 7689 diff changeset	988 if (ngx_quic_parse_long_header(pkt) != NGX_OK) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	989 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	990 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	991
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	992 if (pkt->dcid.len != qc->dcid.len) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	993 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic dcidl");
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	994 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	995 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	996
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	997 if (ngx_memcmp(pkt->dcid.data, qc->dcid.data, qc->dcid.len) != 0) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	998 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic dcid");
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	999 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1000 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1001
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1002 if (pkt->scid.len != qc->scid.len) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1003 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic scidl");
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1004 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1005 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1006
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1007 if (ngx_memcmp(pkt->scid.data, qc->scid.data, qc->scid.len) != 0) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1008 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic scid");
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1009 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1010 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1011
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1012 if (!ngx_quic_pkt_hs(pkt->flags)) {
7659 4355efde26d8 Added functions to decrypt long packets. Vladimir Homutov <vl@nginx.com> parents: 7658 diff changeset	1013 ngx_log_error(NGX_LOG_INFO, c->log, 0,
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1014 "invalid packet type: 0x%xi", pkt->flags);
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1015 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1016 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1017
7690 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 7689 diff changeset	1018 if (ngx_quic_parse_handshake_header(pkt) != NGX_OK) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1019 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1020 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1021
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1022 pkt->secret = &keys->client;
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1023 pkt->level = ssl_encryption_handshake;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	1024 pkt->plaintext = buf;
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1025
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1026 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1027
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1028 if (ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn) != NGX_OK) {
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1029 return NGX_ERROR;
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1030 }
b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1031
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1032 return ngx_quic_payload_handler(c, pkt);
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1033 }
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1034
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1035
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1036 static ngx_int_t
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1037 ngx_quic_early_input(ngx_connection_t c, ngx_quic_header_t pkt)
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1038 {
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1039 ngx_quic_secrets_t *keys;
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1040 ngx_quic_send_ctx_t *ctx;
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1041 ngx_quic_connection_t *qc;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1042 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1043
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1044 c->log->action = "processing early data quic packet";
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1045
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1046 qc = c->quic;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1047
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1048 /* extract cleartext data into pkt */
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1049 if (ngx_quic_parse_long_header(pkt) != NGX_OK) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1050 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1051 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1052
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1053 if (pkt->dcid.len != qc->dcid.len) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1054 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic dcidl");
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1055 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1056 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1057
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1058 if (ngx_memcmp(pkt->dcid.data, qc->dcid.data, qc->dcid.len) != 0) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1059 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic dcid");
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1060 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1061 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1062
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1063 if (pkt->scid.len != qc->scid.len) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1064 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic scidl");
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1065 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1066 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1067
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1068 if (ngx_memcmp(pkt->scid.data, qc->scid.data, qc->scid.len) != 0) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1069 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected quic scid");
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1070 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1071 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1072
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1073 if (!ngx_quic_pkt_zrtt(pkt->flags)) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1074 ngx_log_error(NGX_LOG_INFO, c->log, 0,
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1075 "invalid packet type: 0x%xi", pkt->flags);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1076 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1077 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1078
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1079 if (ngx_quic_parse_handshake_header(pkt) != NGX_OK) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1080 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1081 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1082
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1083 if (c->quic->state != NGX_QUIC_ST_EARLY_DATA) {
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1084 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unexpected 0-RTT packet");
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1085 return NGX_OK;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1086 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1087
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1088 keys = &c->quic->keys[ssl_encryption_early_data];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1089
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1090 pkt->secret = &keys->client;
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1091 pkt->level = ssl_encryption_early_data;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1092 pkt->plaintext = buf;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1093
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1094 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1095
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1096 if (ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn) != NGX_OK) {
7770 90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1097 return NGX_ERROR;
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1098 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1099
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1100 return ngx_quic_payload_handler(c, pkt);
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1101 }
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1102
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1103
90f94413177e TLS Early Data support. Sergey Kandaurov <pluknet@nginx.com> parents: 7769 diff changeset	1104 static ngx_int_t
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1105 ngx_quic_app_input(ngx_connection_t c, ngx_quic_header_t pkt)
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1106 {
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1107 ngx_int_t rc;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1108 ngx_quic_secrets_t keys, next, tmp;
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1109 ngx_quic_send_ctx_t *ctx;
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1110 ngx_quic_connection_t *qc;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	1111 static u_char buf[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1112
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1113 c->log->action = "processing application data quic packet";
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1114
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1115 qc = c->quic;
1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1116
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1117 keys = &c->quic->keys[ssl_encryption_application];
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1118 next = &c->quic->next_key;
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1119
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1120 if (keys->client.key.len == 0) {
7689 61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	1121 ngx_log_error(NGX_LOG_INFO, c->log, 0,
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	1122 "no read keys yet, packet ignored");
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	1123 return NGX_DECLINED;
61f9b873e2e7 Firefox fixes. Vladimir Homutov <vl@nginx.com> parents: 7688 diff changeset	1124 }
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1125
7690 ae35ccba7aa6 Extracted transport part of the code into separate file. Vladimir Homutov <vl@nginx.com> parents: 7689 diff changeset	1126 if (ngx_quic_parse_short_header(pkt, &qc->dcid) != NGX_OK) {
7651 6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 7650 diff changeset	1127 return NGX_ERROR;
6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 7650 diff changeset	1128 }
6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 7650 diff changeset	1129
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	1130 pkt->secret = &keys->client;
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1131 pkt->next = &next->client;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1132 pkt->key_phase = c->quic->key_phase;
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1133 pkt->level = ssl_encryption_application;
7754 ebd5c71b9f02 Got rid of memory allocation in decryption. Vladimir Homutov <vl@nginx.com> parents: 7752 diff changeset	1134 pkt->plaintext = buf;
7672 8d6ac639feac Added support of multiple QUIC packets in single datagram. Vladimir Homutov <vl@nginx.com> parents: 7671 diff changeset	1135
7816 aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1136 ctx = ngx_quic_get_send_ctx(qc, pkt->level);
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1137
aba84d9ab256 Parsing of truncated packet numbers. Sergey Kandaurov <pluknet@nginx.com> parents: 7815 diff changeset	1138 if (ngx_quic_decrypt(pkt, c->ssl->connection, &ctx->largest_pn) != NGX_OK) {
7665 1297dc83a6b9 Generic payload handler for quic packets. Vladimir Homutov <vl@nginx.com> parents: 7664 diff changeset	1139 return NGX_ERROR;
7651 6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 7650 diff changeset	1140 }
6a76d9657772 QUIC handshake final bits. Sergey Kandaurov <pluknet@nginx.com> parents: 7650 diff changeset	1141
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1142 /* switch keys on Key Phase change */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1143
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1144 if (pkt->key_update) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1145 c->quic->key_phase ^= 1;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1146
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1147 tmp = *keys;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1148 keys = next;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1149 *next = tmp;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1150 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1151
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1152 rc = ngx_quic_payload_handler(c, pkt);
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1153
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1154 if (rc == NGX_ERROR) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1155 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1156 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1157
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1158 /* generate next keys */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1159
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1160 if (pkt->key_update) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1161 if (ngx_quic_key_update(c, keys, next) != NGX_OK) {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1162 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1163 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1164 }
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1165
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1166 return rc;
7648 b28ea685a56e Moved all QUIC code into ngx_event_quic.c Vladimir Homutov <vl@nginx.com> parents: 7646 diff changeset	1167 }
7637 4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1168
4daf03d2bd0a OpenSSL compatibility. Sergey Kandaurov <pluknet@nginx.com> parents: diff changeset	1169
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1170 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1171 ngx_quic_payload_handler(ngx_connection_t c, ngx_quic_header_t pkt)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1172 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1173 u_char end, p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1174 ssize_t len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1175 ngx_uint_t ack_this, do_close;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1176 ngx_quic_frame_t frame, *ack_frame;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1177 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1178
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1179
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1180 qc = c->quic;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1181
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1182 p = pkt->payload.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1183 end = p + pkt->payload.len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1184
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1185 ack_this = 0;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1186 do_close = 0;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1187
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1188 while (p < end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1189
7741 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1190 c->log->action = "parsing frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1191
7706 1f002206a59b Added boundaries checks into frame parser. Vladimir Homutov <vl@nginx.com> parents: 7705 diff changeset	1192 len = ngx_quic_parse_frame(pkt, p, end, &frame);
7717 c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1193
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1194 if (len == NGX_DECLINED) {
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1195 /* TODO: handle protocol violation:
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1196 * such frame not allowed in this packet
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1197 */
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1198 return NGX_ERROR;
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1199 }
c217a907ce42 Added checks for permitted frame types. Vladimir Homutov <vl@nginx.com> parents: 7713 diff changeset	1200
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1201 if (len < 0) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1202 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1203 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1204
7741 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1205 c->log->action = "handling frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1206
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1207 p += len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1208
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1209 switch (frame.type) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1210
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1211 case NGX_QUIC_FT_ACK:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1212 if (ngx_quic_handle_ack_frame(c, pkt, &frame.u.ack) != NGX_OK) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1213 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1214 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1215
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1216 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1217
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1218 case NGX_QUIC_FT_CRYPTO:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1219
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1220 if (ngx_quic_handle_crypto_frame(c, pkt, &frame) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1221 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1222 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1223
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1224 ack_this = 1;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1225 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1226
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1227 case NGX_QUIC_FT_PADDING:
7791 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1228 /* no action required */
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1229 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1230
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1231 case NGX_QUIC_FT_PING:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1232 ack_this = 1;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1233 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1234
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1235 case NGX_QUIC_FT_CONNECTION_CLOSE:
7724 80d7144b1c38 Closing connection on NGX_QUIC_FT_CONNECTION_CLOSE. Sergey Kandaurov <pluknet@nginx.com> parents: 7718 diff changeset	1236 case NGX_QUIC_FT_CONNECTION_CLOSE2:
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1237 do_close = 1;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1238 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1239
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1240 case NGX_QUIC_FT_STREAM0:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1241 case NGX_QUIC_FT_STREAM1:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1242 case NGX_QUIC_FT_STREAM2:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1243 case NGX_QUIC_FT_STREAM3:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1244 case NGX_QUIC_FT_STREAM4:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1245 case NGX_QUIC_FT_STREAM5:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1246 case NGX_QUIC_FT_STREAM6:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1247 case NGX_QUIC_FT_STREAM7:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1248
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1249 if (ngx_quic_handle_stream_frame(c, pkt, &frame) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1250 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1251 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1252
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1253 ack_this = 1;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1254 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1255
7703 ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	1256 case NGX_QUIC_FT_MAX_DATA:
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	1257 c->quic->max_data = frame.u.max_data.max_data;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	1258 ack_this = 1;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	1259 break;
ff540f13d95d MAX_DATA frame parser/handler. Sergey Kandaurov <pluknet@nginx.com> parents: 7702 diff changeset	1260
7702 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 7701 diff changeset	1261 case NGX_QUIC_FT_STREAMS_BLOCKED:
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 7701 diff changeset	1262 case NGX_QUIC_FT_STREAMS_BLOCKED2:
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1263
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1264 if (ngx_quic_handle_streams_blocked_frame(c, pkt,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1265 &frame.u.streams_blocked)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1266 != NGX_OK)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1267 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1268 return NGX_ERROR;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1269 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1270
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1271 ack_this = 1;
7702 d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 7701 diff changeset	1272 break;
d3b26c3bea22 Added parsing of STREAMS BLOCKED frames. Vladimir Homutov <vl@nginx.com> parents: 7701 diff changeset	1273
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1274 case NGX_QUIC_FT_STREAM_DATA_BLOCKED:
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1275
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1276 if (ngx_quic_handle_stream_data_blocked_frame(c, pkt,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1277 &frame.u.stream_data_blocked)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1278 != NGX_OK)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1279 {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1280 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1281 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1282
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1283 ack_this = 1;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1284 break;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1285
7791 9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1286 case NGX_QUIC_FT_NEW_CONNECTION_ID:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1287 case NGX_QUIC_FT_RETIRE_CONNECTION_ID:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1288 case NGX_QUIC_FT_NEW_TOKEN:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1289 case NGX_QUIC_FT_RESET_STREAM:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1290 case NGX_QUIC_FT_STOP_SENDING:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1291 case NGX_QUIC_FT_PATH_CHALLENGE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1292 case NGX_QUIC_FT_PATH_RESPONSE:
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1293
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1294 /* TODO: handle */
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1295 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1296 "frame handler not implemented");
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1297 ack_this = 1;
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1298 break;
9b9d592c0da3 Ignore non-yet-implemented frames. Vladimir Homutov <vl@nginx.com> parents: 7788 diff changeset	1299
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1300 default:
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1301 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1302 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1303 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1304
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1305 if (p != end) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1306 ngx_log_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1307 "trailing garbage in payload: %ui bytes", end - p);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1308 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1309 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1310
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1311 if (do_close) {
7733 a8349cc72c64 Avoid using QUIC connection after CONNECTION_CLOSE. Roman Arutyunyan <arut@nginx.com> parents: 7732 diff changeset	1312 return NGX_DONE;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1313 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1314
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1315 if (ack_this == 0) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1316 /* do not ack packets with ACKs and PADDING */
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1317 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1318 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1319
7741 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1320 c->log->action = "generating acknowledgment";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	1321
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1322 // packet processed, ACK it now if required
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1323 // TODO: if (ack_required) ... - currently just ack each packet
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1324
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	1325 ack_frame = ngx_quic_alloc_frame(c, 0);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1326 if (ack_frame == NULL) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1327 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1328 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1329
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	1330 ack_frame->level = (pkt->level == ssl_encryption_early_data)
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	1331 ? ssl_encryption_application
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	1332 : pkt->level;
dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	1333
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1334 ack_frame->type = NGX_QUIC_FT_ACK;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1335 ack_frame->u.ack.largest = pkt->pn;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1336 /* only ack immediate packet ]*/
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1337 ack_frame->u.ack.first_range = 0;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1338
7773 dc7ac778aafe Introduced packet namespace in QUIC connection. Vladimir Homutov <vl@nginx.com> parents: 7772 diff changeset	1339 ngx_sprintf(ack_frame->info, "ACK for PN=%d from frame handler level=%d", pkt->pn, ack_frame->level);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1340 ngx_quic_queue_frame(qc, ack_frame);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1341
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	1342 return NGX_OK;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1343 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1344
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1345
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1346 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1347 ngx_quic_handle_ack_frame(ngx_connection_t c, ngx_quic_header_t pkt,
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1348 ngx_quic_ack_frame_t *ack)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1349 {
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1350 ssize_t n;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1351 u_char pos, end;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1352 uint64_t gap, range;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1353 ngx_uint_t i, min, max;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1354 ngx_quic_send_ctx_t *ctx;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1355
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1356 ctx = ngx_quic_get_send_ctx(c->quic, pkt->level);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1357
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1358 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1359 "ngx_quic_handle_ack_frame level %d", pkt->level);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1360
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1361 /*
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1362 * TODO: If any computed packet number is negative, an endpoint MUST
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1363 * generate a connection error of type FRAME_ENCODING_ERROR.
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1364 * (19.3.1)
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1365 */
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1366
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1367 if (ack->first_range > ack->largest) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1368 ngx_log_error(NGX_LOG_INFO, c->log, 0,
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1369 "invalid first range in ack frame");
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1370 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1371 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1372
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1373 min = ack->largest - ack->first_range;
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1374 max = ack->largest;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1375
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1376 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max) != NGX_OK) {
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1377 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1378 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1379
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1380 /* 13.2.3. Receiver Tracking of ACK Frames */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1381 if (ctx->largest_ack < max) {
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1382 ctx->largest_ack = max;
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1383 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1384 "updated largest received: %ui", max);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1385 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1386
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1387 pos = ack->ranges_start;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1388 end = ack->ranges_end;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1389
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1390 for (i = 0; i < ack->range_count; i++) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1391
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1392 n = ngx_quic_parse_ack_range(pkt, pos, end, &gap, &range);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1393 if (n == NGX_ERROR) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1394 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1395 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1396 pos += n;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1397
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1398 if (gap >= min) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1399 ngx_log_error(NGX_LOG_INFO, c->log, 0,
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1400 "invalid range %ui in ack frame", i);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1401 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1402 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1403
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1404 max = min - 1 - gap;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1405
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1406 if (range > max + 1) {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1407 ngx_log_error(NGX_LOG_INFO, c->log, 0,
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1408 "invalid range %ui in ack frame", i);
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1409 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1410 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1411
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1412 min = max - range + 1;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1413
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1414 if (ngx_quic_handle_ack_frame_range(c, ctx, min, max) != NGX_OK) {
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1415 return NGX_ERROR;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1416 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1417 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1418
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1419 return NGX_OK;
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1420 }
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1421
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1422
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1423 static ngx_int_t
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1424 ngx_quic_handle_ack_frame_range(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1425 uint64_t min, uint64_t max)
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1426 {
1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1427 ngx_uint_t found;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1428 ngx_queue_t *q;
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1429 ngx_quic_frame_t *f;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1430
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1431 found = 0;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1432
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1433 q = ngx_queue_head(&ctx->sent);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1434
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1435 while (q != ngx_queue_sentinel(&ctx->sent)) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1436
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1437 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1438
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1439 if (f->pnum >= min && f->pnum <= max) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1440 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1441 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1442 ngx_quic_free_frame(c, f);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1443 found = 1;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1444
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1445 } else {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1446 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1447 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1448 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1449
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1450 if (!found) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1451
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	1452 if (max <= ctx->pnum) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1453 /* duplicate ACK or ACK for non-ack-eliciting frame */
7792 1cdd53532309 ACK ranges processing. Vladimir Homutov <vl@nginx.com> parents: 7791 diff changeset	1454 return NGX_OK;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1455 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1456
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1457 ngx_log_error(NGX_LOG_INFO, c->log, 0,
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1458 "ACK for the packet not in sent queue ");
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1459 // TODO: handle error properly: PROTOCOL VIOLATION?
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1460 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1461 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	1462
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1463 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1464 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1465
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1466
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1467 static ngx_int_t
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1468 ngx_quic_handle_ordered_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1469 ngx_quic_frame_t *frame, ngx_quic_frame_handler_pt handler)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1470 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1471 size_t full_len;
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1472 ngx_int_t rc;
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1473 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1474 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1475
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1476 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1477
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1478 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1479 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1480 "out-of-order frame: expecting %ui got %ui",
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1481 fs->received, f->offset);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1482
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1483 return ngx_quic_buffer_frame(c, fs, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1484 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1485
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1486 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1487
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1488 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1489 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1490 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1491 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1492 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1493 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1494
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1495 /* intersecting data range, frame modified */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1496 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1497
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1498 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1499
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1500 rc = handler(c, frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1501 if (rc == NGX_ERROR) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1502 return NGX_ERROR;
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1503
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1504 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1505 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1506 return NGX_OK;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1507 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1508
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1509 /* rc == NGX_OK */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1510
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1511 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1512
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1513 /* now check the queue if we can continue with buffered frames */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1514
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1515 do {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1516 q = ngx_queue_head(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1517 if (q == ngx_queue_sentinel(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1518 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1519 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1520
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1521 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1522 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1523
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1524 if (f->offset > fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1525 /* gap found, nothing more to do */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1526 break;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1527 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1528
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1529 full_len = f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1530
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1531 if (f->offset < fs->received) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1532
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1533 if (ngx_quic_adjust_frame_offset(c, frame, fs->received)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1534 == NGX_DONE)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1535 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1536 /* old/duplicate data range */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1537 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1538 fs->total -= f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1539
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1540 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1541 "skipped buffered frame, total %ui", fs->total);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1542 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1543 continue;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1544 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1545
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1546 /* frame was adjusted, proceed to input */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1547 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1548
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1549 /* f->offset == fs->received */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1550
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1551 rc = handler(c, frame);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1552
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1553 if (rc == NGX_ERROR) {
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1554 return NGX_ERROR;
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1555
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1556 } else if (rc == NGX_DONE) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1557 /* handler destroyed stream, queue no longer exists */
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1558 return NGX_OK;
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1559 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1560
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1561 fs->received += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1562 fs->total -= full_len;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1563
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1564 ngx_queue_remove(q);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1565
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1566 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1567 "consumed buffered frame, total %ui", fs->total);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1568
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1569 ngx_quic_free_frame(c, frame);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1570
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1571 } while (1);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1572
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1573 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1574 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1575
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1576
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1577 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1578 ngx_quic_adjust_frame_offset(ngx_connection_t c, ngx_quic_frame_t frame,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1579 uint64_t offset_in)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1580 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1581 size_t tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1582 ngx_quic_ordered_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1583
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1584 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1585
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1586 tail = offset_in - f->offset;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1587
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1588 if (tail >= f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1589 /* range preceeding already received data or duplicate, ignore */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1590
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1591 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1592 "old or duplicate data in ordered frame, ignored");
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1593 return NGX_DONE;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1594 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1595
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1596 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1597 "adjusted ordered frame data start to expected offset");
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1598
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1599 /* intersecting range: adjust data size */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1600
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1601 f->offset += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1602 f->data += tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1603 f->length -= tail;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1604
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1605 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1606 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1607
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1608
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1609 static ngx_int_t
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1610 ngx_quic_buffer_frame(ngx_connection_t c, ngx_quic_frames_stream_t fs,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1611 ngx_quic_frame_t *frame)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1612 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1613 u_char *data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1614 ngx_queue_t *q;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1615 ngx_quic_frame_t dst, item;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1616 ngx_quic_ordered_frame_t f, df;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1617
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1618 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "ngx_quic_buffer_frame");
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1619
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1620 f = &frame->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1621
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1622 /* frame start offset is in the future, buffer it */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1623
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1624 /* check limit on total size used by all buffered frames, not actual data */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1625 if (NGX_QUIC_MAX_BUFFERED - fs->total < f->length) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1626 ngx_log_error(NGX_LOG_INFO, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1627 "ordered input buffer limit exceeded");
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1628 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1629 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1630
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1631 dst = ngx_quic_alloc_frame(c, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1632 if (dst == NULL) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1633 return NGX_ERROR;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1634 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1635
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1636 data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1637 ngx_memcpy(dst, frame, sizeof(ngx_quic_frame_t));
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1638 dst->data = data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1639
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1640 ngx_memcpy(dst->data, f->data, f->length);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1641
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1642 df = &dst->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1643 df->data = dst->data;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1644
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1645 fs->total += f->length;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1646
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1647 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1648 "ordered frame with unexpected offset: buffered, total %ui",
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1649 fs->total);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1650
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1651 /* TODO: do we need some timeout for this queue ? */
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1652
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1653 if (ngx_queue_empty(&fs->frames)) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1654 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1655 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1656 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1657
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1658 for (q = ngx_queue_last(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1659 q != ngx_queue_sentinel(&fs->frames);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1660 q = ngx_queue_prev(q))
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1661 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1662 item = ngx_queue_data(q, ngx_quic_frame_t, queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1663 f = &item->u.ord;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1664
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1665 if (f->offset < df->offset) {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1666 ngx_queue_insert_after(q, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1667 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1668 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1669 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1670
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1671 ngx_queue_insert_after(&fs->frames, &dst->queue);
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1672
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1673 return NGX_OK;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1674 }
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1675
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1676
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1677 static ngx_int_t
7812 76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1678 ngx_quic_handle_crypto_frame(ngx_connection_t c, ngx_quic_header_t pkt,
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1679 ngx_quic_frame_t *frame)
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1680 {
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1681 ngx_quic_connection_t *qc;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1682 ngx_quic_frames_stream_t *fs;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1683
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1684 qc = c->quic;
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1685 fs = &qc->crypto[pkt->level];
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1686
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1687 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_crypto_input);
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1688 }
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1689
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1690
76839f55bc48 Sorted functions and functions declarations. Vladimir Homutov <vl@nginx.com> parents: 7811 diff changeset	1691 static ngx_int_t
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1692 ngx_quic_crypto_input(ngx_connection_t c, ngx_quic_frame_t frame)
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1693 {
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1694 int sslerr;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1695 ssize_t n;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1696 ngx_ssl_conn_t *ssl_conn;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1697 ngx_quic_crypto_frame_t *f;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1698
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1699 f = &frame->u.crypto;
167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1700
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1701 ssl_conn = c->ssl->connection;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1702
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1703 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1704 "SSL_quic_read_level: %d, SSL_quic_write_level: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1705 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1706 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1707
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1708 if (!SSL_provide_quic_data(ssl_conn, SSL_quic_read_level(ssl_conn),
7810 167d32476737 Crypto buffer frames reordering. Vladimir Homutov <vl@nginx.com> parents: 7809 diff changeset	1709 f->data, f->length))
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1710 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1711 ngx_ssl_error(NGX_LOG_INFO, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1712 "SSL_provide_quic_data() failed");
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1713 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1714 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1715
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1716 n = SSL_do_handshake(ssl_conn);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1717
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1718 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_do_handshake: %d", n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1719
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1720 if (n == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1721 sslerr = SSL_get_error(ssl_conn, n);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1722
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1723 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "SSL_get_error: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1724 sslerr);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1725
7766 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	1726 if (sslerr != SSL_ERROR_WANT_READ) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1727 ngx_ssl_error(NGX_LOG_ERR, c->log, 0, "SSL_do_handshake() failed");
7766 23a2b5e7acc8 Improved SSL_do_handshake() error handling in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7765 diff changeset	1728 return NGX_ERROR;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1729 }
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1730
7768 76818c9cdd6f Sending HANDSHAKE_DONE just once with BoringSSL. Sergey Kandaurov <pluknet@nginx.com> parents: 7767 diff changeset	1731 } else if (n == 1 && !SSL_in_init(ssl_conn)) {
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1732 c->quic->state = NGX_QUIC_ST_APPLICATION;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1733
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1734 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
7765 4ad7d4272cd5 Style. Sergey Kandaurov <pluknet@nginx.com> parents: 7760 diff changeset	1735 "quic ssl cipher: %s", SSL_get_cipher(ssl_conn));
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1736
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1737 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0,
7765 4ad7d4272cd5 Style. Sergey Kandaurov <pluknet@nginx.com> parents: 7760 diff changeset	1738 "handshake completed successfully");
7739 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1739
7740 ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1740 #if (NGX_QUIC_DRAFT_VERSION >= 27)
ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1741 {
ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1742 ngx_quic_frame_t *frame;
ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1743
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	1744 frame = ngx_quic_alloc_frame(c, 0);
7739 cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1745 if (frame == NULL) {
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1746 return NGX_ERROR;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1747 }
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1748
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1749 /* 12.4 Frames and frame types, figure 8 */
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1750 frame->level = ssl_encryption_application;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1751 frame->type = NGX_QUIC_FT_HANDSHAKE_DONE;
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1752 ngx_sprintf(frame->info, "HANDSHAKE DONE on handshake completed");
cb75f194f1f0 Implemented sending HANDSHAKE_DONE frame after handshake. Vladimir Homutov <vl@nginx.com> parents: 7738 diff changeset	1753 ngx_quic_queue_frame(c->quic, frame);
7740 ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1754 }
ee53bfd8f9ed Added QUIC version check for sending HANDSHAKE_DONE frame. Vladimir Homutov <vl@nginx.com> parents: 7739 diff changeset	1755 #endif
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1756
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1757 /*
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1758 * Generating next keys before a key update is received.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1759 * See quic-tls 9.4 Header Protection Timing Side-Channels.
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1760 */
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1761
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1762 if (ngx_quic_key_update(c, &c->quic->keys[ssl_encryption_application],
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1763 &c->quic->next_key)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1764 != NGX_OK)
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1765 {
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1766 return NGX_ERROR;
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	1767 }
7729 1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1768 }
1295b293d09a Connection states code cleanup. Vladimir Homutov <vl@nginx.com> parents: 7726 diff changeset	1769
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1770 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1771 "SSL_quic_read_level: %d, SSL_quic_write_level: %d",
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1772 (int) SSL_quic_read_level(ssl_conn),
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1773 (int) SSL_quic_write_level(ssl_conn));
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1774
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1775 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1776 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1777
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1778
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1779 static ngx_int_t
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1780 ngx_quic_handle_stream_frame(ngx_connection_t c, ngx_quic_header_t pkt,
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1781 ngx_quic_frame_t *frame)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1782 {
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1783 size_t n;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1784 ngx_buf_t *b;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1785 ngx_event_t *rev;
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1786 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1787 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1788 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1789 ngx_quic_frames_stream_t *fs;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1790
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1791 qc = c->quic;
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1792 f = &frame->u.stream;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1793
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1794 sn = ngx_quic_find_stream(&qc->streams.tree, f->stream_id);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1795
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1796 if (sn == NULL) {
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1797 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "stream is new");
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1798
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1799 n = (f->stream_id & NGX_QUIC_STREAM_UNIDIRECTIONAL)
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1800 ? qc->tp.initial_max_stream_data_uni
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1801 : qc->tp.initial_max_stream_data_bidi_remote;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1802
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1803 if (n < NGX_QUIC_STREAM_BUFSIZE) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1804 n = NGX_QUIC_STREAM_BUFSIZE;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1805 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1806
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1807 if (n < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1808 ngx_log_error(NGX_LOG_INFO, c->log, 0, "no space in stream buffer");
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1809 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1810 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1811
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1812 /*
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1813 * TODO: check IDs are increasing ? create all lower-numbered?
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1814 *
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1815 * 2.1. Stream Types and Identifiers
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1816 *
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1817 * Within each type, streams are created with numerically increasing
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1818 * stream IDs. A stream ID that is used out of order results in all
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1819 * streams of that type with lower-numbered stream IDs also being
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1820 * opened.
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1821 */
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1822 sn = ngx_quic_create_stream(c, f->stream_id, n);
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1823 if (sn == NULL) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1824 return NGX_ERROR;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1825 }
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1826
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1827 rev = sn->c->read;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1828
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1829 if (f->offset == 0) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1830
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1831 b = sn->b;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1832 b->last = ngx_cpymem(b->last, f->data, f->length);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1833
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1834 sn->fs.received += f->length;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1835
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1836 rev->ready = 1;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1837
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1838 if (f->fin) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1839 rev->pending_eof = 1;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1840 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1841
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1842 } else {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1843 rev->ready = 0;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1844 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1845
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1846 if ((f->stream_id & NGX_QUIC_STREAM_UNIDIRECTIONAL) == 0) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1847 ngx_quic_handle_max_streams(c);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1848 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1849
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1850 qc->streams.handler(sn->c);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1851
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1852 if (f->offset == 0) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1853 return NGX_OK;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1854 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1855
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1856 /* out-of-order stream: proceed to buffering */
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1857 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1858
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1859 fs = &sn->fs;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1860
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1861 return ngx_quic_handle_ordered_frame(c, fs, frame, ngx_quic_stream_input);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1862 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1863
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1864
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1865 static ngx_int_t
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1866 ngx_quic_stream_input(ngx_connection_t c, ngx_quic_frame_t frame)
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1867 {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1868 ngx_buf_t *b;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1869 ngx_event_t *rev;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1870 ngx_quic_stream_t *sn;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1871 ngx_quic_connection_t *qc;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1872 ngx_quic_stream_frame_t *f;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1873
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1874 qc = c->quic;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1875
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1876 f = &frame->u.stream;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1877
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1878 sn = ngx_quic_find_stream(&qc->streams.tree, f->stream_id);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1879 if (sn == NULL) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1880 // TODO: possible?
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1881 // stream was deleted while in reordering queue ?
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1882 return NGX_ERROR;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1883 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1884
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1885 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "existing stream");
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1886
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1887 b = sn->b;
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1888
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1889 if ((size_t) ((b->pos - b->start) + (b->end - b->last)) < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1890 ngx_log_error(NGX_LOG_INFO, c->log, 0, "no space in stream buffer");
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1891 return NGX_ERROR;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1892 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1893
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1894 if ((size_t) (b->end - b->last) < f->length) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1895 b->last = ngx_movemem(b->start, b->pos, b->last - b->pos);
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1896 b->pos = b->start;
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1897 }
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1898
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	1899 b->last = ngx_cpymem(b->last, f->data, f->length);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1900
7760 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1901 rev = sn->c->read;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1902 rev->ready = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1903
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1904 if (f->fin) {
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1905 rev->pending_eof = 1;
32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	1906 }
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1907
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1908 if (rev->active) {
ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1909 rev->handler(rev);
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1910 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1911
7814 ab443e80d9e4 Create new stream immediately on receiving new stream id. Vladimir Homutov <vl@nginx.com> parents: 7813 diff changeset	1912 /* check if stream was destroyed by handler */
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1913 if (ngx_quic_find_stream(&qc->streams.tree, f->stream_id) == NULL) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1914 return NGX_DONE;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1915 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	1916
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1917 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1918 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1919
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	1920
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1921 static ngx_int_t
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1922 ngx_quic_handle_max_streams(ngx_connection_t *c)
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1923 {
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1924 ngx_quic_frame_t *frame;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1925 ngx_quic_connection_t *qc;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1926
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1927 qc = c->quic;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1928 qc->cur_streams++;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1929
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1930 if (qc->cur_streams + NGX_QUIC_STREAMS_INC / 2 < qc->max_streams) {
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1931 return NGX_OK;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1932 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1933
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1934 frame = ngx_quic_alloc_frame(c, 0);
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1935 if (frame == NULL) {
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1936 return NGX_ERROR;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1937 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1938
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1939 qc->max_streams = ngx_max(qc->max_streams + NGX_QUIC_STREAMS_INC,
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1940 NGX_QUIC_STREAMS_LIMIT);
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1941
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1942 frame->level = ssl_encryption_application;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1943 frame->type = NGX_QUIC_FT_MAX_STREAMS;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1944 frame->u.max_streams.limit = qc->max_streams;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1945 frame->u.max_streams.bidi = 1;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1946
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1947 ngx_sprintf(frame->info, "MAX_STREAMS limit:%d bidi:%d level=%d",
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1948 (int) frame->u.max_streams.limit,
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1949 (int) frame->u.max_streams.bidi,
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1950 frame->level);
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1951
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1952 ngx_quic_queue_frame(qc, frame);
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1953
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1954 return NGX_OK;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1955 }
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1956
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1957
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1958 static ngx_int_t
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1959 ngx_quic_handle_streams_blocked_frame(ngx_connection_t *c,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1960 ngx_quic_header_t pkt, ngx_quic_streams_blocked_frame_t f)
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1961 {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1962 ngx_quic_frame_t *frame;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1963
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	1964 frame = ngx_quic_alloc_frame(c, 0);
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1965 if (frame == NULL) {
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1966 return NGX_ERROR;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1967 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1968
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1969 frame->level = pkt->level;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1970 frame->type = NGX_QUIC_FT_MAX_STREAMS;
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1971 frame->u.max_streams.limit = ngx_max(f->limit * 2, NGX_QUIC_STREAMS_LIMIT);
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1972 frame->u.max_streams.bidi = f->bidi;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1973
7780 de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1974 c->quic->max_streams = frame->u.max_streams.limit;
de8981bf2dd5 Advertizing MAX_STREAMS (0x12) credit in advance. Sergey Kandaurov <pluknet@nginx.com> parents: 7778 diff changeset	1975
7711 a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1976 ngx_sprintf(frame->info, "MAX_STREAMS limit:%d bidi:%d level=%d",
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1977 (int) frame->u.max_streams.limit,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1978 (int) frame->u.max_streams.bidi,
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1979 frame->level);
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1980
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1981 ngx_quic_queue_frame(c->quic, frame);
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1982
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1983 return NGX_OK;
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1984 }
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1985
a14afe21e692 Double MAX_STREAMS on STREAMS_BLOCKED. Roman Arutyunyan <arut@nginx.com> parents: 7707 diff changeset	1986
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1987 static ngx_int_t
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1988 ngx_quic_handle_stream_data_blocked_frame(ngx_connection_t *c,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1989 ngx_quic_header_t pkt, ngx_quic_stream_data_blocked_frame_t f)
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1990 {
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	1991 size_t n;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	1992 ngx_buf_t *b;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	1993 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	1994 ngx_quic_stream_t *sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	1995 ngx_quic_connection_t *qc;
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1996
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1997 qc = c->quic;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1998 sn = ngx_quic_find_stream(&qc->streams.tree, f->id);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	1999
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2000 if (sn == NULL) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2001 ngx_log_error(NGX_LOG_INFO, c->log, 0, "unknown stream id:%uL", f->id);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2002 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2003 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2004
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2005 b = sn->b;
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2006 n = sn->fs.received + (b->pos - b->start) + (b->end - b->last);
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2007
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2008 frame = ngx_quic_alloc_frame(c, 0);
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2009 if (frame == NULL) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2010 return NGX_ERROR;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2011 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2012
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2013 frame->level = pkt->level;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2014 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2015 frame->u.max_stream_data.id = f->id;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2016 frame->u.max_stream_data.limit = n;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2017
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2018 ngx_sprintf(frame->info, "MAX_STREAM_DATA id:%d limit:%d level=%d",
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2019 (int) frame->u.max_stream_data.id,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2020 (int) frame->u.max_stream_data.limit,
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2021 frame->level);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2022
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2023 ngx_quic_queue_frame(c->quic, frame);
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2024
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2025 return NGX_OK;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2026 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2027
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2028
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2029 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2030 ngx_quic_queue_frame(ngx_quic_connection_t qc, ngx_quic_frame_t frame)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2031 {
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2032 ngx_quic_send_ctx_t *ctx;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2033
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2034 ctx = ngx_quic_get_send_ctx(qc, frame->level);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2035
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2036 ngx_queue_insert_tail(&ctx->frames, &frame->queue);
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2037
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2038 /* TODO: check PUSH flag on stream and call output */
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2039
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2040 if (!qc->push.timer_set && !qc->closing) {
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2041 ngx_add_timer(&qc->push, qc->tp.max_ack_delay);
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2042 }
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2043 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2044
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2045
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2046 static ngx_int_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2047 ngx_quic_output(ngx_connection_t *c)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2048 {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2049 ngx_uint_t i;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2050 ngx_quic_connection_t *qc;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2051
7741 19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	2052 c->log->action = "sending frames";
19660929e8ff Logging cleanup. Vladimir Homutov <vl@nginx.com> parents: 7740 diff changeset	2053
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2054 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2055
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2056 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
7809 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2057 if (ngx_quic_output_frames(c, &qc->send_ctx[i]) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2058 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2059 }
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2060 }
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2061
7788 d9bc33166361 Do not set timers after the connection is closed. Vladimir Homutov <vl@nginx.com> parents: 7787 diff changeset	2062 if (!qc->send_timer_set && !qc->closing) {
7737 8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	2063 qc->send_timer_set = 1;
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	2064 ngx_add_timer(c->read, qc->tp.max_idle_timeout);
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	2065 }
8e54a17dabee Respect QUIC max_idle_timeout. Roman Arutyunyan <arut@nginx.com> parents: 7736 diff changeset	2066
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2067 if (!qc->retry.timer_set && !qc->closing) {
7782 0dc0552335bd Removed unneccesary milliseconds conversion. Vladimir Homutov <vl@nginx.com> parents: 7781 diff changeset	2068 ngx_add_timer(&qc->retry, qc->tp.max_ack_delay);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2069 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2070
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2071 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2072 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2073
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2074
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2075 static ngx_int_t
7809 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2076 ngx_quic_output_frames(ngx_connection_t c, ngx_quic_send_ctx_t ctx)
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2077 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2078 size_t len, hlen, n;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2079 ngx_int_t rc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2080 ngx_queue_t *q, range;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2081 ngx_quic_frame_t *f;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2082 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2083
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2084 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2085
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2086 if (ngx_queue_empty(&ctx->frames)) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2087 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2088 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2089
7809 6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2090 q = ngx_queue_head(&ctx->frames);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2091 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2092
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2093 /* all frames in same send_ctx share same level */
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2094 hlen = (f->level == ssl_encryption_application) ? NGX_QUIC_MAX_SHORT_HEADER
6ad871b63422 Cleaned up magic numbers in ngx_quic_output_frames(). Vladimir Homutov <vl@nginx.com> parents: 7808 diff changeset	2095 : NGX_QUIC_MAX_LONG_HEADER;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2096 hlen += EVP_GCM_TLS_TAG_LEN;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2097
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2098 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2099 len = 0;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2100 ngx_queue_init(&range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2101
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2102 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2103 /* process group of frames that fits into packet */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2104 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2105
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2106 n = ngx_quic_create_frame(NULL, f);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2107
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2108 if (len && hlen + len + n > qc->ctp.max_packet_size) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2109 break;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2110 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2111
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2112 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2113
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2114 f->first = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2115
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2116 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2117 ngx_queue_insert_tail(&range, &f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2118
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2119 len += n;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2120
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2121 } while (q != ngx_queue_sentinel(&ctx->frames));
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2122
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2123 rc = ngx_quic_send_frames(c, &range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2124
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2125 if (rc == NGX_OK) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2126 /*
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2127 * frames are moved into the sent queue
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2128 * to wait for ack/be retransmitted
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2129 */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2130 ngx_queue_add(&ctx->sent, &range);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2131
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2132 } else if (rc == NGX_DONE) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2133
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2134 /* no ack is expected for this frames, can free them */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2135 ngx_quic_free_frames(c, &range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2136
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2137 } else {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2138 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2139 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2140
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2141 } while (q != ngx_queue_sentinel(&ctx->frames));
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2142
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2143 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2144 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2145
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2146
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2147 static void
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2148 ngx_quic_free_frames(ngx_connection_t c, ngx_queue_t frames)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2149 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2150 ngx_queue_t *q;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2151 ngx_quic_frame_t *f;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2152
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2153 do {
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2154 q = ngx_queue_head(frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2155
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2156 if (q == ngx_queue_sentinel(frames)) {
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2157 break;
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2158 }
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2159
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2160 ngx_queue_remove(q);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2161
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2162 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2163
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2164 ngx_quic_free_frame(c, f);
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2165 } while (1);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2166 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2167
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2168
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2169 /* pack a group of frames [start; end) into memory p and send as single packet */
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2170 static ngx_int_t
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2171 ngx_quic_send_frames(ngx_connection_t c, ngx_queue_t frames)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2172 {
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2173 ssize_t len;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2174 u_char *p;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2175 ngx_msec_t now;
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2176 ngx_str_t out, res;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2177 ngx_queue_t *q;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2178 ngx_quic_frame_t f, start;
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2179 ngx_quic_header_t pkt;
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	2180 ngx_quic_secrets_t *keys;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2181 ngx_quic_send_ctx_t *ctx;
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2182 ngx_quic_connection_t *qc;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2183 static ngx_str_t initial_token = ngx_null_string;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2184 static u_char src[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2185 static u_char dst[NGX_QUIC_DEFAULT_MAX_PACKET_SIZE];
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2186
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2187 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "ngx_quic_send_frames");
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2188
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2189 q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2190 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2191
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2192 ctx = ngx_quic_get_send_ctx(c->quic, start->level);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2193
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2194 ngx_memzero(&pkt, sizeof(ngx_quic_header_t));
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2195
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2196 p = src;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2197 out.data = src;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2198
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2199 for (q = ngx_queue_head(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2200 q != ngx_queue_sentinel(frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2201 q = ngx_queue_next(q))
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2202 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2203 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2204
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2205 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "frame: %s", f->info);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2206
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2207 len = ngx_quic_create_frame(p, f);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2208 if (len == -1) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2209 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2210 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2211
7778 053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 7777 diff changeset	2212 if (f->need_ack) {
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 7777 diff changeset	2213 pkt.need_ack = 1;
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 7777 diff changeset	2214 }
053fa468b044 Fixed missing propagation of need_ack flag from frames to packet. Vladimir Homutov <vl@nginx.com> parents: 7777 diff changeset	2215
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2216 p += len;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2217 f->pnum = ctx->pnum;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2218 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2219
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2220 if (start->level == ssl_encryption_initial) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2221 /* ack will not be sent in initial packets due to initial keys being
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2222 * discarded when handshake start.
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2223 * Thus consider initial packets as non-ack-eliciting
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2224 */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2225 pkt.need_ack = 0;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2226 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2227
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2228 out.len = p - out.data;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2229
7767 c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 7766 diff changeset	2230 while (out.len < 4) {
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 7766 diff changeset	2231 *p++ = NGX_QUIC_FT_PADDING;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 7766 diff changeset	2232 out.len++;
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 7766 diff changeset	2233 }
c9fbe9508e1f QUIC packet padding to fulfil header protection sample demands. Sergey Kandaurov <pluknet@nginx.com> parents: 7766 diff changeset	2234
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2235 ngx_log_debug3(NGX_LOG_DEBUG_EVENT, c->log, 0,
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2236 "packet ready: %ui bytes at level %d need_ack: %ui",
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2237 out.len, start->level, pkt.need_ack);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2238
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2239 qc = c->quic;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2240
7772 058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	2241 keys = &c->quic->keys[start->level];
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	2242
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	2243 pkt.secret = &keys->server;
058a5af7ddfc Refactored QUIC secrets storage. Vladimir Homutov <vl@nginx.com> parents: 7771 diff changeset	2244
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2245 if (start->level == ssl_encryption_initial) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2246 pkt.flags = NGX_QUIC_PKT_INITIAL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2247 pkt.token = initial_token;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2248
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2249 } else if (start->level == ssl_encryption_handshake) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2250 pkt.flags = NGX_QUIC_PKT_HANDSHAKE;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2251
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2252 } else {
7785 29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	2253 // TODO: macro, set FIXED bit
29354c6fc5f2 TLS Key Update in QUIC. Sergey Kandaurov <pluknet@nginx.com> parents: 7782 diff changeset	2254 pkt.flags = 0x40 \| (c->quic->key_phase ? NGX_QUIC_PKT_KPHASE : 0);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2255 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2256
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2257 ngx_quic_set_packet_number(&pkt, ctx);
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2258
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2259 pkt.log = c->log;
949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2260 pkt.level = start->level;
7821 e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 7820 diff changeset	2261 pkt.dcid = qc->scid;
e0abe17a2878 Removed source/destination swap from the function creating header. Vladimir Homutov <vl@nginx.com> parents: 7820 diff changeset	2262 pkt.scid = qc->dcid;
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2263 pkt.payload = out;
7751 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 7750 diff changeset	2264
7755 949b95e4d504 Merged ngx_quic_send_packet() into ngx_quic_send_frames(). Vladimir Homutov <vl@nginx.com> parents: 7754 diff changeset	2265 res.data = dst;
7751 f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 7750 diff changeset	2266
f85749b60e58 Removed memory allocations from encryption code. Vladimir Homutov <vl@nginx.com> parents: 7750 diff changeset	2267 if (ngx_quic_encrypt(&pkt, c->ssl->connection, &res) != NGX_OK) {
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2268 return NGX_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2269 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2270
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2271 ngx_quic_hexdump0(c->log, "packet to send", res.data, res.len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2272
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2273 len = c->send(c, res.data, res.len);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2274 if (len == NGX_ERROR \|\| (size_t) len != res.len) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2275 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2276 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2277
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2278 /* len == NGX_OK \|\| NGX_AGAIN */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2279 ctx->pnum++;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2280
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2281 now = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2282 start->last = now;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2283
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2284 return pkt.need_ack ? NGX_OK : NGX_DONE;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2285 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2286
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2287
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2288 static void
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2289 ngx_quic_set_packet_number(ngx_quic_header_t pkt, ngx_quic_send_ctx_t ctx)
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2290 {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2291 uint64_t delta;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2292
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2293 delta = ctx->pnum - ctx->largest_ack;
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2294 pkt->number = ctx->pnum;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2295
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2296 if (delta <= 0x7F) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2297 pkt->num_len = 1;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2298 pkt->trunc = ctx->pnum & 0xff;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2299
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2300 } else if (delta <= 0x7FFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2301 pkt->num_len = 2;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2302 pkt->flags \|= 0x1;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2303 pkt->trunc = ctx->pnum & 0xffff;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2304
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2305 } else if (delta <= 0x7FFFFF) {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2306 pkt->num_len = 3;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2307 pkt->flags \|= 0x2;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2308 pkt->trunc = ctx->pnum & 0xffffff;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2309
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2310 } else {
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2311 pkt->num_len = 4;
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2312 pkt->flags \|= 0x3;
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2313 pkt->trunc = ctx->pnum & 0xffffffff;
7781 fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2314 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2315 }
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2316
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2317
fdda518d10ba Proper handling of packet number in header. Vladimir Homutov <vl@nginx.com> parents: 7780 diff changeset	2318 static void
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2319 ngx_quic_retransmit_handler(ngx_event_t *ev)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2320 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2321 ngx_uint_t i;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2322 ngx_msec_t wait, nswait;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2323 ngx_connection_t *c;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2324 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2325
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2326 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0,
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2327 "retransmit timer");
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2328
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2329 c = ev->data;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2330 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2331
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2332 wait = 0;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2333
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2334 for (i = 0; i < NGX_QUIC_SEND_CTX_LAST; i++) {
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2335 if (ngx_quic_retransmit(c, &qc->send_ctx[i], &nswait) != NGX_OK) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2336 ngx_quic_close_connection(c);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2337 return;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2338 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2339
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2340 if (i == 0) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2341 wait = nswait;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2342
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2343 } else if (nswait > 0 && nswait < wait) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2344 wait = nswait;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2345 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2346 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2347
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2348 if (wait > 0) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2349 ngx_add_timer(&qc->retry, wait);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2350 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2351 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2352
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2353
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2354 static void
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2355 ngx_quic_push_handler(ngx_event_t *ev)
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2356 {
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2357 ngx_connection_t *c;
7775 7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2358
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2359 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, ev->log, 0, "push timer");
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2360
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2361 c = ev->data;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2362
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2363 if (ngx_quic_output(c) != NGX_OK) {
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2364 ngx_quic_close_connection(c);
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2365 return;
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2366 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2367 }
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2368
7ea2c68735f9 Output buffering. Vladimir Homutov <vl@nginx.com> parents: 7774 diff changeset	2369
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2370 static ngx_int_t
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2371 ngx_quic_retransmit(ngx_connection_t c, ngx_quic_send_ctx_t ctx,
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2372 ngx_msec_t *waitp)
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2373 {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2374 uint64_t pn;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2375 ngx_msec_t now, wait;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2376 ngx_queue_t *q, range;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2377 ngx_quic_frame_t f, start;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2378 ngx_quic_connection_t *qc;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2379
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2380 qc = c->quic;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2381
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2382 now = ngx_current_msec;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2383 wait = 0;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2384
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2385 if (ngx_queue_empty(&ctx->sent)) {
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2386 *waitp = 0;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2387 return NGX_OK;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2388 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2389
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2390 q = ngx_queue_head(&ctx->sent);
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2391 start = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2392 pn = start->pnum;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2393 f = start;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2394
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2395 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2396 ngx_queue_init(&range);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2397
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2398 /* send frames with same packet number to the wire */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2399 do {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2400 f = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2401
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2402 if (start->first + qc->tp.max_idle_timeout < now) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2403 ngx_log_error(NGX_LOG_ERR, c->log, 0,
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2404 "retransmission timeout");
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2405 return NGX_DECLINED;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2406 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2407
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2408 if (f->pnum != pn) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2409 break;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2410 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2411
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2412 q = ngx_queue_next(q);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2413
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2414 ngx_queue_remove(&f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2415 ngx_queue_insert_tail(&range, &f->queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2416
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2417 } while (q != ngx_queue_sentinel(&ctx->sent));
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2418
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2419 wait = start->last + qc->tp.max_ack_delay - now;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2420
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2421 if ((ngx_msec_int_t) wait > 0) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2422 break;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2423 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2424
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2425 /* NGX_DONE is impossible here, such frames don't get into this queue */
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2426 if (ngx_quic_send_frames(c, &range) != NGX_OK) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2427 return NGX_ERROR;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2428 }
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2429
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2430 /* move frames group to the end of queue */
7808 bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2431 ngx_queue_add(&ctx->sent, &range);
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2432
bda817d16cc2 Rename types and variables used for packet number space. Vladimir Homutov <vl@nginx.com> parents: 7794 diff changeset	2433 } while (q != ngx_queue_sentinel(&ctx->sent));
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2434
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2435 *waitp = wait;
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2436
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2437 return NGX_OK;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2438 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2439
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2440
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2441 ngx_connection_t *
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2442 ngx_quic_create_uni_stream(ngx_connection_t *c)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2443 {
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2444 ngx_uint_t id;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2445 ngx_quic_stream_t qs, sn;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2446 ngx_quic_connection_t *qc;
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2447
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2448 qs = c->qs;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2449 qc = qs->parent->quic;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2450
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2451 id = (qc->streams.id_counter << 2)
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2452 \| NGX_QUIC_STREAM_SERVER_INITIATED
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2453 \| NGX_QUIC_STREAM_UNIDIRECTIONAL;
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2454
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2455 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2456 "creating server uni stream #%ui id %ui",
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2457 qc->streams.id_counter, id);
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2458
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2459 qc->streams.id_counter++;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2460
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2461 sn = ngx_quic_create_stream(qs->parent, id, 0);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2462 if (sn == NULL) {
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2463 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2464 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2465
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2466 return sn->c;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2467 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2468
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2469
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2470 static void
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2471 ngx_quic_rbtree_insert_stream(ngx_rbtree_node_t *temp,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2472 ngx_rbtree_node_t node, ngx_rbtree_node_t sentinel)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2473 {
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2474 ngx_rbtree_node_t **p;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2475 ngx_quic_stream_t qn, qnt;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2476
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2477 for ( ;; ) {
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2478 qn = (ngx_quic_stream_t *) node;
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2479 qnt = (ngx_quic_stream_t *) temp;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2480
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2481 p = (qn->id < qnt->id) ? &temp->left : &temp->right;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2482
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2483 if (*p == sentinel) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2484 break;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2485 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2486
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2487 temp = *p;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2488 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2489
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2490 *p = node;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2491 node->parent = temp;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2492 node->left = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2493 node->right = sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2494 ngx_rbt_red(node);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2495 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2496
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2497
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2498 static ngx_quic_stream_t *
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2499 ngx_quic_find_stream(ngx_rbtree_t *rbtree, uint64_t id)
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2500 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2501 ngx_rbtree_node_t node, sentinel;
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2502 ngx_quic_stream_t *qn;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2503
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2504 node = rbtree->root;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2505 sentinel = rbtree->sentinel;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2506
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2507 while (node != sentinel) {
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2508 qn = (ngx_quic_stream_t *) node;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2509
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2510 if (id == qn->id) {
2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2511 return qn;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2512 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2513
7750 2935a11c55b6 Fixed QUIC stream insert and find. Roman Arutyunyan <arut@nginx.com> parents: 7748 diff changeset	2514 node = (id < qn->id) ? node->left : node->right;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2515 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2516
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2517 return NULL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2518 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2519
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2520
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2521 static ngx_quic_stream_t *
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2522 ngx_quic_create_stream(ngx_connection_t *c, uint64_t id, size_t rcvbuf_size)
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2523 {
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2524 ngx_log_t *log;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2525 ngx_pool_t *pool;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2526 ngx_quic_stream_t *sn;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2527 ngx_pool_cleanup_t *cln;
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2528
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2529 pool = ngx_create_pool(NGX_DEFAULT_POOL_SIZE, c->log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2530 if (pool == NULL) {
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2531 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2532 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2533
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2534 sn = ngx_pcalloc(pool, sizeof(ngx_quic_stream_t));
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2535 if (sn == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2536 ngx_destroy_pool(pool);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2537 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2538 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2539
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2540 sn->node.key = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2541 sn->parent = c;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2542 sn->id = id;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2543
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2544 sn->b = ngx_create_temp_buf(pool, rcvbuf_size);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2545 if (sn->b == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2546 ngx_destroy_pool(pool);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2547 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2548 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2549
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2550 ngx_queue_init(&sn->fs.frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2551
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2552 log = ngx_palloc(pool, sizeof(ngx_log_t));
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2553 if (log == NULL) {
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2554 ngx_destroy_pool(pool);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2555 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2556 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2557
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2558 log = c->log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2559 pool->log = log;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2560
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2561 sn->c = ngx_get_connection(-1, log);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2562 if (sn->c == NULL) {
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2563 ngx_destroy_pool(pool);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2564 return NULL;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2565 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2566
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2567 sn->c->qs = sn;
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2568 sn->c->pool = pool;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2569 sn->c->ssl = c->ssl;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2570 sn->c->sockaddr = c->sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2571 sn->c->listening = c->listening;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2572 sn->c->addr_text = c->addr_text;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2573 sn->c->local_sockaddr = c->local_sockaddr;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2574 sn->c->number = ngx_atomic_fetch_add(ngx_connection_counter, 1);
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2575
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2576 sn->c->recv = ngx_quic_stream_recv;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2577 sn->c->send = ngx_quic_stream_send;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2578 sn->c->send_chain = ngx_quic_stream_send_chain;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2579
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2580 sn->c->read->log = c->log;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2581 sn->c->write->log = c->log;
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2582
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2583 cln = ngx_pool_cleanup_add(pool, 0);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2584 if (cln == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2585 ngx_close_connection(sn->c);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2586 ngx_destroy_pool(pool);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2587 return NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2588 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2589
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2590 cln->handler = ngx_quic_stream_cleanup_handler;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2591 cln->data = sn->c;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2592
7748 4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2593 ngx_rbtree_insert(&c->quic->streams.tree, &sn->node);
4cf00c14f11a Safe QUIC stream creation. Roman Arutyunyan <arut@nginx.com> parents: 7747 diff changeset	2594
7695 cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2595 return sn;
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2596 }
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2597
cfc429911c0d Implemented creation of server unidirectional streams. Vladimir Homutov <vl@nginx.com> parents: 7691 diff changeset	2598
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2599 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2600 ngx_quic_stream_recv(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2601 {
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2602 ssize_t len;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2603 ngx_buf_t *b;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2604 ngx_event_t *rev;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2605 ngx_connection_t *pc;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2606 ngx_quic_frame_t *frame;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2607 ngx_quic_stream_t *qs;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2608 ngx_quic_connection_t *qc;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2609
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2610 qs = c->qs;
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2611 b = qs->b;
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2612 pc = qs->parent;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2613 qc = pc->quic;
7745 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2614 rev = c->read;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2615
7745 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2616 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2617 "quic recv: eof:%d, avail:%z",
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2618 rev->pending_eof, b->last - b->pos);
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2619
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2620 if (b->pos == b->last) {
7745 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2621 rev->ready = 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2622
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2623 if (rev->pending_eof) {
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2624 rev->eof = 1;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2625 return 0;
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2626 }
5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2627
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2628 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic recv() not ready");
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2629 return NGX_AGAIN;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2630 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2631
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2632 len = ngx_min(b->last - b->pos, (ssize_t) size);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2633
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2634 ngx_memcpy(buf, b->pos, len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2635
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2636 b->pos += len;
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2637 qc->streams.total_received += len;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2638
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2639 if (b->pos == b->last) {
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2640 b->pos = b->start;
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2641 b->last = b->start;
7760 32db41d603cd Fixed handling QUIC stream eof. Roman Arutyunyan <arut@nginx.com> parents: 7759 diff changeset	2642 rev->ready = rev->pending_eof;
7732 f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2643 }
f92e583fc256 Better flow control and buffering for QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7731 diff changeset	2644
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2645 ngx_log_debug2(NGX_LOG_DEBUG_EVENT, c->log, 0,
7745 5f223cdad40e Implemented eof in QUIC streams. Roman Arutyunyan <arut@nginx.com> parents: 7744 diff changeset	2646 "quic recv: %z of %uz", len, size);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2647
7815 0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2648 if (!rev->pending_eof) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2649 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2650 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2651 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2652 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2653
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2654 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2655 frame->type = NGX_QUIC_FT_MAX_STREAM_DATA;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2656 frame->u.max_stream_data.id = qs->id;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2657 frame->u.max_stream_data.limit = qs->fs.received + (b->pos - b->start)
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2658 + (b->end - b->last);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2659
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2660 ngx_sprintf(frame->info, "MAX_STREAM_DATA id:%d limit:%d l=%d on recv",
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2661 (int) frame->u.max_stream_data.id,
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2662 (int) frame->u.max_stream_data.limit,
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2663 frame->level);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2664
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2665 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2666 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2667
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2668 if ((qc->streams.max_data / 2) < qc->streams.total_received) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2669
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2670 frame = ngx_quic_alloc_frame(pc, 0);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2671
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2672 if (frame == NULL) {
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2673 return NGX_ERROR;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2674 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2675
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2676 qc->streams.max_data *= 2;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2677
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2678 frame->level = ssl_encryption_application;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2679 frame->type = NGX_QUIC_FT_MAX_DATA;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2680 frame->u.max_data.max_data = qc->streams.max_data;
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2681
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2682 ngx_sprintf(frame->info, "MAX_DATA max_data:%d level=%d on recv",
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2683 (int) frame->u.max_data.max_data, frame->level);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2684
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2685 ngx_quic_queue_frame(pc->quic, frame);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2686
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2687 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2688 "quic recv: increased max data: %ui",
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2689 qc->streams.max_data);
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2690 }
0f9e9786b90d Added primitive flow control mechanisms. Vladimir Homutov <vl@nginx.com> parents: 7814 diff changeset	2691
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2692 return len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2693 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2694
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2695
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2696 static ssize_t
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2697 ngx_quic_stream_send(ngx_connection_t c, u_char buf, size_t size)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2698 {
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2699 u_char p, end;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2700 size_t fsize, limit;
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2701 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2702 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2703 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2704 ngx_quic_connection_t *qc;
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2705
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2706 qs = c->qs;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2707 pc = qs->parent;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2708 qc = pc->quic;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2709
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2710 if (qc->closing) {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2711 return NGX_ERROR;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2712 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2713
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2714 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic send: %uz", size);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2715
7822 6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2716 /*
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2717 * we need to fit at least 1 frame into a packet, thus account head/tail;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2718 * 25 = 1 + 8x3 is max header for STREAM frame, with 1 byte for frame type
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2719 */
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2720 limit = qc->ctp.max_packet_size - NGX_QUIC_MAX_SHORT_HEADER - 25
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2721 - EVP_GCM_TLS_TAG_LEN;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2722
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2723 p = (u_char *) buf;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2724 end = (u_char *) buf + size;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2725
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2726 while (p < end) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2727
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2728 fsize = ngx_min(limit, (size_t) (end - p));
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2729
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2730 frame = ngx_quic_alloc_frame(pc, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2731 if (frame == NULL) {
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2732 return 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2733 }
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2734
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2735 ngx_memcpy(frame->data, p, fsize);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2736
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2737 frame->level = ssl_encryption_application;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2738 frame->type = NGX_QUIC_FT_STREAM6; /* OFF=1 LEN=1 FIN=0 */
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2739 frame->u.stream.off = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2740 frame->u.stream.len = 1;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2741 frame->u.stream.fin = 0;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2742
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2743 frame->u.stream.type = frame->type;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2744 frame->u.stream.stream_id = qs->id;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2745 frame->u.stream.offset = c->sent;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2746 frame->u.stream.length = fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2747 frame->u.stream.data = frame->data;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2748
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2749 c->sent += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2750 p += fsize;
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2751
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2752 ngx_sprintf(frame->info, "stream %xi len=%ui level=%d",
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2753 qs->id, fsize, frame->level);
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2754
6481427ca3fc Respecting maximum packet size. Vladimir Homutov <vl@nginx.com> parents: 7821 diff changeset	2755 ngx_quic_queue_frame(qc, frame);
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2756 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2757
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2758 return size;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2759 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2760
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2761
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2762 static void
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2763 ngx_quic_stream_cleanup_handler(void *data)
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2764 {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2765 ngx_connection_t *c = data;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2766
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2767 ngx_connection_t *pc;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2768 ngx_quic_frame_t *frame;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2769 ngx_quic_stream_t *qs;
b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2770 ngx_quic_connection_t *qc;
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2771
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2772 qs = c->qs;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2773 pc = qs->parent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2774 qc = pc->quic;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2775
7747 618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2776 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic stream cleanup");
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2777
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2778 ngx_rbtree_delete(&qc->streams.tree, &qs->node);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2779
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2780 if (qc->closing) {
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2781 ngx_post_event(pc->read, &ngx_posted_events);
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2782 return;
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2783 }
618a65de08b3 When closing a QUIC connection, wait for all streams to finish. Roman Arutyunyan <arut@nginx.com> parents: 7746 diff changeset	2784
7811 72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2785 ngx_quic_free_frames(pc, &qs->fs.frames);
72d20158c814 Added reordering support for STREAM frames. Vladimir Homutov <vl@nginx.com> parents: 7810 diff changeset	2786
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2787 if ((qs->id & 0x03) == NGX_QUIC_STREAM_UNIDIRECTIONAL) {
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2788 /* do not send fin for client unidirectional streams */
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2789 return;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2790 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2791
7746 b364af7f9f3f Removed ngx_quic_stream_node_t. Roman Arutyunyan <arut@nginx.com> parents: 7745 diff changeset	2792 ngx_log_debug0(NGX_LOG_DEBUG_EVENT, c->log, 0, "quic send fin");
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2793
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2794 frame = ngx_quic_alloc_frame(pc, 0);
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2795 if (frame == NULL) {
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2796 return;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2797 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2798
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2799 frame->level = ssl_encryption_application;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2800 frame->type = NGX_QUIC_FT_STREAM7; /* OFF=1 LEN=1 FIN=1 */
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2801 frame->u.stream.off = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2802 frame->u.stream.len = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2803 frame->u.stream.fin = 1;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2804
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2805 frame->u.stream.type = frame->type;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2806 frame->u.stream.stream_id = qs->id;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2807 frame->u.stream.offset = c->sent;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2808 frame->u.stream.length = 0;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2809 frame->u.stream.data = NULL;
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2810
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2811 ngx_sprintf(frame->info, "stream %xi fin=1 level=%d", qs->id, frame->level);
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2812
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2813 ngx_quic_queue_frame(qc, frame);
7759 1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 7756 diff changeset	2814
1ec905f4d851 Push QUIC stream frames in send() and cleanup handler. Roman Arutyunyan <arut@nginx.com> parents: 7756 diff changeset	2815 (void) ngx_quic_output(pc);
7705 5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2816 }
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2817
5ad7bffd3850 Send a FIN frame when QUIC stream is closed. Roman Arutyunyan <arut@nginx.com> parents: 7703 diff changeset	2818
7691 714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2819 static ngx_chain_t *
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2820 ngx_quic_stream_send_chain(ngx_connection_t c, ngx_chain_t in,
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2821 off_t limit)
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2822 {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2823 size_t len;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2824 ssize_t n;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2825 ngx_buf_t *b;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2826
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2827 for ( /* void */; in; in = in->next) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2828 b = in->buf;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2829
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2830 if (!ngx_buf_in_memory(b)) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2831 continue;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2832 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2833
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2834 if (ngx_buf_size(b) == 0) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2835 continue;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2836 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2837
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2838 len = b->last - b->pos;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2839
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2840 n = ngx_quic_stream_send(c, b->pos, len);
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2841
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2842 if (n == NGX_ERROR) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2843 return NGX_CHAIN_ERROR;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2844 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2845
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2846 if (n == NGX_AGAIN) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2847 return in;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2848 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2849
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2850 if (n != (ssize_t) len) {
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2851 b->pos += n;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2852 return in;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2853 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2854 }
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2855
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2856 return NULL;
714a19dba6af Style and handlers. Vladimir Homutov <vl@nginx.com> parents: 7690 diff changeset	2857 }
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2858
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2859
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2860 static ngx_quic_frame_t *
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2861 ngx_quic_alloc_frame(ngx_connection_t *c, size_t size)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2862 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2863 u_char *p;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2864 ngx_queue_t *q;
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2865 ngx_quic_frame_t *frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2866 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2867
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2868 if (size) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2869 p = ngx_alloc(size, c->log);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2870 if (p == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2871 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2872 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2873
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2874 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2875 p = NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2876 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2877
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2878 qc = c->quic;
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2879
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2880 if (!ngx_queue_empty(&qc->free_frames)) {
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2881
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2882 q = ngx_queue_head(&qc->free_frames);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2883 frame = ngx_queue_data(q, ngx_quic_frame_t, queue);
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2884
e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2885 ngx_queue_remove(&frame->queue);
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2886
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2887 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2888 "reuse quic frame n:%ui", qc->nframes);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2889
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2890 } else {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2891 frame = ngx_pcalloc(c->pool, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2892 if (frame == NULL) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2893 ngx_free(p);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2894 return NULL;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2895 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2896
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2897 #if (NGX_DEBUG)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2898 ++qc->nframes;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2899 #endif
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2900
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2901 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2902 "alloc quic frame n:%ui", qc->nframes);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2903 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2904
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2905 ngx_memzero(frame, sizeof(ngx_quic_frame_t));
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2906
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2907 frame->data = p;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2908
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2909 return frame;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2910 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2911
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2912
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2913 static void
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2914 ngx_quic_free_frame(ngx_connection_t c, ngx_quic_frame_t frame)
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2915 {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2916 ngx_quic_connection_t *qc;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2917
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2918 qc = c->quic;
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2919
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2920 if (frame->data) {
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2921 ngx_free(frame->data);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2922 }
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2923
7774 e10b4c61420f Implemented retransmission and retransmit queue. Vladimir Homutov <vl@nginx.com> parents: 7773 diff changeset	2924 ngx_queue_insert_head(&qc->free_frames, &frame->queue);
7752 c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2925
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2926 ngx_log_debug1(NGX_LOG_DEBUG_EVENT, c->log, 0,
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2927 "free quic frame n:%ui", qc->nframes);
c7185bc5b4d9 QUIC frames reuse. Roman Arutyunyan <arut@nginx.com> parents: 7751 diff changeset	2928 }

Mercurial > hg > nginx-quic

annotate src/event/ngx_event_quic.c @ 7822:6481427ca3fc quic