http2
2022-11-07
HTTP2 protocol implementation
This is a (work in progress) implementation of HTTP/2 protocol as described in RFC9113 (and RFC7540 before) and RFC7541 (HPACK).
The core part of the library is implementing writing http2 frames, reading them,
and reacting on read frames. What to do with the frames is managed by classes
CONNECTION and HTTP2-STREAM that are supposed to be extended by application to
do something reasonable with headers and payload; see client.lisp or server.lisp
for an example.
0.1Status and quick start
In quicklisp. Tested primarily on sbcl, occasionally on ecl.Almost all parts of the listed standards implemented, see below for exceptions.
The library definitely allows to implement a client or server, and a simple ones are attached to it as examples.
0.1.1Client
The bundled client requests remote page and returns values of body (converted to string), result status, and response headers.
Improvements to allow for cookie management, ... are out of scope of this library, as they would probably be better taken over from some existing http/1.x library or incorporated there.
Improvements to query several resources on one server, and to receive pushes are considered for future, as they are http2 specific.
(ql:quickload 'http2/client)
(http2/client:retrieve-url "https://example.com")
<!doctype html>
<html>
<head>
<title>Example Domain</title>
<meta charset="utf-8" />
<meta http-equiv="Content-type" content="text/html; charset=utf-8" />
<meta name="viewport" conten...[sly-elided string of length 1256]"
"200"
(("content-length" . "1256") ("x-cache" . "HIT") ("vary" . "Accept-Encoding")
("server" . "ECS (bsa/EB24)")
("last-modified" . "Thu, 17 Oct 2019 07:18:26 GMT")
("expires" . "Thu, 16 Jun 2022 09:35:21 GMT")
("etag" . "\"3147526947+ident\"") ("date" . "Thu, 09 Jun 2022 09:35:21 GMT")
("content-type" . "text/html; charset=UTF-8")
("cache-control" . "max-age=604800") ("age" . "239205"))
0.1.2Server
Example https server (that indicates h2 support with ALPN) is provided ; TLS keyand certificate is needed (test script generates a pair when missing). Ithandles connections one by thread by default; this is trivial to improve inseveral ways (workers, polling...) with customizing*dispatch-fn* but for nowout of scope of this project. (ql:quickload 'http2/server)
(http2::create-server 1234 "key.pem" "cert.pem")
Then point your browser (not eww nor drakma, of course - must support http2) to https://localhost:1234 or
curl -k http://localhost:1234/
Customize PEER-ENDS-HTTP-STREAM to send something else (or process-end-headers if you do not want to see their data), and maybe add a method to ADD-HEADER to pay attention to what other headers than URL the client sends.
For simple cases, handlers can be defined to send data as text or binary streams, see sample server. Splitting the payload based on window size is done.
0.2Missing pieces
- No handling of priorities is implemented. This is OK, as these are onlysuggestions, and they are more or less dropped in RFC9113 anyway.
- Push promises are not implemented in the client. This is OK, they are disabledby default (settings)
- Option to encode headers to Literal Header Field Never Indexed format is notimplemented. This is simple to do, but interface would need to be though out.
- The algorithm to split data being sent out to windows and frames can beconfused sometimes
- The MAX-HEADER-LIST-SIZE limit is not enforced.
- Some checks on behaviour of the peer are not enforced
0.3Implementation details
See HACKING.org for the details.
0.4Dependencies
(to be reviewed)
The core library used trivial-gray-streams to implement streams over data frames.
Client and server require usocket and cl+ssl to talk over TLS, and bordeaux-threads for concurrency.
Client uses puri to manipulate URLs.
Server also uses cffi directly to check and confirm alpn. The sample server uses cl-who to create html; this is an arbitrary choice and your server can use anything else.
Additioanlly, fiasco is used for testing.
0.5License
Licensed by MIT license.Some comments are taken over from the RFCs above and copyrighted by RFC contributors. I read the copyright licenses for RFC that this is allowed.