123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363 |
- # Abstract
- This document describes a way to add origin authentication, message integrity,
- and replay resistance to HTTP REST requests. It is intended to be used over
- the HTTPS protocol.
- # Copyright Notice
- Copyright (c) 2011 Joyent, Inc. and the persons identified as document authors.
- All rights reserved.
- Code Components extracted from this document must include MIT License text.
- # Introduction
- This protocol is intended to provide a standard way for clients to sign HTTP
- requests. RFC2617 (HTTP Authentication) defines Basic and Digest authentication
- mechanisms, and RFC5246 (TLS 1.2) defines client-auth, both of which are widely
- employed on the Internet today. However, it is common place that the burdens of
- PKI prevent web service operators from deploying that methodology, and so many
- fall back to Basic authentication, which has poor security characteristics.
- Additionally, OAuth provides a fully-specified alternative for authorization
- of web service requests, but is not (always) ideal for machine to machine
- communication, as the key acquisition steps (generally) imply a fixed
- infrastructure that may not make sense to a service provider (e.g., symmetric
- keys).
- Several web service providers have invented their own schemes for signing
- HTTP requests, but to date, none have been placed in the public domain as a
- standard. This document serves that purpose. There are no techniques in this
- proposal that are novel beyond previous art, however, this aims to be a simple
- mechanism for signing these requests.
- # Signature Authentication Scheme
- The "signature" authentication scheme is based on the model that the client must
- authenticate itself with a digital signature produced by either a private
- asymmetric key (e.g., RSA) or a shared symmetric key (e.g., HMAC). The scheme
- is parameterized enough such that it is not bound to any particular key type or
- signing algorithm. However, it does explicitly assume that clients can send an
- HTTP `Date` header.
- ## Authorization Header
- The client is expected to send an Authorization header (as defined in RFC 2617)
- with the following parameterization:
- credentials := "Signature" params
- params := 1#(keyId | algorithm | [headers] | [ext] | signature)
- digitalSignature := plain-string
- keyId := "keyId" "=" <"> plain-string <">
- algorithm := "algorithm" "=" <"> plain-string <">
- headers := "headers" "=" <"> 1#headers-value <">
- ext := "ext" "=" <"> plain-string <">
- signature := "signature" "=" <"> plain-string <">
- headers-value := plain-string
- plain-string = 1*( %x20-21 / %x23-5B / %x5D-7E )
- ### Signature Parameters
- #### keyId
- REQUIRED. The `keyId` field is an opaque string that the server can use to look
- up the component they need to validate the signature. It could be an SSH key
- fingerprint, an LDAP DN, etc. Management of keys and assignment of `keyId` is
- out of scope for this document.
- #### algorithm
- REQUIRED. The `algorithm` parameter is used if the client and server agree on a
- non-standard digital signature algorithm. The full list of supported signature
- mechanisms is listed below.
- #### headers
- OPTIONAL. The `headers` parameter is used to specify the list of HTTP headers
- used to sign the request. If specified, it should be a quoted list of HTTP
- header names, separated by a single space character. By default, only one
- HTTP header is signed, which is the `Date` header. Note that the list MUST be
- specified in the order the values are concatenated together during signing. To
- include the HTTP request line in the signature calculation, use the special
- `request-line` value. While this is overloading the definition of `headers` in
- HTTP linguism, the request-line is defined in RFC 2616, and as the outlier from
- headers in useful signature calculation, it is deemed simpler to simply use
- `request-line` than to add a separate parameter for it.
- #### extensions
- OPTIONAL. The `extensions` parameter is used to include additional information
- which is covered by the request. The content and format of the string is out of
- scope for this document, and expected to be specified by implementors.
- #### signature
- REQUIRED. The `signature` parameter is a `Base64` encoded digital signature
- generated by the client. The client uses the `algorithm` and `headers` request
- parameters to form a canonicalized `signing string`. This `signing string` is
- then signed with the key associated with `keyId` and the algorithm
- corresponding to `algorithm`. The `signature` parameter is then set to the
- `Base64` encoding of the signature.
- ### Signing String Composition
- In order to generate the string that is signed with a key, the client MUST take
- the values of each HTTP header specified by `headers` in the order they appear.
- 1. If the header name is not `request-line` then append the lowercased header
- name followed with an ASCII colon `:` and an ASCII space ` `.
- 2. If the header name is `request-line` then append the HTTP request line,
- otherwise append the header value.
- 3. If value is not the last value then append an ASCII newline `\n`. The string
- MUST NOT include a trailing ASCII newline.
- # Example Requests
- All requests refer to the following request (body omitted):
- POST /foo HTTP/1.1
- Host: example.org
- Date: Tue, 07 Jun 2014 20:51:35 GMT
- Content-Type: application/json
- Digest: SHA-256=X48E9qOokqqrvdts8nOJRJN3OWDUoyWxBf7kbu9DBPE=
- Content-Length: 18
- The "rsa-key-1" keyId refers to a private key known to the client and a public
- key known to the server. The "hmac-key-1" keyId refers to key known to the
- client and server.
- ## Default parameterization
- The authorization header and signature would be generated as:
- Authorization: Signature keyId="rsa-key-1",algorithm="rsa-sha256",signature="Base64(RSA-SHA256(signing string))"
- The client would compose the signing string as:
- date: Tue, 07 Jun 2014 20:51:35 GMT
- ## Header List
- The authorization header and signature would be generated as:
- Authorization: Signature keyId="rsa-key-1",algorithm="rsa-sha256",headers="(request-target) date content-type digest",signature="Base64(RSA-SHA256(signing string))"
- The client would compose the signing string as (`+ "\n"` inserted for
- readability):
- (request-target) post /foo + "\n"
- date: Tue, 07 Jun 2011 20:51:35 GMT + "\n"
- content-type: application/json + "\n"
- digest: SHA-256=Base64(SHA256(Body))
- ## Algorithm
- The authorization header and signature would be generated as:
- Authorization: Signature keyId="hmac-key-1",algorithm="hmac-sha1",signature="Base64(HMAC-SHA1(signing string))"
- The client would compose the signing string as:
- date: Tue, 07 Jun 2011 20:51:35 GMT
- # Signing Algorithms
- Currently supported algorithm names are:
- * rsa-sha1
- * rsa-sha256
- * rsa-sha512
- * dsa-sha1
- * hmac-sha1
- * hmac-sha256
- * hmac-sha512
- # Security Considerations
- ## Default Parameters
- Note the default parameterization of the `Signature` scheme is only safe if all
- requests are carried over a secure transport (i.e., TLS). Sending the default
- scheme over a non-secure transport will leave the request vulnerable to
- spoofing, tampering, replay/repudiation, and integrity violations (if using the
- STRIDE threat-modeling methodology).
- ## Insecure Transports
- If sending the request over plain HTTP, service providers SHOULD require clients
- to sign ALL HTTP headers, and the `request-line`. Additionally, service
- providers SHOULD require `Content-MD5` calculations to be performed to ensure
- against any tampering from clients.
- ## Nonces
- Nonces are out of scope for this document simply because many service providers
- fail to implement them correctly, or do not adopt security specifications
- because of the infrastructure complexity. Given the `header` parameterization,
- a service provider is fully enabled to add nonce semantics into this scheme by
- using something like an `x-request-nonce` header, and ensuring it is signed
- with the `Date` header.
- ## Clock Skew
- As the default scheme is to sign the `Date` header, service providers SHOULD
- protect against logged replay attacks by enforcing a clock skew. The server
- SHOULD be synchronized with NTP, and the recommendation in this specification
- is to allow 300s of clock skew (in either direction).
- ## Required Headers to Sign
- It is out of scope for this document to dictate what headers a service provider
- will want to enforce, but service providers SHOULD at minimum include the
- `Date` header.
- # References
- ## Normative References
- * [RFC2616] Hypertext Transfer Protocol -- HTTP/1.1
- * [RFC2617] HTTP Authentication: Basic and Digest Access Authentication
- * [RFC5246] The Transport Layer Security (TLS) Protocol Version 1.2
- ## Informative References
- Name: Mark Cavage (editor)
- Company: Joyent, Inc.
- Email: mark.cavage@joyent.com
- URI: http://www.joyent.com
- # Appendix A - Test Values
- The following test data uses the RSA (1024b) keys, which we will refer
- to as `keyId=Test` in the following samples:
- -----BEGIN PUBLIC KEY-----
- MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDCFENGw33yGihy92pDjZQhl0C3
- 6rPJj+CvfSC8+q28hxA161QFNUd13wuCTUcq0Qd2qsBe/2hFyc2DCJJg0h1L78+6
- Z4UMR7EOcpfdUE9Hf3m/hs+FUR45uBJeDK1HSFHD8bHKD6kv8FPGfJTotc+2xjJw
- oYi+1hqp1fIekaxsyQIDAQAB
- -----END PUBLIC KEY-----
- -----BEGIN RSA PRIVATE KEY-----
- MIICXgIBAAKBgQDCFENGw33yGihy92pDjZQhl0C36rPJj+CvfSC8+q28hxA161QF
- NUd13wuCTUcq0Qd2qsBe/2hFyc2DCJJg0h1L78+6Z4UMR7EOcpfdUE9Hf3m/hs+F
- UR45uBJeDK1HSFHD8bHKD6kv8FPGfJTotc+2xjJwoYi+1hqp1fIekaxsyQIDAQAB
- AoGBAJR8ZkCUvx5kzv+utdl7T5MnordT1TvoXXJGXK7ZZ+UuvMNUCdN2QPc4sBiA
- QWvLw1cSKt5DsKZ8UETpYPy8pPYnnDEz2dDYiaew9+xEpubyeW2oH4Zx71wqBtOK
- kqwrXa/pzdpiucRRjk6vE6YY7EBBs/g7uanVpGibOVAEsqH1AkEA7DkjVH28WDUg
- f1nqvfn2Kj6CT7nIcE3jGJsZZ7zlZmBmHFDONMLUrXR/Zm3pR5m0tCmBqa5RK95u
- 412jt1dPIwJBANJT3v8pnkth48bQo/fKel6uEYyboRtA5/uHuHkZ6FQF7OUkGogc
- mSJluOdc5t6hI1VsLn0QZEjQZMEOWr+wKSMCQQCC4kXJEsHAve77oP6HtG/IiEn7
- kpyUXRNvFsDE0czpJJBvL/aRFUJxuRK91jhjC68sA7NsKMGg5OXb5I5Jj36xAkEA
- gIT7aFOYBFwGgQAQkWNKLvySgKbAZRTeLBacpHMuQdl1DfdntvAyqpAZ0lY0RKmW
- G6aFKaqQfOXKCyWoUiVknQJAXrlgySFci/2ueKlIE1QqIiLSZ8V8OlpFLRnb1pzI
- 7U1yQXnTAEFYM560yJlzUpOb1V4cScGd365tiSMvxLOvTA==
- -----END RSA PRIVATE KEY-----
- And all examples use this request:
- <!-- httpreq -->
- POST /foo?param=value&pet=dog HTTP/1.1
- Host: example.com
- Date: Thu, 05 Jan 2014 21:31:40 GMT
- Content-Type: application/json
- Digest: SHA-256=X48E9qOokqqrvdts8nOJRJN3OWDUoyWxBf7kbu9DBPE=
- Content-Length: 18
- {"hello": "world"}
- <!-- /httpreq -->
- ### Default
- The string to sign would be:
- <!-- sign {"name": "Default", "options": {"keyId":"Test", "algorithm": "rsa-sha256"}} -->
- <!-- signstring -->
- date: Thu, 05 Jan 2014 21:31:40 GMT
- <!-- /signstring -->
- The Authorization header would be:
- <!-- authz -->
- Authorization: Signature keyId="Test",algorithm="rsa-sha256",headers="date",signature="jKyvPcxB4JbmYY4mByyBY7cZfNl4OW9HpFQlG7N4YcJPteKTu4MWCLyk+gIr0wDgqtLWf9NLpMAMimdfsH7FSWGfbMFSrsVTHNTk0rK3usrfFnti1dxsM4jl0kYJCKTGI/UWkqiaxwNiKqGcdlEDrTcUhhsFsOIo8VhddmZTZ8w="
- <!-- /authz -->
- ### All Headers
- Parameterized to include all headers, the string to sign would be (`+ "\n"`
- inserted for readability):
- <!-- sign {"name": "All Headers", "options": {"keyId":"Test", "algorithm": "rsa-sha256", "headers": ["(request-target)", "host", "date", "content-type", "digest", "content-length"]}} -->
- <!-- signstring -->
- (request-target): post /foo?param=value&pet=dog
- host: example.com
- date: Thu, 05 Jan 2014 21:31:40 GMT
- content-type: application/json
- digest: SHA-256=X48E9qOokqqrvdts8nOJRJN3OWDUoyWxBf7kbu9DBPE=
- content-length: 18
- <!-- /signstring -->
- The Authorization header would be:
- <!-- authz -->
- Authorization: Signature keyId="Test",algorithm="rsa-sha256",headers="(request-target) host date content-type digest content-length",signature="Ef7MlxLXoBovhil3AlyjtBwAL9g4TN3tibLj7uuNB3CROat/9KaeQ4hW2NiJ+pZ6HQEOx9vYZAyi+7cmIkmJszJCut5kQLAwuX+Ms/mUFvpKlSo9StS2bMXDBNjOh4Auj774GFj4gwjS+3NhFeoqyr/MuN6HsEnkvn6zdgfE2i0="
- <!-- /authz -->
- ## Generating and verifying signatures using `openssl`
- The `openssl` commandline tool can be used to generate or verify the signatures listed above.
- Compose the signing string as usual, and pipe it into the the `openssl dgst` command, then into `openssl enc -base64`, as follows:
- $ printf 'date: Thu, 05 Jan 2014 21:31:40 GMT' | \
- openssl dgst -binary -sign /path/to/private.pem -sha256 | \
- openssl enc -base64
- jKyvPcxB4JbmYY4mByyBY7cZfNl4OW9Hp...
- $
- The `-sha256` option is necessary to produce an `rsa-sha256` signature. You can select other hash algorithms such as `sha1` by changing this argument.
- To verify a signature, first save the signature data, Base64-decoded, into a file, then use `openssl dgst` again with the `-verify` option:
- $ echo 'jKyvPcxB4JbmYY4mByy...' | openssl enc -A -d -base64 > signature
- $ printf 'date: Thu, 05 Jan 2014 21:31:40 GMT' | \
- openssl dgst -sha256 -verify /path/to/public.pem -signature ./signature
- Verified OK
- $
- ## Generating and verifying signatures using `sshpk-sign`
- You can also generate and check signatures using the `sshpk-sign` tool which is
- included with the `sshpk` package in `npm`.
- Compose the signing string as above, and pipe it into `sshpk-sign` as follows:
- $ printf 'date: Thu, 05 Jan 2014 21:31:40 GMT' | \
- sshpk-sign -i /path/to/private.pem
- jKyvPcxB4JbmYY4mByyBY7cZfNl4OW9Hp...
- $
- This will produce an `rsa-sha256` signature by default, as you can see using
- the `-v` option:
- sshpk-sign: using rsa-sha256 with a 1024 bit key
- You can also use `sshpk-verify` in a similar manner:
- $ printf 'date: Thu, 05 Jan 2014 21:31:40 GMT' | \
- sshpk-verify -i ./public.pem -s 'jKyvPcxB4JbmYY...'
- OK
- $
|