Skip to content

Commit 224910a

Browse files
author
Mehakmeet Singh
committed
HADOOP-17705. white-space fix
1 parent 6e4e8ab commit 224910a

File tree

1 file changed

+8
-11
lines changed

1 file changed

+8
-11
lines changed

hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/troubleshooting_s3a.md

Lines changed: 8 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -249,27 +249,24 @@ As an example, the endpoint for S3 Frankfurt is `s3.eu-central-1.amazonaws.com`:
249249
```
250250
### <a name="AuthorizationHeaderMalformed"></a> "Authorization Header is Malformed"(400) exception when PrivateLink URL is used in "fs.s3a.endpoint"
251251

252-
When [PrivateLink](https://docs.aws.amazon.com/AmazonS3/latest/userguide/privatelink-interface-endpoints.html)
253-
URL is used instead of standard s3a endpoint, it returns "authorization
252+
When [PrivateLink](https://docs.aws.amazon.com/AmazonS3/latest/userguide/privatelink-interface-endpoints.html) URL
253+
is used instead of standard s3a endpoint, it returns "authorization
254254
header is malformed" exception. So, if we set fs.s3a.endpoint=bucket.vpce
255255
-<some_string>.s3.ca-central-1.vpce.amazonaws.com and make s3 calls we get:
256256
```
257-
com.amazonaws.services.s3.model.AmazonS3Exception: The authorization header is malformed; the region 'vpce' is wrong;
258-
expecting 'ca-central-1' (Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed;
259-
Request ID: req-id; S3 Extended Request ID: req-id-2), S3 Extended Request ID: req-id-2:AuthorizationHeaderMalformed: The authorization
260-
header is malformed; the region 'vpce' is wrong; expecting 'ca-central-1' (Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed;
261-
Request ID: req-id;
257+
com.amazonaws.services.s3.model.AmazonS3Exception: The authorization header is malformed; the region 'vpce' is wrong; expecting 'ca-central-1'
258+
(Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed; Request ID: req-id; S3 Extended Request ID: req-id-2), S3 Extended Request ID: req-id-2:AuthorizationHeaderMalformed: The authorization
259+
header is malformed; the region 'vpce' is wrong; expecting 'ca-central-1' (Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed; Request ID: req-id;
262260
```
263261
Cause:
264262

265263
Since, endpoint parsing is done in a way that it assumes the AWS S3 region
266264
would be the 2nd component of the `fs.s3a.endpoint` URL delimited by ".", in
267265
case of PrivateLink URL, it can't figure out the region and throws an
268-
authorization exception. Thus, to add support to using PrivateLink URLs we use
269-
`fs.s3a.endpoint.region` to set the region and bypass this parsing of
270-
`fs.s3a.endpoint`, in the case shown above to make it work we'll set the AWS
266+
authorization exception. Thus, to add support to using PrivateLink URLs we use `fs.s3a.endpoint.region`
267+
to set the region and bypass this parsing of `fs.s3a.endpoint`, in the case shown above to make it work we'll set the AWS
271268
S3 region as `ca-central-1`.
272-
269+
273270
```xml
274271
<property>
275272
<name>fs.s3a.endpoint.region</name>

0 commit comments

Comments
 (0)