File tree Expand file tree Collapse file tree 1 file changed +8
-5
lines changed
source/reference/pipeline Expand file tree Collapse file tree 1 file changed +8
-5
lines changed Original file line number Diff line number Diff line change @@ -157,8 +157,10 @@ Fields
157
157
158
158
* - ``s3.region``
159
159
- string
160
- - Name of the |aws| region in which the bucket is hosted.
161
- - Required
160
+ - Name of the |aws| region in which the bucket is hosted. If
161
+ omitted, uses the {+dl+} :ref:`configuration <datalake-configuration-file>` to determine the region where the
162
+ specified ``s3.bucket`` is hosted.
163
+ - Optional
162
164
163
165
* - ``s3.filename``
164
166
- string
@@ -309,7 +311,7 @@ Examples
309
311
.. example::
310
312
311
313
You want to write 1 GiB of data as compressed |bson| files to
312
- an |s3| bucket named ``my-s3-bucket``.
314
+ an |s3| bucket named ``my-s3-bucket``.
313
315
314
316
Using the following |out| syntax:
315
317
@@ -320,7 +322,6 @@ Examples
320
322
"$out": {
321
323
"s3": {
322
324
"bucket": "my-s3-bucket",
323
- "region": "us-east-1",
324
325
"filename": "big_box_store/",
325
326
"format": {
326
327
"name": "bson.gz"
@@ -329,7 +330,9 @@ Examples
329
330
}
330
331
}
331
332
332
- |out| writes five compressed |bson| files:
333
+ The ``s3.region`` is omitted and so, {+dl+} determines the
334
+ region where the bucket named ``my-s3-bucket`` is hosted from the
335
+ storage configuration. |out| writes five compressed |bson| files:
333
336
334
337
1. The first 200 MiB of data to a file that |out| names
335
338
``big_box_store/1.bson.gz``.
You can’t perform that action at this time.
0 commit comments