Skip to content

Commit f263eee

Browse files
DOCSP-12588 Removing String as Default Partition Attribute Type (#89)
* DOCSP-12588 Removing String as Default Partition Attribute Type DOCSP-12588 minor update * DOCSP-12588 updates for copy review feedback
1 parent 51ecbdd commit f263eee

File tree

3 files changed

+7
-34
lines changed

3 files changed

+7
-34
lines changed
Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,6 @@
11
When specifying the
22
:datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path`:
3-
3+
4+
- Specify the data type for the partition attribute.
45
- Ensure that the partition attribute type matches the data type to parse.
56
- Use the delimiter specified in :datalakeconf:`~stores.[n].delimiter`.

source/reference/examples/path-syntax-examples.txt

Lines changed: 3 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,7 @@ exist in ``1234.json``, {+dl+} adds the ``age`` field and value to
8686
.. _supported-parsing-funcs:
8787

8888
Supported Parsing Functions
89-
~~~~~~~~~~~~~~~~~~~~~~~~~~~
89+
---------------------------
9090

9191
.. list-table::
9292
:widths: 30 70
@@ -143,7 +143,7 @@ Supported Parsing Functions
143143
.. _parse-null-values:
144144

145145
Parsing Null Values from Filenames
146-
``````````````````````````````````
146+
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
147147

148148
{+dl+} automatically parses an empty string (``""``) in the place of an
149149
attribute in the file path as the BSON null value for all the {+adl+} attribute
@@ -175,7 +175,7 @@ conflicting type to documents read from |s3|.
175175
.. _parse-padded-numeric-values:
176176

177177
Parsing Padded Numbers from Filenames
178-
`````````````````````````````````````
178+
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
179179

180180
File path can include numeric values that are padded with leading zeros. For
181181
{+dl+} to correctly parse padded numeric values for attribute types like
@@ -204,28 +204,6 @@ the value using regular expressions.
204204

205205
/users/{user_id int:\\d{3}}
206206

207-
Default Partition Attribute Type
208-
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
209-
210-
The partition attributes in the
211-
:datalakeconf:`~databases.[n].collections.[n].dataSources.[n].path` defaults to
212-
string if you don't set a different data type.
213-
214-
.. example::
215-
216-
Suppose a path similar to the following:
217-
218-
.. code-block:: none
219-
:copyable: false
220-
221-
/employees/{startDate}
222-
223-
``startDate`` is interpreted as a string.
224-
225-
.. seealso::
226-
227-
:ref:`datalake-path-attribute-types`
228-
229207
.. _datalake-path-syntax-egs:
230208

231209
Examples

source/supported-unsupported/supported-partition-attributes.txt

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -33,18 +33,12 @@ example for each data type:
3333
- Example
3434

3535
* - ``string``
36-
- Parses the filename as a string. This is the default data type.
37-
If a data type is not specified for a partition attribute,
38-
{+data-lake-short+} interprets the partition attribute as a string.
36+
- Parses the filename as a string.
3937
- filename: ``/employees/949-555-0195.json``
4038

4139
path: ``/employees/{phone string}``
4240

43-
OR
44-
45-
path: ``employees/{phone}``
46-
47-
In the preceding ``path`` examples, {+dl+} interprets ``phone`` as a string.
41+
In the preceding example, {+dl+} interprets ``phone`` as a string.
4842

4943
.. seealso::
5044

0 commit comments

Comments
 (0)