@@ -94,13 +94,20 @@ object.
94
94
PyArrow integration
95
95
-------------------
96
96
97
- `pyarrow `_ has its own internal idea of what a file-system is (``pyarrow.filesystem .FileSystem ``),
97
+ `pyarrow `_ has its own internal idea of what a file-system is (``pyarrow.fs .FileSystem ``),
98
98
and some functions, particularly the loading of parquet, require that the target be compatible.
99
- As it happens, the design of the file-system interface in ``pyarrow `` *is * compatible with `fsspec `
100
- (this is not by accident). Therefore at import time, ``fsspec `` checks for the existence of
101
- ``pyarrow ``, and, if found, adds it to the superclasses of the spec base-class. In this manner,
102
- all ``fsspec ``-derived file-systems are also pyarrow file-systems, and can be used by pyarrow
103
- functions.
99
+ As it happens, the design of the file-system interface in ``pyarrow `` *is * compatible with ``fsspec ``
100
+ (this is not by accident).
101
+
102
+ At import time, ``fsspec `` checks for the existence of ``pyarrow ``, and, if ``pyarrow < 2.0 `` is
103
+ found, adds its base filesystem to the superclasses of the spec base-class.
104
+ For ``pyarrow >= 2.0 ``, ``fsspec `` file systems can simply be passed to ``pyarrow `` functions
105
+ that expect ``pyarrow `` filesystems, and ``pyarrow `` `will automatically wrap them
106
+ <https://arrow.apache.org/docs/python/filesystems.html#using-fsspec-compatible-filesystems> `_.
107
+
108
+ In this manner, all ``fsspec ``-derived file-systems are also ``pyarrow `` file-systems, and can be used
109
+ by ``pyarrow `` functions.
110
+
104
111
105
112
.. _pyarrow : https://arrow.apache.org/docs/python/
106
113
@@ -377,7 +384,7 @@ Obviously, you should only define default values that are appropriate for
377
384
a given file system implementation. INI files only support string values.
378
385
379
386
Alternatively, you can provide overrides with environment variables of
380
- the style " FSSPEC_{protocol}_{kwargname}=value" .
387
+ the style `` FSSPEC_{protocol}_{kwargname}=value `` .
381
388
382
389
Configuration is determined in the following order, with later items winning:
383
390
0 commit comments