Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
From https://github.com/dask/dask/pull/8944#issuecomment-1112620037
For the ORC file format, we return base Fragment objects instead of the FileFragment subclass (which has more functionality):
import pyarrow as pa import pyarrow.dataset as ds from pyarrow import orc table = pa.table({'a': [1, 2, 3]}) orc.write_table(table, "test.orc") dataset = ds.dataset("test.orc", format="orc") fragment = list(dataset.get_fragments())[0]
In [9]: fragment Out[9]: <pyarrow._dataset.Fragment at 0x7f97b159beb0> In [10]: fragment.path --------------------------------------------------------------------------- AttributeError Traceback (most recent call last) <ipython-input-10-6477cc57f0cc> in <module> ----> 1 fragment.path AttributeError: 'pyarrow._dataset.Fragment' object has no attribute 'path'
Attachments
Issue Links
- links to