Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
The goal of this would be to iterate over a Dataset and generate a "flattened" stream of RecordBatches from the union of data sources and data fragments. This should not bother with filtering yet.
Attachments
Issue Links
- depends upon
-
ARROW-6229 [C++] Add a DataSource implementation which scans a directory
- Resolved
-
ARROW-6238 [C++] Implement SimpleDataSource/SimpleDataFragment
- Resolved
- is depended upon by
-
ARROW-6340 [R] Implements low-level bindings to Dataset classes
- Resolved
-
ARROW-6341 [Python] Implement low-level bindings for Dataset
- Resolved
- links to