Description
Apache Arrow will soon release v1.0.0 which provides backward/forward compatibility guarantees as well as a number of fixes and improvements. This will upgrade the Java artifact and PySpark API. Although PySpark will not need special changes, it might be a good idea to bump up minimum supported version and CI testing.
TBD: list of important improvements and fixes
Attachments
Issue Links
- is related to
-
SPARK-29376 Upgrade Apache Arrow to 0.15.1
- Resolved
- links to