[SPARK-31536] Backport SPARK-25407 Allow nested access for non-existent field for Parquet file when nested pruning is enabled - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Won't Fix
Affects Version/s: 2.4.6
Fix Version/s: None
Component/s: SQL
Labels:
None

Target Version/s:

2.4.6

Description

Consider backporting ~~SPARK-25407~~ Allow nested access for non-existent field for Parquet file when nested pruning is enabled to 2.4.6

Attachments

Issue Links

depends upon

SPARK-25407 Spark throws a `ParquetDecodingException` when attempting to read a field from a complex type in certain cases of schema merging

Resolved

Activity

People

Assignee:: Unassigned

Reporter:: Holden Karau

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 23/Apr/20 20:02

Updated:: 12/Dec/22 18:10

Resolved:: 27/Apr/20 23:46