[IMPALA-11529] FILE__POSITION virtual column for ORC - ASF JIRA

Agile Board

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: Backend
Labels:
- iceberg

Epic Color:
ghx-label-12

Description

https://gerrit.cloudera.org/#/c/18704/ implemented the support of FILE_POSITION virtual column for Parquet files. This ticket covers the same but for ORC files.

Note, ORC scanner already has a functionality to calculate the position of a row in a file, in an optimal scenario it only has to be re-used for the FILE_POSITION virtual column.
see: https://github.com/apache/impala/blob/8e0482294975352d3d34d75adb50602d85b3c155/be/src/exec/orc/hdfs-orc-scanner.h#L275