Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10785

when union kudu table and hdfs table, union passthrough does not take effect

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • ghx-label-10

    Description

      IMPALA-3586 already supports union passthrough, and brings great performance improvements in union, but there is still some problems when union between hdfs table and kudu table ,several points cause the problem:

      1. in kudu scanner node output TupleDescriptor, string slot is 16B,while in hdfs scanner node output TupleDescriptor, string slot is 12B,cause tuple memory layout mismatch
      2. in kudu scanner node output TupleDescriptor, string slot is 16B, while in Union output TupleDescriptor, string slot is 12B,cause tuple memory layout mismatch
      3. in Kudu Scannode, row key slot is not null, while in hdfs node, not null slot can't get from the metadata, cause tuple memory layout mismatch

      I hive resolved the 1st and 2nd points, how should I do with the 3rd point?

      Attachments

        Issue Links

          Activity

            People

              pengdou1990 pengdou1990
              pengdou1990 pengdou1990
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: