Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21724

Nested ARRAY and STRUCT inside MAP don't work with LazySimpleDeserializeRead

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.1
    • Fix Version/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      The logic during vectorized execution that keeps track of how deep we are in the nested structure doesn't work for ARRAYs and STRUCTs embedded inside maps.

      Repro steps (with hive.vectorized.execution.enabled=true):

      CREATE TABLE srctable(a map<int,array<int>>) STORED AS TEXTFILE;
      create table desttable(c1 map<int,array<int>>);
      insert into srctable values (map(1, array(1, 2, 3)));
      insert into desttable select a from srctable;
      select * from desttable;
      

      Will produce:

      {1:[null]}
      

        Attachments

        1. HIVE-21724.2.patch
          14 kB
          Daniel Voros
        2. HIVE-21724.2.patch
          14 kB
          Daniel Voros
        3. HIVE-21724.2.patch
          14 kB
          Daniel Voros
        4. HIVE-21724.1.patch
          9 kB
          Daniel Voros

          Activity

            People

            • Assignee:
              dvoros Daniel Voros
              Reporter:
              dvoros Daniel Voros
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: