Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19306

Arrow batch serializer

    XMLWordPrintableJSON

Details

    Description

      Leverage the ThriftJDBCBinarySerDe code path that already exists in SemanticAnalyzer/FileSinkOperator to create a serializer that batches rows into Arrow vector batches.

      Attachments

        1. HIVE-19306.4.patch
          85 kB
          Teddy Choi
        2. HIVE-19306.3.patch
          85 kB
          Eric Wohlstadter
        3. HIVE-19306.2.patch
          100 kB
          Teddy Choi

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-19305 Arrow format for LlapOutputFormatService (umbrella)

          • Major - Major loss of function.
          • Resolved
          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-19305 Arrow format for LlapOutputFormatService (umbrella)

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HIVE-19511 Null value error with complex nested data type in Arrow batch serializer

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              teddy.choi Teddy Choi
              ewohlstadter Eric Wohlstadter
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: