Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20932

Vectorize Druid Storage Handler Reader

    XMLWordPrintableJSON

Details

    Description

      This patch aims at adding support for vectorize read of data from Druid to Hive.

      t3rmin4t0r suggested that this will improve the performance of the top level operators that supports vectorization.

      As a first cut am just adding a wrapper around the existing Record Reader to read up to 1024 row at a time. 

      Future work will be to avoid going via old reader and convert straight the Json (smile format) to Vector primitive types. 

      Attachments

        1. HIVE-20932.patch
          36 kB
          Slim Bouguerra
        2. HIVE-20932.3.patch
          193 kB
          Slim Bouguerra
        3. HIVE-20932.4.patch
          247 kB
          Slim Bouguerra
        4. HIVE-20932.5.patch
          30 kB
          Slim Bouguerra
        5. HIVE-20932.6.patch
          30 kB
          Slim Bouguerra
        6. HIVE-20932.7.patch
          30 kB
          Slim Bouguerra
        7. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        8. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        9. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra

        Issue Links

          Activity

            People

              bslim Slim Bouguerra
              bslim Slim Bouguerra
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: