Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20932

Vectorize Druid Storage Handler Reader

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersStop watchingWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      This patch aims at adding support for vectorize read of data from Druid to Hive.

      Gopal V suggested that this will improve the performance of the top level operators that supports vectorization.

      As a first cut am just adding a wrapper around the existing Record Reader to read up to 1024 row at a time. 

      Future work will be to avoid going via old reader and convert straight the Json (smile format) to Vector primitive types. 

      Attachments

        1. HIVE-20932.3.patch
          193 kB
          Slim Bouguerra
        2. HIVE-20932.4.patch
          247 kB
          Slim Bouguerra
        3. HIVE-20932.5.patch
          30 kB
          Slim Bouguerra
        4. HIVE-20932.6.patch
          30 kB
          Slim Bouguerra
        5. HIVE-20932.7.patch
          30 kB
          Slim Bouguerra
        6. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        7. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        8. HIVE-20932.8.patch
          30 kB
          Slim Bouguerra
        9. HIVE-20932.patch
          36 kB
          Slim Bouguerra
        There are no Sub-Tasks for this issue.

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bslim Slim Bouguerra Assign to me
            bslim Slim Bouguerra
            Votes:
            0 Vote for this issue
            Watchers:
            4 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment