XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.1.0
    • None
    • Hive, Thrift API
    • None

    Description

      This JIRA proposes an architecture for enabling ResultSet compression which uses an external plugin.

      The patch has three aspects to it:
      0. An architecture for enabling ResultSet compression with external plugins
      1. An example plugin to demonstrate end-to-end functionality
      2. A container to allow everyone to write and test ResultSet compressors with a query submitter (https://github.com/xiaom/hs2driver)

      Also attaching a design document explaining the changes, experimental results document, and a pdf explaining how to setup the docker container to observe end-to-end functionality of ResultSet compression.

      https://reviews.apache.org/r/35792/ Review board link.

      Attachments

        1. Proposal-rscompressor.pdf
          70 kB
          Rohit Dholakia
        2. hs2driver-master.zip
          63 kB
          Rohit Dholakia
        3. Results_Snappy_protobuf_TBinary_TCompact.pdf
          31 kB
          Rohit Dholakia
        4. HIVE-10438.patch
          136 kB
          Rohit Dholakia
        5. HIVE-10438-1.patch
          146 kB
          Rohit Dholakia
        6. hs2ResultSetCompressor.zip
          17 kB
          Rohit Dholakia
        7. README.txt
          0.7 kB
          Rohit Dholakia

        Issue Links

          Activity

            People

              kliew Kevin Liew
              rohitdholakia Rohit Dholakia
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: