Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19205 Hive streaming ingest improvements (v2)
  3. HIVE-19208

Automatic distribution for non-bucketed tables during streaming ingest

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.0, 3.0.0
    • None
    • Streaming
    • None

    Description

      Currently non-bucketed tables write to a single file in transaction batch. This limits the concurrency of compactor job to be 1. Provide an option to automatically distribute the incoming records to N files within a transaction batch.

      Attachments

        Activity

          People

            prasanth_j Prasanth Jayachandran
            prasanth_j Prasanth Jayachandran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: