Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17320

OrcRawRecordMerger.discoverKeyBounds logic can be simplified

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Transactions
    • None

    Description

      with HIVE-17089 we never have any insert events in the deltas
      so if for every split of the base we know min/max key, we can use them to filter delete events since all files are sorted by RecordIdentifier
      So we should be able to create SARG for all delete deltas

      the code can be simplified since now min/max key doesn't ever have to be null

      Attachments

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-17089 make acid 2.0 the default

          • Major - Major loss of function.
          • Closed
          relates to

          Sub-task - The sub-task of the issue HIVE-16812 VectorizedOrcAcidRowBatchReader doesn't filter delete events

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              Unassigned Unassigned
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: