Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-11948

Investigate TxnHandler and CompactionTxnHandler to see where we improve concurrency

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.14.0
    • 1.3.0
    • Transactions
    • None

    Description

      at least some operations (or parts of operations) can run at READ_COMMITTED.
      CompactionTxnHandler.setRunAs()

      CompactionTxnHandler.findNextToCompact()
      if update stmt includes cq_state = '" + INITIATED_STATE + "'" in WHERE clause and logic to look for "next" candidate

      CompactionTxnHandler.markCompacted()
      perhaps add cq_state=WORKING_STATE in Where clause (mostly as an extra consistency check)

      Attachments

        1. HIVE-11948.patch
          48 kB
          Eugene Koifman
        2. HIVE-11948.3.patch
          63 kB
          Eugene Koifman
        3. HIVE-11948.4.patch
          63 kB
          Eugene Koifman
        4. HIVE-11948.5.patch
          66 kB
          Eugene Koifman
        5. HIVE-11948.6.patch
          66 kB
          Eugene Koifman
        6. HIVE-11948.7.patch
          67 kB
          Eugene Koifman

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12389 CompactionTxnHandler.cleanEmptyAbortedTxns() should safeguard against huge IN clauses

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13013 Further Improve concurrency in TxnHandler

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12352 CompactionTxnHandler.markCleaned() may delete too much

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12585 fix TxnHandler connection leak

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-12439 CompactionTxnHandler.markCleaned() and TxnHandler.openTxns() misc improvements

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB

          Activity

            People

              ekoifman Eugene Koifman
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: