Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25828

CompactionProgress WARNS: "totalCompactingKVs=N less than currentCompactedKVs=M"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.3
    • None
    • Compaction, Operability, regionserver
    • None

    Description

      Similar to HBASE-25642, but compaction progress warnings.

      Lots of warnings like:

      2021-04-30 00:55:15,436 WARN  [regionserver/ip-172-31-63-65:8120] 
compactions.CompactionProgress: totalCompactingKVs=15589 less than currentCompactedKVs=21411

      2021-04-30 00:55:15,437 WARN  [regionserver/ip-172-31-63-65:8120] 
compactions.CompactionProgress: totalCompactingKVs=21916 less than currentCompactedKVs=33328

      2021-04-30 00:55:15,438 WARN  [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=89731 less than currentCompactedKVs=92808

      A couple of issues:

      • Is there a way to make CompactionProgress more reliable? I seem to recall this is the second or third time around the block on this.
      • This is annoying because compaction progress isn't always accurate, but this information is not used to determine anything significant, so WARN level is a bit much. (Or, if this is a real correctness problem, see point above.)

      Attachments

        Activity

          People

            Unassigned Unassigned
            apurtell Andrew Kyle Purtell
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: