Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20828 Finish-up AMv2 Design/List of Tenets/Specification of operation
  3. HBASE-21490

WALProcedure may remove proc wal files still with active procedures

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.2.0, 2.0.3, 2.1.2
    • proc-v2
    • None
    • Reviewed

    Description

      It happens for me several times. After master restart, all the procedures are gone.

      And the proc wal files were deleted before restarting, I see this in the master's log

      2018-11-16,20:57:40,177 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Remove all state logs with ID less than 184, since all the active procedures are in the latest log
      2018-11-16,20:57:40,177 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.ProcedureWALFile: Archiving hdfs://c4tst-xiaomi/hbase/c4tst-sync1/MasterProcWALs/pv2-00000000000000000184.log to hdfs://c4tst-xiaomi/hbase/c4tst-sync1/oldWALs/pv2-00000000000000000184.log
      

      Let me dig...

      Attachments

        1. HBASE-21490-UT.patch
          7 kB
          Duo Zhang
        2. HBASE-21490.patch
          12 kB
          Duo Zhang
        3. HBASE-21490.patch
          12 kB
          Michael Stack
        4. HBASE-21490-v1.patch
          13 kB
          Duo Zhang

        Issue Links

          Activity

            People

              zhangduo Duo Zhang
              zhangduo Duo Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: