Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20828 Finish-up AMv2 Design/List of Tenets/Specification of operation
  3. HBASE-21323

Should not skip force updating for a sub procedure even if it has been finished

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.2.0, 2.1.1, 2.0.3
    • proc-v2
    • None
    • Reviewed

    Description

      Keep seeing this

      2018-10-16,20:03:02,027 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=340 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:02,027 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=343
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=341 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:02,870 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=344
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=342 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:03,816 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=345
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      

      Attachments

        1. HBASE-21323.patch
          4 kB
          Duo Zhang
        2. HBASE-21323.patch
          4 kB
          Duo Zhang
        3. 0001-HBASE-21323-Should-not-skip-force-updating-for-a-sub.ADDENDUM.patch
          3 kB
          Michael Stack
        4. HBASE-21323.branch-2.1.patch
          5 kB
          Michael Stack

        Issue Links

          Activity

            People

              zhangduo Duo Zhang
              zhangduo Duo Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: