Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13811

Splitting WALs, we are filtering out too many edits -> DATALOSS

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.1.0, 1.2.0, 2.0.0
    • 1.2.0, 1.1.1, 2.0.0
    • wal
    • None
    • Reviewed

    Description

      I've been running ITBLLs against branch-1 around HBASE-13616 (move of ServerShutdownHandler to pv2). I have come across an instance of dataloss. My patch for HBASE-13616 was in place so can only think it the cause (but cannot see how). When we split the logs, we are skipping legit edits. Digging.

      Attachments

        1. 13811.txt
          Delete this attachment
          42 kB
          Michael Stack
        2. 13811.branch-1.txt
          Delete this attachment
          42 kB
          Michael Stack
        3. HBASE-13811.testcase.patch
          Delete this attachment
          7 kB
          Duo Zhang
        4. HBASE-13811-v1.testcase.patch
          Delete this attachment
          7 kB
          Duo Zhang
        5. 13811.branch-1.txt
          Delete this attachment
          87 kB
          Michael Stack
        6. 13811.v2.branch-1.txt
          Delete this attachment
          85 kB
          Michael Stack
        7. 13811.v3.branch-1.txt
          Delete this attachment
          90 kB
          Michael Stack
        8. 13811.v3.branch-1.txt
          Delete this attachment
          90 kB
          Michael Stack
        9. 13811.v4.branch-1.txt
          Delete this attachment
          826 kB
          Michael Stack
        10. 13811.v5.branch-1.txt
          Delete this attachment
          91 kB
          Michael Stack
        11. 13811.v6.branch-1.txt
          Delete this attachment
          91 kB
          Michael Stack
        12. 13811.v6.branch-1.txt
          Delete this attachment
          91 kB
          Michael Stack
        13. 13811.v7.branch-1.txt
          Delete this attachment
          94 kB
          Michael Stack
        14. startCacheFlush.diff
          Delete this attachment
          6 kB
          Duo Zhang
        15. 13811.v8.branch-1.txt
          Delete this attachment
          105 kB
          Michael Stack
        16. 13811.v9.branch-1.txt
          Delete this attachment
          107 kB
          Michael Stack
        17. HBASE-13811-branch-1.1.patch
          Delete this attachment
          23 kB
          Duo Zhang
        18. 13811.addendum.txt
          Delete this attachment
          0.9 kB
          Michael Stack

        Issue Links

        relates to

        Bug - A problem which impairs or prevents the functions of the product. HBASE-13853 ITBLL improvements after HBASE-13811

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stack Michael Stack Assign to me
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment