Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7929

inotify unable fetch pre-upgrade edit log segments once upgrade starts

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      inotify is often used to periodically poll HDFS events. However, once an HDFS upgrade has started, edit logs are moved to /previous on the NN, which is not accessible. Moreover, once the upgrade is finalized /previous is currently lost forever.

      Attachments

        1. HDFS-7929-003.patch
          8 kB
          Zhe Zhang
        2. HDFS-7929-002.patch
          8 kB
          Zhe Zhang
        3. HDFS-7929-001.patch
          4 kB
          Zhe Zhang
        4. HDFS-7929-000.patch
          4 kB
          Zhe Zhang

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. HDFS-8480 Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zhz Zhe Zhang Assign to me
            zhz Zhe Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment