Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8308

Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      If the editlog contains a transaction for creating an EC file, the NN will get blocked in waitForLoadingFSImage because the following call path:

      FSDirectory#addFileForEditLog --> FSDirectory#isInECZone --> FSDirectory#getECSchema --> ECZoneManager#getECSchema --> ECZoneManager#getECZoneInfo --> FSNamesystem#getSchema --> waitForLoadingFSImage

      This jira plans to fix this bug and also do some code cleanup.

      Attachments

        1. HDFS-8308.000.patch
          10 kB
          Jing Zhao

        Activity

          People

            jingzhao Jing Zhao
            jingzhao Jing Zhao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: