Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7396 Revisit synchronization in Namenode
  3. HDFS-4702

remove namesystem lock from DatanodeManager#fetchDatanodes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0-alpha1
    • None
    • namenode
    • None

    Description

      DatanodeManager#fetchDatanodes currently holds the namesystem read lock while iterating through data nodes. This method is called from the namenode web UI. HDFS-3990 reported a performance problem in this code path. This is a follow-up jira to investigate whether or not we can remove the lock.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-2206 Add read-write lock to DatanodeManager

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HDFS-3990 NN's health report has severe performance problems

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4269 DatanodeManager#registerDatanode rejects all datanode registrations from localhost in single-node developer setup

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-1762 Namenode does not need to store storageID and datanodeID persistently

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3137 Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cnauroth Chris Nauroth
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: