Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-8672

Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • None

    Description

      1. MissingBlocks metric is updated in HDFS-8461 so it includes striped blocks.
      2. CorruptBlocks metric is updated in HDFS-8619 so it includes striped blocks.
      3. UnderReplicatedBlocks and PendingReplicationBlocks includes striped blocks (HDFS-7912).

      This jira aims to seperate striped blocks count from UnderReplicatedBlocks count.

      EC file recovery need coding. It's more expensive than block duplication.
      It's necessary to seperate striped blocks count from UnderReplicatedBlocks count. So user can know what's going on.

      Attachments

        Issue Links

        duplicates

        Sub-task - The sub-task of the issue HDFS-10999 Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

        • Major - Major loss of function.
        • Resolved
        Is contained by

        Sub-task - The sub-task of the issue HDFS-7674 [umbrella] Adding metrics for Erasure Coding

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            manojg Manoj Govindassamy
            walter.k.su Walter Su
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment