Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-8320

Erasure coding: consolidate striping-related terminologies

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None
    • Reviewed

    Description

      Right now we are doing striping-based I/O in a number of places:

      1. Client output stream (HDFS-7889)
      2. Client input stream
      3. DN reconstruction (HDFS-7348)

      In each place we use one or multiple of the following terminologies:

      1. Cell
      2. Stripe
      3. Block group
      4. Internal block
      5. Chunk

      This JIRA aims to systematically define these terminologies in relation with each other and in the context of the containing file. For example, a cell belong to stripe i and internal block j can be indexed as (i, j) and its logical index k in the file can be calculated.

      With the above consolidation, hopefully we can further consolidate striping I/O codes.

      Attachments

        1. HDFS-8320-HDFS-7285.00.patch
          46 kB
          Zhe Zhang
        2. HDFS-8320-HDFS-7285.01.patch
          51 kB
          Zhe Zhang
        3. HDFS-8320-HDFS-7285.02.patch
          51 kB
          Zhe Zhang
        4. HDFS-8320-HDFS-7285.03.patch
          51 kB
          Jing Zhao

        Activity

          People

            zhz Zhe Zhang
            zhz Zhe Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: