Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7285 Erasure Coding Support inside HDFS
  3. HDFS-7678

Erasure coding: DFSInputStream with decode functionality (pread)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HDFS-7285
    • HDFS-7285
    • None
    • None
    • Reviewed

    Description

      A block group reader will read data from BlockGroup no matter in striping layout or contiguous layout. The corrupt blocks can be known before reading(told by namenode), or just be found during reading. The block group reader needs to do decoding work when some blocks are found corrupt.

      Attachments

        1. BlockGroupReader.patch
          26 kB
          Li Bo
        2. HDFS-7678.000.patch
          16 kB
          Zhe Zhang
        3. HDFS-7678.001.patch
          20 kB
          Zhe Zhang
        4. HDFS-7678-HDFS-7285.002.patch
          23 kB
          Zhe Zhang
        5. HDFS-7678-HDFS-7285.003.patch
          40 kB
          Zhe Zhang
        6. HDFS-7678-HDFS-7285.004.patch
          39 kB
          Zhe Zhang
        7. HDFS-7678-HDFS-7285.005.patch
          26 kB
          Zhe Zhang
        8. HDFS-7678-HDFS-7285.006.patch
          27 kB
          Zhe Zhang
        9. HDFS-7678-HDFS-7285.007.patch
          28 kB
          Zhe Zhang
        10. HDFS-7678-HDFS-7285.008.patch
          29 kB
          Zhe Zhang
        11. HDFS-7678-HDFS-7285.009.patch
          27 kB
          Zhe Zhang
        12. HDFS-7678-HDFS-7285.010.patch
          27 kB
          Zhe Zhang
        13. HDFS-7678-HDFS-7285.012.patch
          36 kB
          Zhe Zhang
        14. HDFS-7678-HDFS-7285.013.patch
          45 kB
          Zhe Zhang
        15. HDFS-7678-HDFS-7285.014.patch
          47 kB
          Zhe Zhang

        Issue Links

          Activity

            People

              zhz Zhe Zhang
              libo-intel Li Bo
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: