Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20540 [umbrella] Hadoop 3 compatibility
  3. HBASE-19369

HBase Should use Builder Pattern to Create Log Files while using WAL on Erasure Coding

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 3.0.0-alpha-1, 2.2.0, 2.1.1, 2.0.2
    • None
    • None

    Description

      Right now an HBase instance using the WAL won't function properly in an Erasure Coded environment. We should change the following line to use the hdfs.DistributedFileSystem builder pattern https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/ProtobufLogWriter.java#L92

      Attachments

        1. HBASE-19369.v9.patch
          15 kB
          Mike Drob
        2. HBASE-19369.v8.patch
          15 kB
          Mike Drob
        3. HBASE-19369.v7.patch
          13 kB
          Mike Drob
        4. HBASE-19369.v6.patch
          13 kB
          Mike Drob
        5. HBASE-19369.v5.patch
          10 kB
          Mike Drob
        6. HBASE-19369.v13.patch
          15 kB
          Mike Drob
        7. HBASE-19369.v12.patch
          16 kB
          Mike Drob
        8. HBASE-19369.v11.patch
          16 kB
          Mike Drob
        9. HBASE-19369.v10.patch
          15 kB
          Mike Drob
        10. HBASE-19369.master.004.patch
          10 kB
          Alex Leblang
        11. HBASE-19369.master.003.patch
          10 kB
          Alex Leblang
        12. HBASE-19369.master.002.patch
          7 kB
          Alex Leblang
        13. HBASE-19369.master.001.patch
          2 kB
          Alex Leblang
        14. HBASE-19369.branch-2.0.001.patch
          15 kB
          Mike Drob

        Issue Links

          is related to

          Test - A new unit, integration or system test. HBASE-19289 CommonFSUtils$StreamLacksCapabilityException: hflush when running test against hadoop3 beta1

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              mdrob Mike Drob
              awleblang Alex Leblang
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: