Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3621

Make TestECPolicyDisabler work with Hadoop 3

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      TestECPolicyDisabler is not compatible with hadoop 3. The following error messages are produced by command `mvn clean install -DskipTests -Dhadoop.version=3.1.0 -Dhadoop.majorversion=3 -Phadoop-3`

      [ERROR] COMPILATION ERROR :
      [INFO] -------------------------------------------------------------
      [ERROR] /home/chia7712/oozie/tools/src/test/java/org/apache/oozie/tools/TestECPolicyDisabler.java:[50,71] getErasureCodingPolicy(org.apache.hadoop.fs.Path) in org.apache.oozie.tools.TestECPolicyDisabler.MockDistributedFileSystem cannot override getErasureCodingPolicy(org.apache.hadoop.fs.Path) in org.apache.hadoop.hdfs.DistributedFileSystem
      return type org.apache.hadoop.hdfs.protocol.SystemErasureCodingPolicies.ReplicationPolicy is not compatible with org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy

      The root cause is the method `getErasureCodingPolicy` was introduced in hadoop 3 and the method signature is different to mock fs of TestECPolicyDisabler. Fortunately, all we want to test is the static method 'ECPolicyDisabler#check' so we can add a new argument to make it be able to check another method.

      Attachments

        1. OOZIE-3621.v0.patch
          10 kB
          Chia-Ping Tsai

        Issue Links

          Activity

            People

              Unassigned Unassigned
              chia7712 Chia-Ping Tsai
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: