Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2388

Make shim for Hadoop 0.20 and 0.23 support dynamic

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.9.2, 0.10.0
    • 0.9.2, 0.10.0
    • None
    • None

    Description

      We need a single Pig installation that works with both Hadoop versions. The current shim implementation assumes different builds for each version. We can solve this statically through internal build/installation system or by making the shim dynamic so that pig.jar will work on both version with runtime detection. Attached patch is to convert the static shims into a shim interface with 2 implementations, each of which will be compiled against the respective Hadoop version and included into single pig.jar (similar to what Hive does).

      The default build behavior remains unchanged, only the shim for ${hadoopversion} will be compiled. Both shims can be built via: ant -Dbuild-all-shims=true

      Attachments

        1. PIG-2388_branch-0.9.patch
          91 kB
          Thomas Weise

        Issue Links

          Activity

            People

              Unassigned Unassigned
              thw Thomas Weise
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: