Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2972 Umbrella ticket for test failures in 0.11/trunk
  3. PIG-2984

MergeJoin, MergeSparseJoin, and Order e2e test fail

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • 0.11
    • None
    • CentOS 6.2, Hadoop 1.0.x

    Description

      MergeJoin/MergeSparseJoin e2e tests fail with the following error:

      org.apache.pig.backend.executionengine.ExecException: ERROR 2997: Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 1102: Data is not sorted on left side. Last two keys encountered were:
      zach zipper
      rachel allen
              at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POMergeJoin.getNext(POMergeJoin.java:400)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
              at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
              at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
              at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
              at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.secur
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:217)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:149)
              at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:400)
              at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
              at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
              at org.apache.pig.PigServer.execute(PigServer.java:1239)
              at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
              at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:136)
              at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:197)
              at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
              at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
              at org.apache.pig.Main.run(Main.java:604)
              at org.apache.pig.Main.main(Main.java:154)
      

      Order e2e tests also fail because the results do not match with expected outputs.

      It seems that ORDER BY is broken and causing these failures.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              cheolsoo Cheolsoo Park
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: