Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6400

Multiple shuffle transfer fails because input is closed too early

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 2.8.0
    • 2.8.0, 3.0.0-alpha1
    • task
    • None
    • Reviewed

    Description

      TestReduceFetchFromPartialMem fails.

      Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 132.978 sec <<< FAILURE! - in org.apache.hadoop.mapred.TestReduceFetchFromPartialMem
testReduceFromPartialMem(org.apache.hadoop.mapred.TestReduceFetchFromPartialMem)  Time elapsed: 69.214 sec  <<< ERROR!
java.io.IOException: Job failed!
	at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:867)
	at org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.runJob(TestReduceFetchFromPartialMem.java:300)
	at org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.testReduceFromPartialMem(TestReduceFetchFromPartialMem.java:93)


Results :

Tests in error: 
  TestReduceFetchFromPartialMem.testReduceFromPartialMem:93->runJob:300 ยป IO Job...

Tests run: 1, Failures: 0, Errors: 1, Skipped: 0

      Attachments

        1. MAPREDUCE-6400.005.patch
          4 kB
          Gera Shegalov
        2. MAPREDUCE-6400.004.patch
          8 kB
          Akira Ajisaka
        3. MAPREDUCE-6400.003.patch
          8 kB
          Gera Shegalov
        4. MAPREDUCE-6400-002.patch
          7 kB
          Brahma Reddy Battula
        5. MAPREDUCE-6400.001.patch
          4 kB
          Gera Shegalov
        6. MAPREDUCE-6400.patch
          1 kB
          Brahma Reddy Battula

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6174 Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              brahmareddy Brahma Reddy Battula
              aajisaka Akira Ajisaka
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: