Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6922

MapReduce jobs may fail during rolling upgrade due to MAPREDUCE-6829

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      MAPREDUCE-6829 should be reverted from branch-2 because rolling upgrade fails.

      2017-06-08 17:43:37,173 WARN [Socket Reader #1 for port 41187] org.apache.hadoop.ipc.Server: Unable to read call parameters for client 10.17.242.22on connection protocol org.apache.hadoop.mapred.TaskUmbilicalProtocol for rpcKind RPC_WRITABLE
java.lang.ArrayIndexOutOfBoundsException: 23
	at org.apache.hadoop.mapreduce.counters.FrameworkCounterGroup.readFields(FrameworkCounterGroup.java:261)
	at org.apache.hadoop.mapred.Counters$Group.readFields(Counters.java:324)
	at org.apache.hadoop.mapreduce.counters.AbstractCounters.readFields(AbstractCounters.java:306)
	at org.apache.hadoop.mapred.TaskStatus.readFields(TaskStatus.java:489)
	at org.apache.hadoop.mapred.MapTaskStatus.readFields(MapTaskStatus.java:88)
	at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:285)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.readFields(WritableRpcEngine.java:160)
	at org.apache.hadoop.ipc.Server$Connection.processRpcRequest(Server.java:1909)
	at org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1841)
	at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1600)
	at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:820)
	at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:693)
	at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:664)

      Attachments

        1. YARN-6922.branch-2.000.patch
          14 kB
          Miklos Szegedi

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6829 Add peak memory usage counter for each task

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6978 MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              miklos.szegedi@cloudera.com Miklos Szegedi
              miklos.szegedi@cloudera.com Miklos Szegedi
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: