Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6171

ConcurrentModificationException on FSAppAttempt.containersToPreempt

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha2
    • 2.9.0, 3.0.0-alpha4
    • fairscheduler
    • None

    Description

      I have noticed an exception that closes the Application Master occasionally with Fair scheduler.

      Caused by: org.apache.hadoop.ipc.RemoteException(java.util.ConcurrentModificationException): java.util.ConcurrentModificationException
      	at java.util.HashMap$HashIterator.nextEntry(HashMap.java:922)
      	at java.util.HashMap$KeyIterator.next(HashMap.java:956)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.allocate(FairScheduler.java:1005)
      	at org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService.allocate(ApplicationMasterService.java:532)
      	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationMasterProtocolPBServiceImpl.allocate(ApplicationMasterProtocolPBServiceImpl.java:60)
      	at org.apache.hadoop.yarn.proto.ApplicationMasterProtocol$ApplicationMasterProtocolService$2.callBlockingMethod(ApplicationMasterProtocol.java:99)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:617)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1073)
      

      Attachments

        1. YARN-6171.000.patch
          5 kB
          Miklos Szegedi
        2. YARN-6171.001.patch
          5 kB
          Miklos Szegedi
        3. YARN-6171.002.patch
          6 kB
          Miklos Szegedi
        4. YARN-6171.003.patch
          6 kB
          Miklos Szegedi
        5. YARN-6171.004.patch
          7 kB
          Miklos Szegedi

        Activity

          People

            miklos.szegedi@cloudera.com Miklos Szegedi
            miklos.szegedi@cloudera.com Miklos Szegedi
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: