Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15693

LLAP: cached threadpool in AMReporter creates too many threads leading to OOM

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.2.0
    • llap

    Description

      branch: master

      2017-01-22T19:52:42,470 WARN  [IPC Server handler 3 on 34642 ()] org.apache.hadoop.ipc.Server: IPC Server handler 3 on 34642, call org.apache.hadoop.hive.llap.protocol.LlapProtocolBlockingPB.submitWork ...Call#17257 Retry#0
      java.lang.OutOfMemoryError: unable to create new native thread
              at java.lang.Thread.start0(Native Method) ~[?:1.8.0_77]
              at java.lang.Thread.start(Thread.java:714) [?:1.8.0_77]
              at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:950) ~[?:1.8.0_77]
              at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1368) ~[?:1.8.0_77]
              at com.google.common.util.concurrent.MoreExecutors$ListeningDecorator.execute(MoreExecutors.java:480) ~[hive-exec-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
              at com.google.common.util.concurrent.AbstractListeningExecutorService.submit(AbstractListeningExecutorService.java:61) ~[hive-exec-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
              at org.apache.hadoop.hive.llap.daemon.impl.AMReporter.taskKilled(AMReporter.java:231) ~[hive-llap-server-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
              at org.apache.hadoop.hive.llap.daemon.impl.ContainerRunnerImpl$KilledTaskHandlerImpl.taskKilled(ContainerRunnerImpl.java:501) ~[hive-llap-server-2.2.0-SNAPSHOT.jar:2.2.0-SNAPSHOT]
      

      Attachments

        1. HIVE-15693.5.patch
          5 kB
          Rajesh Balamohan
        2. HIVE-15693.4.patch
          5 kB
          Rajesh Balamohan
        3. HIVE-15693.3.patch
          5 kB
          Rajesh Balamohan
        4. HIVE-15693.2.patch
          4 kB
          Rajesh Balamohan
        5. HIVE-15693.1.patch
          3 kB
          Rajesh Balamohan

        Issue Links

          Activity

            People

              rajesh.balamohan Rajesh Balamohan
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: