Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-40617

Assertion failed in ExecutorMetricsPoller "task count shouldn't below 0"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.2.0, 3.2.1, 3.3.0, 3.2.2
    • 3.2.0, 3.3.1, 3.4.0
    • Spark Core
    • None

    Description

      Spurious failures because of the assert:

      22/09/29 09:46:24 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker for task 3063.0 in stage 1997.0 (TID 677249),5,main]
      java.lang.AssertionError: assertion failed: task count shouldn't below 0
      	at scala.Predef$.assert(Predef.scala:223)
      	at org.apache.spark.executor.ExecutorMetricsPoller.decrementCount$1(ExecutorMetricsPoller.scala:130)
      	at org.apache.spark.executor.ExecutorMetricsPoller.$anonfun$onTaskCompletion$3(ExecutorMetricsPoller.scala:135)
      	at java.base/java.util.concurrent.ConcurrentHashMap.computeIfPresent(ConcurrentHashMap.java:1822)
      	at org.apache.spark.executor.ExecutorMetricsPoller.onTaskCompletion(ExecutorMetricsPoller.scala:135)
      	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:737)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
      	at java.base/java.lang.Thread.run(Thread.java:829)
      22/09/29 09:46:24 INFO MemoryStore: MemoryStore cleared
      22/09/29 09:46:24 INFO BlockManager: BlockManager stopped
      22/09/29 09:46:24 INFO ShutdownHookManager: Shutdown hook called
      22/09/29 09:46:24 INFO ShutdownHookManager: Deleting directory /mnt/yarn/usercache/hadoop/appcache/application_1664443624160_0001/spark-93efc2d4-84de-494b-a3b7-2cb1c3a45426
      

      Attachments

        Issue Links

          Activity

            People

              attilapiros Attila Zsolt Piros
              attilapiros Attila Zsolt Piros
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: