Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
0.7.3, 0.8.0
-
None
-
None
Description
INFO [2018-02-16 17:59:50,518] ({Thread-52} Logging.scala[logInfo]:54) - Post-Scan Filters: INFO [2018-02-16 17:59:50,521] ({Thread-52} Logging.scala[logInfo]:54) - Output Data Schema: struct<> INFO [2018-02-16 17:59:50,522] ({Thread-52} Logging.scala[logInfo]:54) - Pushed Filters: INFO [2018-02-16 17:59:50,668] ({Thread-52} Logging.scala[logInfo]:54) - Block broadcast_15 stored as values in memory (estimated size 347.7 KB, free 5.2 GB) INFO [2018-02-16 17:59:50,687] ({Thread-52} Logging.scala[logInfo]:54) - Block broadcast_15_piece0 stored as bytes in memory (estimated size 34.3 KB, free 5.2 GB) INFO [2018-02-16 17:59:50,687] ({dispatcher-event-loop-7} Logging.scala[logInfo]:54) - Added broadcast_15_piece0 in memory on 10.20.32.57:15295 (size: 34.3 KB, free: 5.2 GB) INFO [2018-02-16 17:59:50,688] ({Thread-52} Logging.scala[logInfo]:54) - Created broadcast 15 from count at NativeMethodAccessorImpl.java:0 INFO [2018-02-16 17:59:50,688] ({Thread-52} Logging.scala[logInfo]:54) - Planning scan with bin packing, max size: 4194304 bytes, open cost is considered as scanning 4194304 bytes. INFO [2018-02-16 17:59:50,705] ({Thread-52} Logging.scala[logInfo]:54) - Starting job: count at NativeMethodAccessorImpl.java:0 INFO [2018-02-16 17:59:50,706] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Registering RDD 47 (count at NativeMethodAccessorImpl.java:0) INFO [2018-02-16 17:59:50,707] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Got job 5 (count at NativeMethodAccessorImpl.java:0) with 1 output partitions INFO [2018-02-16 17:59:50,707] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Final stage: ResultStage 11 (count at NativeMethodAccessorImpl.java:0) INFO [2018-02-16 17:59:50,707] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Parents of final stage: List(ShuffleMapStage 10) INFO [2018-02-16 17:59:50,707] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Missing parents: List() INFO [2018-02-16 17:59:50,707] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Submitting ResultStage 11 (MapPartitionsRDD[50] at count at NativeMethodAccessorImpl.java:0), which has no missing parents INFO [2018-02-16 17:59:50,709] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Block broadcast_16 stored as values in memory (estimated size 7.0 KB, free 5.2 GB) ERROR [2018-02-16 17:59:50,710] ({SparkListenerBus} Logging.scala[logError]:91) - Listener threw an exception java.lang.NullPointerException at org.apache.zeppelin.spark.Utils.getNoteId(Utils.java:156) at org.apache.zeppelin.spark.NewSparkInterpreter$1.onJobStart(NewSparkInterpreter.java:225) at org.apache.spark.scheduler.SparkListenerBus$class.doPostEvent(SparkListenerBus.scala:37) at org.apache.spark.scheduler.LiveListenerBus.doPostEvent(LiveListenerBus.scala:36) at org.apache.spark.scheduler.LiveListenerBus.doPostEvent(LiveListenerBus.scala:36) at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:63) at org.apache.spark.scheduler.LiveListenerBus.postToAll(LiveListenerBus.scala:36) at org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(LiveListenerBus.scala:94) at org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(LiveListenerBus.scala:79) at org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(LiveListenerBus.scala:79) at scala.util.DynamicVariable.withValue(DynamicVariable.scala:58) at org.apache.spark.scheduler.LiveListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(LiveListenerBus.scala:78) at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1279) at org.apache.spark.scheduler.LiveListenerBus$$anon$1.run(LiveListenerBus.scala:77) INFO [2018-02-16 17:59:50,714] ({dag-scheduler-event-loop} Logging.scala[logInfo]:54) - Block broadcast_16_piece0 stored as bytes in memory (estimated size 3.7 KB, free 5.2 GB) INFO [2018-02-16 17:59:50,715] ({dispatcher-event-loop-4} Logging.scala[logInfo]:54) - Added broadcast_16_piece0 in memory on 10.20.32.57:15295 (size: 3.7 KB, free: 5.2 GB)
Notice
ERROR [2018-02-16 17:59:50,710] ({SparkListenerBus} Logging.scala[logError]:91) - Listener threw an exception
java.lang.NullPointerException
at org.apache.zeppelin.spark.Utils.getNoteId(Utils.java:156)
at org.apache.zeppelin.spark.NewSparkInterpreter$1.onJobStart(NewSparkInterpreter.java:225)
at org.apache.spark.scheduler.SparkListenerBus$class.doPostEvent(SparkListenerBus.scala:37)
at org.apache.spark.scheduler.LiveListenerBus.doPostEvent(LiveListenerBus.scala:36)
at
Attachments
Attachments
Issue Links
- blocks
-
ZEPPELIN-2385 Release 0.8.0
- Resolved
- breaks
-
ZEPPELIN-3484 sc.setJobGroup() shows up in error stack and shifts line numbering
- Resolved
-
ZEPPELIN-3270 Spark interpreter - job progress is not shown nor a link to Spark driver UI
- Closed
- is duplicated by
-
ZEPPELIN-3270 Spark interpreter - job progress is not shown nor a link to Spark driver UI
- Closed
- is related to
-
ZEPPELIN-4079 SparkShims.getNoteId returns NPE
- Open
- links to
(1 links to)