Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2085

Zeppelin fails to compile function contains function as a parameter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.7.0
    • 0.8.0
    • None
    • None

    Description

      Code below runs well in Spark shell,
      but fails to run on Zeppelin 0.7 (Used to be work on Zeppelin 0.6)

      ====

      case class TestClass(a: Int)
      
      object TestClassBuilder {
        def get(a: Int) = TestClass(a)
      }
      
      def successToCompile()(filterFunc: (TestClass) => Boolean) {
        val rdd = sc.makeRDD(List(TestClass(1), TestClass(2)))
        rdd.filter(filterFunc)
      }
      
      def failToCompile(filterFunc: (TestClass) => Boolean) {
        val rdd = sc.makeRDD(List(TestClassBuilder.get(1), TestClassBuilder.get(2)))
        rdd.filter(filterFunc)
      }
      

      In 0.7.2, it's resolved by reverting 0629d93.

      Attachments

        1. test_it.png
          299 kB
          Jongyoul Lee
        2. test_it_2.png
          280 kB
          Jongyoul Lee

        Issue Links

          Activity

            People

              drigor Igor Drozdov
              swkimme Kevin (Sangwoo) Kim
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: