Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-2518

Moving spark dataframe from spark.pyspark to spark.r

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Not A Bug
    • 0.7.1
    • 0.7.1
    • None
    • ubuntu 16.04, AWS EC2, 64 Gb RAM, Octa core

    Description

      I am trying to pass the spark.sql.dataframe df_weekly from spark.pyspark to spark.r

      spark.pyspark
      z.put("df_weekly",df_weekly._jdf)
      
      spark.r
      library(SparkR)
      df_weekly = z.get("df_weekly")
      type(df_weekly)
      

      The object received in R is of class "jobj"

      Attachments

        Activity

          People

            Unassigned Unassigned
            mrshanth Prasanth
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified