Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7256

Add Graph abstraction which uses DataFrame

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Later
    • None
    • None
    • GraphX, SQL

    Description

      RDD is to DataFrame as Graph is to ??? (this JIRA).

      It would be very useful long-term to have a Graph type which uses 2 DataFrames instead of 2 RDDs.

      The immediate benefit I have in mind is taking advantage of Spark SQL datasources and storage formats.

      This could also be an opportunity to make an API which is more Java- and Python-friendly.

      CC: ankurdave rxin

      Attachments

        Issue Links

          is required by

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7258 spark.ml API taking Graph instead of DataFrame

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              josephkb Joseph K. Bradley
              Votes:
              3 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: