Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-47652

Spark Remote Connect to multiple Spark Sessions

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.0
    • 3.5.2
    • Kubernetes
    • None

    Description

      Current Spark Remote connects looks to have a single spark remote connect session. Can it be extended to do multiple Spark Sessions. This would help in creating decentralized Kubernetes/Custom Cloud Environment and reduce the compute of the current Spark Session.

      Making Spark to work like a full remote API call for multiple datasets where requried.

      Attachments

        Activity

          People

            Unassigned Unassigned
            voidunraj Nagharajan Raghavendran
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: