Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42471 Distributed ML <> spark connect
  3. SPARK-42472

Make spark connect supporting canceling job group

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.4.0
    • None
    • Connect, ML
    • None

    Description

      PySpark ML crossValidator relies on this:

      proposal:
      when spark client sending request, can we make it send with a "job_group_id", and in server side, for each request that with the same (user_id, job_group_id), handling request in a fixed thread

      Attachments

        Activity

          People

            Unassigned Unassigned
            podongfeng Ruifeng Zheng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: