Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25299 Use remote storage for persisting shuffle data
  3. SPARK-28592

Mark new Shuffle apis as @Experimental (instead of @Private)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: Shuffle, Spark Core
    • Labels:
      None

      Description

      The new Shuffle api is initially marked as @Private, just to discourage anyone from trying to make use of it before all the pieces are in place (in particular if spark 3.0 is released before everything is merged).  But once its all merged we can change to @Experimental

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              irashid Imran Rashid
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: