Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26788

Remove SchedulerExtensionService

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Spark Core, YARN
    • None

    Description

      This was added in SPARK-11314, but it has a few issues:

      • it's in the YARN module, which is not a public Spark API.
      • because of that it's also YARN specific
      • it's not used by Spark in any way other than providing this as an extension point

      For the latter, it probably makes sense to use listeners instead, and enhance the listener interface if it's lacking.

      Also pinging steve_l since he added that code.

      Attachments

        Issue Links

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: