Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29396 Extend Spark plugin interface to driver
  3. SPARK-29398

Allow RPC endpoints to use dedicated thread pools

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Spark Core
    • None

    Description

      This is a new feature of the RPC framework so that we can isolate RPC message delivery for plugins from normal Spark RPC needs. This minimizes the impact that plugins can have on normal RPC communication - they'll still fight for CPU, but they wouldn't block the dispatcher threads used by existing Spark RPC endpoints.

      See parent bug for further details.

      Attachments

        Issue Links

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: