Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21737

Create communication channel between arbitrary clients and the Spark AM in YARN mode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 2.1.1
    • None
    • Spark Core
    • None

    Description

      In this JIRA, I develop code to create a communication channel between arbitrary clients and a Spark AM on YARN. This code can be utilized to send commands such as getting status command, getting history info from the CLI, killing the application and pushing new tokens.

      Design Doc:
      https://docs.google.com/document/d/1QMbWhg13ocIoADywZQBRRVj-b9Zf8CnBrruP5JhcOOY/edit?usp=sharing

      Attachments

        Issue Links

          is part of

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-21655 Kill CLI for Yarn mode

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-19143 API in Spark for distributing new delegation tokens (Improve delegation token handling in secure clusters)

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #18978 [Github] Pull Request #18978 (yoonlee95)

          Activity

            People

              Unassigned Unassigned
              yoonlee95 Jong Yoon Lee
              Thomas Graves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: