Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-45278

Make Yarn executor's bindAddress configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.0
    • None
    • Spark Core

    Description

      An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn.

      When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster.

      Another linked Jira explained Allowing binding to all IPs very well SPARK-42411 

      Attachments

        Issue Links

          Activity

            People

              nishchal Nishchal Venkataramana
              gedeh Hendra Saputra
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: