Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29790

Add notes about port being required for Kubernetes API URL when set as master

    XMLWordPrintableJSON

Details

    • Documentation
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.3, 2.4.4
    • 2.4.5, 3.0.0
    • Kubernetes, Spark Core
    • None

    Description

      Apparently, when configuring the master endpoint, the Kubernetes API url needs to include the port, even if it's 443. This should be noted in the documentation of "Running Spark on Kubernetes guide".

      Reported in the wild https://medium.com/@kidane.weldemariam_75349/thanks-james-on-issuing-spark-submit-i-run-into-this-error-cc507d4f8f0d

      I had the same issue myself.

      We might want to create an issue for fixing the implementation, if it's considered a bug.

      Attachments

        Issue Links

          Activity

            People

              tapped Emil Sandstø
              tapped Emil Sandstø
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: