Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24326

Add local:// scheme support for the app jar in mesos cluster mode

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • Mesos
    • None

    Description

      It is often useful to reference an application jar within the image used to deploy a Spark job on mesos in cluster mode. This is not possible right now because the mesos dispatcher will try to resolve the local://... uri on the host (via the fetcher) and not in the container. Target is to have a scheme like local:/// being resolved in the container's fs.

      Attachments

        Activity

          People

            skonto Stavros Kontopoulos
            skonto Stavros Kontopoulos
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: