Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-45869 Revisit and Improve Spark Standalone Cluster
  3. SPARK-46215

Improve `FileSystemPersistenceEngine` to allow non-exist parents

    XMLWordPrintableJSON

Details

    Description

      To prevent the following

      info]   java.io.IOException: No such file or directory
[info]   at java.base/java.io.UnixFileSystem.createFileExclusively(Native Method)
[info]   at java.base/java.io.File.createNewFile(File.java:1043)
[info]   at org.apache.spark.deploy.master.FileSystemPersistenceEngine.serializeIntoFile(FileSystemPersistenceEngine.scala:62)
[info]   at org.apache.spark.deploy.master.FileSystemPersistenceEngine.persist(FileSystemPersistenceEngine.scala:45)

      Attachments

        Activity

          People

            dongjoon Dongjoon Hyun
            dongjoon Dongjoon Hyun
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: