Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12948

Add .withPipelineTempDirectory() Builder setting for file-based sinks

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • io-java-files
    • None

    Description

      Per the discussion in dev@ mailing list: https://lists.apache.org/thread.html/r927907b17a33f672ee04826ba8d3cb7004d4c7e7c18608b3562f4e9c%40%3Cdev.beam.apache.org%3E

       

      adds a Builder setting for core file-based sinks to use the user-specified PipelineOptions#tempLocation as the temp directory for file writes (before the files are renamed to the final output destination).

      Attachments

        Activity

          People

            Unassigned Unassigned
            clairemcginty Claire McGinty
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: