Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8815

Portable pipeline execution without artifact staging

    XMLWordPrintableJSON

    Details

      Description

      The default artifact staging implementation relies on a distributed filesystem. A directory and manifest will be created even when artifact staging isn't used, and the container boot code will fail retrieving artifacts, even though there are non. In a containerized environment it is common to package artifacts into containers. It should be possible to run the pipeline w/o a distributed filesystem. 

      https://lists.apache.org/thread.html/1b0d545955a80688ea19f227ad943683747b17beb45368ad0908fd21@%3Cdev.beam.apache.org%3E

        Attachments

          Activity

            People

            • Assignee:
              thw Thomas Weise
              Reporter:
              thw Thomas Weise
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 6h
                6h