P2 Description
It doesn't look like the AWS Filesystem libraries are included in the Flink JobServer.
There is a TODO in the code to update the dependencies to support the AWS filesystem.
https://github.com/apache/beam/blob/master/runners/flink/job-server/flink_job_server.gradle#L89
As reported in this mailing list thread trying to use S3 to stage artifacts results in the exception
Aug 06, 2021 1:52:51 AM
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2
finishStaging
SEVERE: Error staging artifacts
java.util.concurrent.ExecutionException:
java.lang.IllegalArgumentException: No filesystem found for scheme s3
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
Attachments
Issue Links
- links to
