Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12642

Flink's job server container attempts to invoke docker

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • 2.31.0
    • None
    • runner-flink
    • None
    • Linux

    Description

      I want to run a Java pipeline with --runner PortableRunner, so I do the following:

      • Run the Flink's job server with:
      docker run --rm --net=host apache/beam_flink1.13_job_server:latest
      • Run the pipeline with:
      mvn exec:java -Dexec.mainClass=org.foo.bar.MyMainClass -Pportable-runner -Dexec.args="--runner=PortableRunner --jobEndpoint=localhost:8099"

      After this I get the error:

      java.lang.Exception: The user defined 'open()' method caused an exception: java.io.IOException: Cannot run program "docker": error=2, No such file or directory
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:513)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.lang.Thread.run(Thread.java:748)

      What I did to workaround this is to use the gradlew script from the Git repository like this:

      ./gradlew :runners:flink:1.13:job-server:runShadow

      and it works without problem.

      Attachments

        Activity

          People

            Unassigned Unassigned
            itaranto Ignacio Taranto
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: