Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6699

Docker iptables command fails while running :beam-sdks-python:portableWordCountBatch

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.12.0
    • runner-flink
    • None

    Description

      Attempting to run portable python wordcount*:

      ./gradlew :beam-sdks-python:portableWordCountBatch

      fails:

      > Task :beam-sdks-python:portableWordCountBatch
      INFO:root:Using latest locally built Python SDK docker image.
      INFO:root:==================== <function lift_combiners at 0x11951a578> ====================
      docker: Error response from daemon: driver failed programming external connectivity on endpoint angry_lamarr (d7b5f6f6cafc143ed4a5f37e32e6fcb0d04fe0ebb67c50d544482bbbe3bf6ee5): (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 32777 -j DNAT --to-destination 172.17.0.2:0 ! -i docker0: iptables v1.6.2: Port `0' not valid
      
      Try `iptables -h' or 'iptables --help' for more information.
      (exit status 2)).
      time="2019-02-17T04:26:10Z" level=error msg="error waiting for container: context canceled"

      mxm thinks it might be a docker-on-mac problem. I recently updated Docker on this macbook to version 2.0.0.3 (31259), and I'm testing from current HEADcdea885872.

      I don't see where that invalid iptables command is being generated. Various other issues mention that error ("Port `0' not valid"), but I don't see any info about how to debug.

      • Building the job-server container before running seems to complete successfully and be picked up by the wordcount task:
        ./gradlew -p runners/flink/job-server-container docker

      Attachments

        Issue Links

          Activity

            People

              mxm Maximilian Michels
              rdub Ryan Williams
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h