Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6699

Docker iptables command fails while running :beam-sdks-python:portableWordCountBatch

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.12.0
    • Component/s: runner-flink
    • Labels:
      None

      Description

      Attempting to run portable python wordcount*:

      ./gradlew :beam-sdks-python:portableWordCountBatch

      fails:

      > Task :beam-sdks-python:portableWordCountBatch
      INFO:root:Using latest locally built Python SDK docker image.
      INFO:root:==================== <function lift_combiners at 0x11951a578> ====================
      docker: Error response from daemon: driver failed programming external connectivity on endpoint angry_lamarr (d7b5f6f6cafc143ed4a5f37e32e6fcb0d04fe0ebb67c50d544482bbbe3bf6ee5): (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 32777 -j DNAT --to-destination 172.17.0.2:0 ! -i docker0: iptables v1.6.2: Port `0' not valid
      
      Try `iptables -h' or 'iptables --help' for more information.
      (exit status 2)).
      time="2019-02-17T04:26:10Z" level=error msg="error waiting for container: context canceled"

      Maximilian Michels thinks it might be a docker-on-mac problem. I recently updated Docker on this macbook to version 2.0.0.3 (31259), and I'm testing from current HEADcdea885872.

      I don't see where that invalid iptables command is being generated. Various other issues mention that error ("Port `0' not valid"), but I don't see any info about how to debug.

      • Building the job-server container before running seems to complete successfully and be picked up by the wordcount task:
        ./gradlew -p runners/flink/job-server-container docker

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mxm Maximilian Michels
                Reporter:
                rdub Ryan Williams
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h