Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7873

FnApi with Subprocess runner hangs frequently when running with multi workers with py2

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.15.0
    • Component/s: sdk-py-core
    • Labels:
      None

      Description

      Pipeline hangs at subprocess.Popen() when shut it down. I looked into source code of subprocess lib. py27 doesn't do any lock while py3 locks when waiting. Py3 added locks at other places of Popen() as well, all unlocked places with py2 may contribute to the problem. We can add a lock when calling Popen() to prevent the deadlock. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hannahjiang Hannah Jiang
                Reporter:
                hannahjiang Hannah Jiang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: