Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5797

SDK workers are not always killed when Flink pipeline finishes

Details

    Description

      Beam python workers are spun up as part of a pipeline execution, and killed once that pipeline has been cancelled or failed. However, in some situations we see the workers hanging around indefinitely until they are manually killed or the taskmanager is restarted. The behavior seems to only occur with streaming pipelines, and appearsĀ non-deterministic

      Attachments

        Issue Links

          Activity

            People

              mwylde Micah Wylde
              mwylde Micah Wylde
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m