Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8617

Tear down the DoFns upon the control service termination in Python SDK harness

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 2.18.0
    • Component/s: sdk-py-harness
    • Labels:
      None

      Description

      Per the discussion in the ML can be found [1], the teardown of DoFns should be supported in the portability framework. It happens at two places:
      1) Upon the control service termination
      2) Tear down the unused DoFns periodically

      The aim of this JIRA is to add support to teardown the DoFns upon the control service termination for Python SDK harness.

      [1] https://lists.apache.org/thread.html/0c4a4cf83cf2e35c3dfeb9d906e26cd82d3820968ba6f862f91739e4@%3Cdev.beam.apache.org%3E

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sunjincheng121 sunjincheng
                Reporter:
                sunjincheng121 sunjincheng
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h
                  1h