Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8618

Tear down unused DoFns periodically in Python SDK harness

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 2.19.0
    • Component/s: sdk-py-harness
    • Labels:
      None

      Description

      Per the discussion in the ML, detail can be found [1], the teardown of DoFns should be supported in the portability framework. It happens at two places:
      1) Upon the control service termination
      2) Tear down the unused DoFns periodically

      The aim of this JIRA is to add support for tear down the unused DoFns periodically in Python SDK harness.
      [1] https://lists.apache.org/thread.html/0c4a4cf83cf2e35c3dfeb9d906e26cd82d3820968ba6f862f91739e4@%3Cdev.beam.apache.org%3E

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sunjincheng121 sunjincheng
                Reporter:
                sunjincheng121 sunjincheng
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: