Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7279

Huge memory leak when using logging with invalid params on py27

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Not A Bug
    • Affects Version/s: 2.11.0, 2.12.0
    • Fix Version/s: 2.11.0, 2.12.0
    • Component/s: sdk-py-core
    • Labels:
      None
    • Environment:
      macos, beam 2.11.0

      Description

      This very exotic and invalid input to log function causes the memory usage go all the way up until it's killed by OS (so the worker dies with OOM).

      ```
      import logging
      import apache_beam as beam

      [0] | beam.Map(lambda x: logging.warning('%203080000332%', 1))

      ```

      Works as expected on python37 (raises TypeError), fails on python27 on macOS, linux and dataflow workers.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sadovnychyi Dmytro Sadovnychyi
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: