Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7279

Huge memory leak when using logging with invalid params on py27

Details

    • Bug
    • Status: Resolved
    • P1
    • Resolution: Not A Bug
    • 2.11.0, 2.12.0
    • 2.11.0, 2.12.0
    • sdk-py-core
    • None
    • macos, beam 2.11.0

    Description

      This very exotic and invalid input to log function causes the memory usage go all the way up until it's killed by OS (so the worker dies with OOM).

      ```
      import logging
      import apache_beam as beam

      [0] | beam.Map(lambda x: logging.warning('%203080000332%', 1))

      ```

      Works as expected on python37 (raises TypeError), fails on python27 on macOS, linux and dataflow workers.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sadovnychyi Dmytro Sadovnychyi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: