Details
-
Bug
-
Status: Open
-
P3
-
Resolution: Unresolved
-
2.13.0
-
None
-
None
Description
Using the dataflow runner, log messages always show up in stackdriver with the step_id as the empty string, so filtering log messages for a step doesn't work.
resource: { labels: { job_id: "<job id>" job_name: "<job name>" project_id: "<project id>" region: "<region>" step_id: "" } type: "dataflow_step" }
Another user seems to have posted in the old github repo and appears to be seeing the same problem based on their output:
https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/62
From what I can tell is only affecting streaming pipelines