Details
-
Bug
-
Status: Open
-
P3
-
Resolution: Unresolved
-
2.16.0
-
None
-
None
Description
We are using the beam python sdk 2.16.0 and have noticed since upgrading to 2.16.0 that beam jobs are exiting successfully even though the BQ load job fails. We can see the load job failing in the Bigquery UI while the beam jobs running on either the DirectRunner or the DataflowRunner were successful.
Note we areĀ using the BigQuery File Loads (which is enabled via use_beam_bq_sink)
I have verified that downgrading to 2.15.0 fixes this issue so it must be a newly introduced bug.