Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12765

Cannot access field fruit on a value with type ARRAY<STRUCT<fruit STRING>>

    XMLWordPrintableJSON

Details

    Description

      I believe https://github.com/apache/beam/pull/15237 is the root cause.

      Example failure:
      https://ci-beam.apache.org/job/beam_PostCommit_Python38/1564/testReport/junit/apache_beam.io.gcp.bigquery_write_it_test/BigQueryWriteIntegrationTests/test_big_query_write_temp_table_append_schema_update/

      Tests are failing with:

      google.api_core.exceptions.BadRequest: 400 Cannot access field fruit on a value with type ARRAY<STRUCT<fruit STRING>> at [1:53]  (job ID: 3dcd4354-fcae-44dd-8e27-cff6ad41155c)                                                    -----Query Job SQL Follows-----                                                         |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    1:SELECT bytes, date, time, int64, bool, nested_field.fruit FROM python_write_to_table_16291383366439.python_append_schema_update     |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |    .    |

      Attachments

        Activity

          People

            pabloem Pablo Estrada
            lcwik Luke Cwik
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h 10m
                2h 10m