Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8560

Construction time schema Validation for writing to BQ

Details

    • Improvement
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • sdk-java-core

    Description

      `BigQueryIO.write` should be able to validate the schema of the input PCollection against the schema for this table (either retrieved from DataCatalog, or from BQ metadata). Then we can fail at pipeline construction time rather than waiting until execution.

      At the very least this should work when writing Beam Rows.

      Attachments

        Activity

          People

            Unassigned Unassigned
            bhulette Brian Hulette
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: