Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3632

Table partioning in DynamicDestination is lost with project is not set in Table Destination

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • 2.2.0, 2.3.0
    • 2.4.0
    • io-java-gcp
    • None

    Description

      In the following class https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/*WriteTables.java*

      line 140

      When the project is not set in table name, a new TableDestination is created but all the time partitioning parameter is lost.

      Fix is very easy. Add a get time partitioning on the new creation:
      tableDestination = new TableDestination(tableReference, tableDestination.getTableDescription(),tableDestination.getTimePartitioning());
       
      Should be enought

      Attachments

        Activity

          People

            Guillaume Blaquiere Blaquiere Guillaume
            Guillaume Blaquiere Blaquiere Guillaume
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 10m Original Estimate - 10m
                10m
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 2h
                2h