Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8745

More fine-grained controls for the size of a BigQuery Load job

Details

    • Improvement
    • Status: Triage Needed
    • P2
    • Resolution: Fixed
    • None
    • 2.19.0
    • io-java-gcp
    • None

    Description

      Users have hit problems where load jobs into very wide tables (100s of columns) are very slow, and sometimes fail. Feedback from BigQuery is that for very wide tables, smaller load jobs can avoid failures, and slowdowns.

      Attachments

        Issue Links

          Activity

            People

              jeff.klukas@gmail.com Jeff Klukas
              pabloem Pablo Estrada
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m