Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-6736

Upgrade gcsio dependency to 1.9.15

    XMLWordPrintableJSON

Details

    Description

      GCS IO 1.9.12-1.9.14 could send large number of GCS list requests (if there are a 1000+ of files in the folder) in GoogleCloudStorageFileSystem#getFileInfo method.

      This issue is mitigated in GCS IO 1.9.15:
      https://github.com/GoogleCloudPlatform/bigdata-interop/releases/tag/v1.9.15

      Attachments

        Issue Links

          is superceded by

          New Feature - A new feature of the product, which has yet to be developed. BEAM-6697 ParquetIO Performance test is failing on (GCS filesystem)

          • P0 - Outage blocking development and/or testing work; requires immediate and continuous attention
          • Resolved
          links to

          Web Link GitHub Pull Request #7933

          Activity

            People

              Unassigned Unassigned
              medb Igor Dvorzhak
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m