Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-18272

[pyarrow] ParquetFile does not recognize GCS cloud path as a string

    XMLWordPrintableJSON

Details

    Description

      I have a Parquet file at

       

      path = 'gs://mybucket/abc/d.parquet'

       

      `pyarrow.parquet.read_metadata(path)` works fine.

       

      `pyarrow.parquet.ParquetFile(path)` raises "Failed to open local file 'gs://mybucket/abc/d.parquet'.

       

      Looks like ParquetFile misses the path resolution logic found in `read_metadata`

      Attachments

        Issue Links

          Activity

            People

              milesgranger Miles Granger
              zpz Zepu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 20m
                  3h 20m