Details
-
Improvement
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
While running a pipeline on AWS Glue I noticed a recurrent warning:
WARN S3AbortableInputStream: Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use.
This seems to be related to not fully consuming the input stream when reading files from AWS S3.
Attachments
Issue Links
- links to