Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18886 S3A: AWS SDK V2 Migration: stabilization and S3Express
  3. HADOOP-19027

S3A: S3AInputStream doesn't recover from HTTP/channel exceptions

    XMLWordPrintableJSON

Details

    Description

      S3AInputStream doesn't seem to recover from Http exceptions raised through HttpClient or through OpenSSL.

      • review the recovery code to make sure it is retrying enough, it looks suspiciously like it doesn't
      • detect the relevant openssl, shaded httpclient and unshaded httpclient exceptions, map to a standard one and treat as comms error in our retry policy

      This is not the same as the load balancer/proxy returning 443/444 which we map to AWSNoResponseException. We can't reuse that as it expects to be created from an software.amazon.awssdk.awscore.exception.AwsServiceException exception with the relevant fields...changing it could potentially be incompatible.

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: