Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14531 [Umbrella] Improve S3A error handling & reporting
  3. HADOOP-13664

S3AInputStream to use a retry policy on read failures

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 2.8.0
    • None
    • fs/s3
    • None

    Description

      S3AInputStream has some retry logic to handle failures on a read: log and retry. We should move this over to a (possibly hard coded RetryPolicy with some sleep logic, so that longer-than-just-transient read failures can be handled.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HADOOP-14303 Review retry logic on all S3 SDK calls, implement where needed

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: