Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-19092 ABFS phase 4: post Hadoop 3.4.0 features
  3. HADOOP-18841

[ABFS][Retry Policy] Using hadoop-common code to refractor Abfs Retry Policy Implementation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.5, 3.3.3, 3.3.4, 3.3.6
    • None
    • fs/azure
    • None

    Description

      AbfsRetryPolicy is an independent module in hadoop-azure code. There is a lot of reimplementation of a more generic and advanced retry policy already present in hadoop-common. AbfsRetryPolicy should either inherit or directly use io.retry.Retrypolicy instead of reimplementing the same functionalities again.

      AbfsRetryPolicy has only two versions: exponential and static. These both along with many others are already present in io.retry.Retrypolicy.

      Issue identified in this PR: [Hadoop-18759: [ABFS][Backoff-Optimization] Have a Static retry policy for connection timeout. by anujmodi2021 · Pull Request #5881 · apache/hadoop (github.com)|https://github.com/apache/hadoop/pull/5881]

      Attachments

        Activity

          People

            anujmodi2021 Anuj Modi
            anujmodi2021 Anuj Modi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: