Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18425

[ABFS]: RenameFilePath Source File Not Found (404) error in retry loop

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • fs/azure

    Description

      RenameFilePath on its first try receives a Request timed out error with code 500. On retrying the same operation, a Source file not found (404) error is received. 

      Possible mitigation: Check whether etags remain the same before and after the retry and accordingly send an Operation Successful result, instead of source file not found. 

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue HADOOP-18012 ABFS: Enable config controlled ETag check for Rename idempotency

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-17979 Interface EtagSource to allow FileStatus subclasses to provide etags

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-17981 Support etag-assisted renames in FileOutputCommitter

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-18163 hadoop-azure support for the Manifest Committer of MAPREDUCE-7341

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #5485

          Web Link GitHub Pull Request #5494

          Activity

            People

              sreeb Sree Bhattacharyya
              sreeb Sree Bhattacharyya
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: