Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15822

Client retry mechanism may invalid when use hedgedRead

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs-client
    • None

    Description

      Hedgedread uses ignoreNodes to ensure that multiple requests fall on different nodes. But the ignoreNodes never been cleared. So if the request of 1st round all failed, and the refetched location is not changed, HDFS client would not request the same nodes which are in the ignoreNodes. It just sleep time by time until reach the retry num, then throw a exception.

      Attachments

        1. HDFS-15822.001.patch
          5 kB
          tianhang tang

        Issue Links

          fixes

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10597 DFSClient hangs if using hedged reads and all but one eligible replica is down

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11303 Hedged read might hang infinitely if read data from all DN failed

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              tangtianhang tianhang tang
              tangtianhang tianhang tang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated: