Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42090

Introduce sasl retry count in RetryingBlockTransferor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.2.4, 3.3.2, 3.4.0
    • Spark Core
    • None

    Description

      Previously a boolean variable, saslTimeoutSeen, was used in RetryingBlockTransferor. However, the boolean variable wouldn't cover the following scenario:

      1. SaslTimeoutException
      2. IOException
      3. SaslTimeoutException
      4. IOException

      Even though IOException at #2 is retried (resulting in increment of retryCount), the retryCount would be cleared at step #4.
      Since the intention of saslTimeoutSeen is to undo the increment due to retrying SaslTimeoutException, we should keep a counter for SaslTimeoutException retries and subtract the value of this counter from retryCount.

      Attachments

        Activity

          People

            yuzhihong@gmail.com Ted Yu
            yuzhihong@gmail.com Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: