Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26665

BlockTransferService.fetchBlockSync may hang forever

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0, 2.3.1, 2.3.2, 2.4.0
    • 2.3.3, 2.4.1, 3.0.0
    • Spark Core
    • None

    Description

      `ByteBuffer.allocate` may throw OutOfMemoryError when the block is large but no enough memory is available. However, when this happens, right now BlockTransferService.fetchBlockSync will just hang forever.

      Attachments

        Activity

          People

            zsxwing Shixiong Zhu
            zsxwing Shixiong Zhu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: