Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-27862 FLIP-235: Hybrid Shuffle Mode
  3. FLINK-27907

Implement disk read and write logic for hybrid shuffle

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Done
    • None
    • 1.16.0
    • None

    Description

      Implement disk read and write logic for hybrid shuffle. In order to access the disk as sequentially as possible, Introduce HsMemoryDataSpiller, HsResultPartitionReadScheduler and HsSubpartitionFileReader.

      Attachments

        Issue Links

          Activity

            People

              Weijie Guo Weijie Guo
              Weijie Guo Weijie Guo
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: