Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19614 Further optimization of sort-merge based blocking shuffle
  3. FLINK-22307

Increase the default value of data writing cache size (not configurable) for sort-merge blocking shuffle

    XMLWordPrintableJSON

Details

    Description

      Currently, the data writing cache is 8M, which is not enough if data compression is enabled. By increasing the cache size to 16M, the performance of our benchmark job can be increased by about 20%. (We may make it configurable in the future)

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              kevin.cyj Yingjie Cao
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: