Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-32213

Add get off heap buffer in memory segment

    XMLWordPrintableJSON

Details

    Description

      When flink job writes data to data lake such as paimon, iceberg and hudi, the sink will write data to writer buffer first, then flush the data to file system. To manage the writer buffer better, we'd like to allocate segment from managed memory in flink and get off heap buffer to create writer buffer

      Attachments

        Issue Links

          Activity

            People

              zjureel Fang Yong
              zjureel Fang Yong
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: