Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-4794

Reduce the ZKDatabase#committedLog memory usage

    XMLWordPrintableJSON

Details

    Description

      In ZKDatabase, after a quorum request is committed successfully, the ZKDatabase will wrap the request into a proposal and store it in the committedLog.
      The wrap operation: Serialize the request to a byte array and wrap the byte array in the QuorumPacket, so if the request payload size is 1M, the Proposal will occupy 2M memory, which will increase the memory pressure.

      The committedLog is used for fast follower synchronization, so we can serialize the request in the synchronization of the processes, no need to serialize the request in advance.

      It can reduce half of the memory for committedLog

      Attachments

        Issue Links

          Activity

            People

              horizonzy Yan Zhao
              horizonzy Yan Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h