Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18103 High performance vectored read API in Hadoop
  3. HADOOP-18105

Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

    XMLWordPrintableJSON

Details

    Description

      Currently in hadoop codebase, we have two classes which implements byte buffers pooling.

      One is ElasticByteBufferPool which doesn't use weak references and thus could cause memory leaks in production environment. 

      Other is DirectBufferPool which uses weak references but doesn't support caller's preference for either on-heap or off-heap buffers. 

       

      The idea is to create an improved version of ElasticByteBufferPool by subclassing it ( as it is marked as public and stable and used widely in hdfs ) with essential functionalities required for effective buffer pooling. This is important for the parent Vectored IO work.

      Attachments

        Issue Links

          Activity

            People

              mthakur Mukund Thakur
              mthakur Mukund Thakur
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 4h
                  4h