Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15240

Go Big BucketCache Fixes

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • None
    • None
    • BucketCache
    • None

    Description

      Umbrella issue to which we will attach issues that prevent bucketcache going big; there's a few.

      Attachments

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-17204 Make Off heap Bucket Cache default ON

        • Blocker - Blocks development and/or testing work, production could not run
        • Open
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when configuring hbase.bucketcache.bucket.sizes

        • Major - Major loss of function.
        • Resolved
        1.
        		 HFileReaderV2 prefetch overreaches; runs off the end of the data Sub-task Resolved Michael Stack Actions
        2.
        		 Blockcache hits hbase.ui.blockcache.by.file.max limit and is silent that it will load no more blocks Sub-task Resolved Unassigned Actions
        3.
        		 BLOCKSIZE 4k should result in 4096 bytes on disk; i.e. fit inside a BucketCache 'block' of 4k Sub-task Resolved Unassigned Actions
        4.
        		 Allow more than one backing file in bucketcache Sub-task Resolved Chunhui Shen Actions
        5.
        		 Remove unnecessary or Document constraints on BucketCache possible bucket sizes Sub-task Resolved Unassigned Actions
        6.
        		 Add doc, trace-level logging, and test around hfileblock Sub-task Resolved Michael Stack Actions
        7.
        		 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored Sub-task Resolved Michael Stack Actions
        8.
        		 Single Cell Get reads two HFileBlocks Sub-task Resolved Michael Stack Actions
        9.
        		 TestHFileBackedByBucketCache is flakey since it went in Sub-task Resolved Michael Stack Actions
        10.
        		 Convert TestStoreScanner to junit4 from junit3 and clean up close of scanners Sub-task Resolved Michael Stack Actions
        11.
        		 Do not save 'next block header' when we cache hfileblocks Sub-task Resolved Michael Stack Actions
        12.
        		 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit Sub-task Resolved Michael Stack Actions
        13.
        		 Port HBASE-10205 (ConcurrentModificationException in BucketAllocator) to branch-1 Sub-task Closed Stephen Yuan Jiang Actions
        14.
        		 Backport "HBASE-15477 Do not save 'next block header' when we cache hfileblocks" Sub-task Resolved Michael Stack Actions
        15.
        		 BucketCache startup is slow Sub-task Resolved ramkrishna.s.vasudevan Actions
        16.
        		 BucketCache is inefficient/wasteful/dumb in its bucket allocations Sub-task Open Unassigned Actions
        17.
        		 Reduce the heap overhead for BucketCache Sub-task Resolved Anoop Sam John Actions
        18.
        		 Investigate why bucket cache filling up in file mode in an exisiting file is slower Sub-task Resolved ramkrishna.s.vasudevan Actions
        19.
        		 BucketCache reduce heap overhead : Investigate removal of NavigableSet 'blocksByHFile' Sub-task Open Anoop Sam John Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stack Michael Stack Assign to me
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment