[HBASE-15161] Umbrella: Miscellaneous improvements from production usage - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.0.0-alpha-1, 2.3.0
Component/s: None
Labels:
None

Release Note:
This ticket summarizes significant improvements and expansion to the metrics surface area. Interested users should review the individual sub-tasks.

Description

We use HBase to (mainly) build index for our search engine in Alibaba. Recently we are upgrading our online cluster from 0.98.12 to 1.x and I'd like to take the opportunity to contribute a bunch of our private patches to community (better late than never, I hope ). This is an umbrella to track this effort.

Attachments

Issue Links

contains

HBASE-14061 Support CF-level Storage Policy

Closed

HBASE-15172 Support setting storage policy in bulkload

Closed

HBASE-16393 Improve computeHDFSBlocksDistribution

Closed

is related to

HBASE-15614 Report metrics from JvmPauseMonitor

Closed

HBASE-15643 Need metrics of cache hit ratio, etc for one table

Closed

relates to

HBASE-15595 Document new metrics improvements

Closed

HBASE-14983 Create metrics for per block type hit/miss ratios

Closed

(2 relates to)

Sub-Tasks

1.	Put back HFile's HDFS op latency sampling code and add metrics for monitoring	Closed	Yu Li
2.	Add separate metrics for meta/data block hit ratio in cache	Closed	Unassigned
3.	Add sampling code and metrics for get/scan/multi/mutate count separately	Closed	Yu Li
4.	Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer	Closed	Yu Li
5.	ScanNext metric is size-based while every other per-operation metric is time based	Closed	Heng Chen
6.	Per-RS Get metric is time based, per-region metric is size-based	Closed	Heng Chen
7.	Add average region size metric	Closed	Alicia Ying Shu
8.	Add WAL (in bytes) written metric	Closed	Alicia Ying Shu
9.	Flush / Compaction metrics revisited	Closed	Enis Soztutar
10.	Add Per-Table metrics back	Closed	Alicia Ying Shu
11.	Add per-user metrics	Closed	Ankit Singhal
12.	Add per-table metrics on memstore, storefile and regionsize	Closed	Alicia Ying Shu
13.	Add more details about region on table.jsp	Closed	Yu Li
14.	Min latency in latency histograms are emitted as Long.MAX_VALUE	Closed	Enis Soztutar
15.	Add remaining per-table region / store / flush / compaction related metrics	Closed	Xu Cang
16.	Replication source.shippedKBs metric is undercounting because it is in KB	Closed	Enis Soztutar
17.	CLONE - Add Per-Table metrics back	Closed	Alicia Ying Shu

Activity

People

Assignee:: Yu Li

Reporter:: Yu Li

Votes:: 0 Vote for this issue

Watchers:: 15 Start watching this issue

Dates

Created:: 25/Jan/16 09:06

Updated:: 01/Jul/22 20:22

Resolved:: 22/Jun/20 23:50