[HBASE-21171] [amv2] Tool to parse a directory of MasterProcWALs standalone - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.0.0-alpha-1, 2.2.0, 2.1.1
Component/s: amv2, test
Labels:
None

Hadoop Flags:

Reviewed
Release Note:

Hide
Make it so can run the WAL parse and load system in isolation. Here is an example:

{code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/
{code}

Show
Make it so can run the WAL parse and load system in isolation. Here is an example: {code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/ {code}

Description

I want to be able to test parsing and be able to profile a standalone parse and WALProcedureStore load of procedures. Adding a simple main on WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds of WALs to see what is going on when we try to load. Good for figuring how to log, where the memory is going, etc., in this subsystem.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HBASE-21171.branch-2.1.001.patch
08/Sep/18 00:07
5 kB
Michael Stack
HBASE-21171.branch-2.1.002.patch
08/Sep/18 19:22
5 kB
Michael Stack
HBASE-21171.branch-2.1.003.patch
09/Sep/18 03:35
5 kB
Michael Stack

Issue Links

links to

Review Board (branch-2.1)

Activity

People

Assignee:: Michael Stack

Reporter:: Michael Stack

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 08/Sep/18 00:06

Updated:: 09/Sep/18 23:14

Resolved:: 09/Sep/18 16:29