[HBASE-15536] Make AsyncFSWAL as our default WAL - ASF JIRA

XML

Word

Printable

JSON

Hadoop Flags:

Reviewed
Release Note:

Hide
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'.
If you want to change back to use FSHLog, please add this in hbase-site.xml
{code}
<property>
<name>hbase.wal.provider</name>
<value>filesystem</value>
</property>
{code}
If you want to use FSHLog with multiwal, please add this in hbase-site.xml
{code}
<property>
<name>hbase.wal.regiongrouping.delegate.provider</name>
<value>filesystem</value>
</property>
{code}

This patch also sets hbase.wal.async.use-shared-event-loop to false so WAL has its own netty event group.

Show
Now the default WALProvider is AsyncFSWALProvider, i.e. 'asyncfs'. If you want to change back to use FSHLog, please add this in hbase-site.xml {code} <property> <name>hbase.wal.provider</name> <value>filesystem</value> </property> {code} If you want to use FSHLog with multiwal, please add this in hbase-site.xml {code} <property> <name>hbase.wal.regiongrouping.delegate.provider</name> <value>filesystem</value> </property> {code} This patch also sets hbase.wal.async.use-shared-event-loop to false so WAL has its own netty event group.

As it should be predicated on passing basic cluster ITBLL

HBASE-15536.patch
26/Apr/16 03:17
135 kB
Duo Zhang
HBASE-15536-v1.patch
26/Apr/16 09:05
141 kB
Duo Zhang
HBASE-15536-v2.patch
26/Apr/16 12:09
140 kB
Duo Zhang
HBASE-15536-v3.patch
29/Apr/16 10:11
274 kB
Duo Zhang
HBASE-15536-v4.patch
29/Apr/16 14:33
276 kB
Duo Zhang
HBASE-15536-v5.patch
09/May/16 02:47
274 kB
Duo Zhang
latesttrunk_asyncWAL_50threads_10cols.jfr
18/Oct/16 12:28
8.53 MB
ramkrishna.s.vasudevan
latesttrunk_defaultWAL_50threads_10cols.jfr
18/Oct/16 12:28
10.89 MB
ramkrishna.s.vasudevan
15536.minor.addendum.patch
06/Dec/17 19:32
1 kB
Michael Stack
15536.addendum2.enable.asyncfswal.by.default.txt
11/Dec/17 21:53
2 kB
Michael Stack
15536.addendum2.enable.asyncfswal.by.default.txt
12/Dec/17 12:59
2 kB
Duo Zhang
15536.addendum2.enable.asyncfswal.by.default.2.txt
12/Dec/17 18:38
3 kB
Michael Stack
15536.addendum2.enable.asyncfswal.by.default.3.txt
14/Dec/17 07:50
3 kB
Michael Stack
15536.addendum2.enable.asyncfswal.by.default.txt
15/Dec/17 04:21
2 kB
Duo Zhang
15536.addendum2.enable.asyncfswal.by.default.2.txt
15/Dec/17 08:01
3 kB
Duo Zhang
15536.addendum2.enable.asyncfswal.by.default.txt
15/Dec/17 09:38
2 kB
Duo Zhang

is blocked by

HBASE-16890 Analyze the performance of AsyncWAL and fix the same

HBASE-15709 Handle large edits for asynchronous WAL

HBASE-15628 Implement an AsyncOutputStream which can work with any FileSystem implementation

HBASE-19510 TestDistributedLogSplitting is flakey for AsyncFSWAL

HBASE-19493 Make TestWALMonotonicallyIncreasingSeqId also work with AsyncFSWAL

HBASE-19503 Fix TestWALOpenAfterDNRollingStart for AsyncFSWAL

(1 is blocked by)