[HBASE-24150] Allow module tests run in parallel - ASF JIRA

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.0.0-alpha-1, 2.3.0, 2.2.6
Component/s: build
Labels:
None

Hadoop Flags:

Reviewed
Release Note:
Pass -T2 to mvn. Makes it so we do two modules-at-a-time dependencies willing. Helps speed build and testing. Doubles the resource usage when running modules in parallel.

Description

Parent issue is about upping forkcount. This one is about mildly letting modules run tests in parallel. Parent wants forkcount to be 0.5C so we use half the processors. This is about keeping forkcount at 0.25C but allowing two modules to run their tests at same time when mvn figures it is possible.

In a test on a local machine, using forkcount of 1.0C and -T == 1 – default – the full test suite took 1hr 15mins. With forkcount at 0.5 and T == 2, full suite took 53mins.