[HBASE-21773] rowcounter utility should respond to pleas for help - ASF JIRA

Details

Type: Bug
Status: Resolved
Priority: Critical
Resolution: Fixed
Affects Version/s: 2.1.0
Fix Version/s: 3.0.0-alpha-1, 2.3.0
Component/s: tooling
Labels:
None

Release Note:

Hide
This adds [-h|-help] options to rowcounter. Passing either -h or -help will print rowcounter guide as below:

$hbase rowcounter -h

usage: hbase rowcounter <tablename> [options] [<column1> <column2>...]
Options:
    --starttime=<arg> starting time filter to start counting rows from.
    --endtime=<arg> end time filter limit, to only count rows up to this timestamp.
    --range=<arg> [startKey],[endKey][;[startKey],[endKey]...]]
    --expectedCount=<arg> expected number of rows to be count.
For performance, consider the following configuration properties:
-Dhbase.client.scanner.caching=100
-Dmapreduce.map.speculative=false

Show
This adds [-h|-help] options to rowcounter. Passing either -h or -help will print rowcounter guide as below: $hbase rowcounter -h usage: hbase rowcounter <tablename> [options] [<column1> <column2>...] Options:     --starttime=<arg> starting time filter to start counting rows from.     --endtime=<arg> end time filter limit, to only count rows up to this timestamp.     --range=<arg> [startKey],[endKey][;[startKey],[endKey]...]]     --expectedCount=<arg> expected number of rows to be count. For performance, consider the following configuration properties: -Dhbase.client.scanner.caching=100 -Dmapreduce.map.speculative=false

Description

hbase rowcounter does not respond to reasonable requests for help, i.e. -help, -h, or ?

[systest@busbey-training-1 root]$ hbase rowcounter -?
OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
19/01/24 12:30:00 INFO client.RMProxy: Connecting to ResourceManager at busbey-training-1.gce.cloudera.com/172.31.116.31:8032
19/01/24 12:30:01 INFO hdfs.DFSClient: Created token for systest: HDFS_DELEGATION_TOKEN owner=systest@GCE.CLOUDERA.COM, renewer=yarn, realUser=, issueDate=1548361801519, maxDate=1548966601519, sequenceNumber=3, masterKeyId=8 on 172.31.116.31:8020
19/01/24 12:30:01 INFO kms.KMSClientProvider: Getting new token from https://busbey-training-3.gce.cloudera.com:16000/kms/v1/, renewer:yarn/busbey-training-1.gce.cloudera.com@GCE.CLOUDERA.COM
19/01/24 12:30:02 INFO kms.KMSClientProvider: New token received: (Kind: kms-dt, Service: 172.31.116.52:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361801965, maxDate=1548966601965, sequenceNumber=5, masterKeyId=17))
19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 172.31.116.31:8020, Ident: (token for systest: HDFS_DELEGATION_TOKEN owner=systest@GCE.CLOUDERA.COM, renewer=yarn, realUser=, issueDate=1548361801519, maxDate=1548966601519, sequenceNumber=3, masterKeyId=8)
19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: kms-dt, Service: 172.31.116.52:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361801965, maxDate=1548966601965, sequenceNumber=5, masterKeyId=17)
19/01/24 12:30:02 INFO kms.KMSClientProvider: Getting new token from https://busbey-training-4.gce.cloudera.com:16000/kms/v1/, renewer:yarn/busbey-training-1.gce.cloudera.com@GCE.CLOUDERA.COM
19/01/24 12:30:02 INFO kms.KMSClientProvider: New token received: (Kind: kms-dt, Service: 172.31.116.50:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361802363, maxDate=1548966602363, sequenceNumber=6, masterKeyId=18))
19/01/24 12:30:02 INFO security.TokenCache: Got dt for hdfs://busbey-training-1.gce.cloudera.com:8020; Kind: kms-dt, Service: 172.31.116.50:16000, Ident: (kms-dt owner=systest, renewer=yarn, realUser=, issueDate=1548361802363, maxDate=1548966602363, sequenceNumber=6, masterKeyId=18)
19/01/24 12:30:02 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /user/systest/.staging/job_1548349234632_0003
19/01/24 12:30:03 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/systest/.staging/job_1548349234632_0003
Exception in thread "main" java.lang.IllegalArgumentException: Illegal first character <45> at 0. User-space table qualifiers can only start with 'alphanumeric characters' from any language: -?
        at org.apache.hadoop.hbase.TableName.isLegalTableQualifierName(TableName.java:193)
        at org.apache.hadoop.hbase.TableName.isLegalTableQualifierName(TableName.java:156)
        at org.apache.hadoop.hbase.TableName.<init>(TableName.java:346)
        at org.apache.hadoop.hbase.TableName.createTableNameIfNecessary(TableName.java:382)
        at org.apache.hadoop.hbase.TableName.valueOf(TableName.java:469)
        at org.apache.hadoop.hbase.mapreduce.TableInputFormat.initialize(TableInputFormat.java:198)
        at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:243)
        at org.apache.hadoop.hbase.mapreduce.TableInputFormat.getSplits(TableInputFormat.java:254)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:310)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:327)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:200)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1588)
        at org.apache.hadoop.hbase.mapreduce.RowCounter.run(RowCounter.java:242)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:261)

[systest@busbey-training-1 root]$ hbase rowcounter
OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
ERROR: Wrong number of parameters: 0
Usage: hbase rowcounter [options] <tablename> [--starttime=<start> --endtime=<end>] [--range=[startKey],[endKey][;[startKey],[endKey]...]] [<column1> <column2>...]
For performance consider the following options:
-Dhbase.client.scanner.caching=100
-Dmapreduce.map.speculative=false

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HBASE-21773.master.004.patch
31/Jan/19 05:54
21 kB
Wellington Chevreuil
HBASE-21773.master.003.patch
31/Jan/19 01:28
20 kB
Wellington Chevreuil
HBASE-21773.master.002.patch
30/Jan/19 23:54
20 kB
Wellington Chevreuil
HBASE-21773.master.001.patch
30/Jan/19 23:49
19 kB
Wellington Chevreuil

Issue Links

links to

GitHub Pull Request #1953

rowcounter utility should respond to pleas for help

Details

Description

Attachments

Attachments

Issue Links

Activity

People

Dates