Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9353

org.apache.impala.planner.PlannerTest.testHbaseNoKeyEstimate seems flaky after IMPALA-9349

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • None
    • None
    • Frontend

    Description

      The FE test org.apache.impala.planner.PlannerTest.testHbaseNoKeyEstimate seems flaky after IMPALA-9349. We may need to revise the expected results in https://github.com/apache/impala/blob/master/testdata/workloads/functional-planner/queries/PlannerTest/hbase-no-key-est.test.

      In what follows the corresponding error message is provided.

      Error Message
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id > '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 5\0:7
  HBASE KEYRANGE 7:9
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 9:<unbounded>
NODE 0:

Expected:
  HBASE KEYRANGE 5\0:7
  HBASE KEYRANGE 7:<unbounded>
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id >= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 5:7
  HBASE KEYRANGE 7:9
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 9:<unbounded>
NODE 0:

Expected:
  HBASE KEYRANGE 5:7
  HBASE KEYRANGE 7:<unbounded>
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id > '4' and id <= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 4\0:5
^^^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4\0:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id >= '4' and id <= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where string_col = '4' and tinyint_col = 5 and id >= '4' and id <= '5'
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where string_col = '4' and tinyint_col = 5
  and id >= concat('', '4') and id <= concat('5', '')
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:

      The stacktrace is given in the following.

      Stacktrace
java.lang.AssertionError: 
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id > '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 5\0:7
  HBASE KEYRANGE 7:9
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 9:<unbounded>
NODE 0:

Expected:
  HBASE KEYRANGE 5\0:7
  HBASE KEYRANGE 7:<unbounded>
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id >= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 5:7
  HBASE KEYRANGE 7:9
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 9:<unbounded>
NODE 0:

Expected:
  HBASE KEYRANGE 5:7
  HBASE KEYRANGE 7:<unbounded>
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id > '4' and id <= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 4\0:5
^^^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4\0:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where id >= '4' and id <= '5'
and tinyint_col = 5
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where string_col = '4' and tinyint_col = 5 and id >= '4' and id <= '5'
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:
section SCANRANGELOCATIONS of query:
select * from functional_hbase.stringids
where string_col = '4' and tinyint_col = 5
  and id >= concat('', '4') and id <= concat('5', '')
Actual does not match expected result:
  HBASE KEYRANGE 4:5
^^^^^^^^^^^^^^^^^^^^
  HBASE KEYRANGE 5:5\0
NODE 0:

Expected:
  HBASE KEYRANGE 4:5\0
NODE 0:

	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:924)
	at org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:839)
	at org.apache.impala.planner.PlannerTest.testHbaseNoKeyEstimate(PlannerTest.java:211)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:272)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:236)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143)

      Attachments

        Issue Links

          is duplicated by

          Task - A task that needs to be done. IMPALA-1995 Flaky test: PlannerTest.testHbase: splits for HBASE KEYRANGE not set up correctly.

          • Critical - Crashes, loss of data, severe memory leak.
          • Reopened

          Activity

            People

              tarmstrong Tim Armstrong
              fangyurao Fang-Yu Rao
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: