Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21620

Problem in scan query when using more than one column prefix filter in some cases.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 1.5.0, 2.2.0, 1.4.8, 2.1.2, 2.0.4
    • Fix Version/s: 3.0.0, 2.2.0, 2.1.2, 2.0.4
    • Component/s: Scanners
    • Labels:
      None
    • Environment:

      hbase-1.4.8, hbase-1.4.9

      hadoop-2.7.3

    • Hadoop Flags:
      Reviewed

      Description

      In some cases, unable to get the scan results when using more than one column prefix filter.

      Attached a java file to import the data which we used and a text file containing the values..

      While executing the following query (hbase shell as well as java program) it is waiting indefinitely and after RPC timeout we got the following error.. Also we noticed high cpu, high load average and very frequent young gc  in the region server containing this row...

      scan 'namespace:tablename',{STARTROW => 'test',ENDROW => 'test', FILTER => "ColumnPrefixFilter('1544770422942010001_') OR ColumnPrefixFilter('1544769883529010001_')"}

      ROW                                                  COLUMN+CELL                                                                   ERROR: Call id=18, waitTime=60005, rpcTimetout=60000

       

      Note: Table scan operation and scan with a single column prefix filter works fine in this case.

      When we check the same query in hbase-1.2.5 it is working fine.

      Can you please help me on this..

        Attachments

        1. test.patch
          5 kB
          Zheng Hu
        2. scanquery.txt
          3 kB
          Mohamed Mohideen Meeran
        3. qualifiers.txt
          26.29 MB
          Mohamed Mohideen Meeran
        4. HBaseImportData.java
          2 kB
          Mohamed Mohideen Meeran
        5. HBaseFileImport.java
          2 kB
          Mohamed Mohideen Meeran
        6. HBASE-21620.v3.patch
          15 kB
          Zheng Hu
        7. HBASE-21620.v3.patch
          15 kB
          stack
        8. HBASE-21620.v2.patch
          14 kB
          Zheng Hu
        9. HBASE-21620.v1.patch
          14 kB
          Zheng Hu
        10. HBASE-21620.branch-1.patch
          5 kB
          Zheng Hu
        11. file.txt
          1 kB
          Mohamed Mohideen Meeran
        12. columnkey.txt
          15.11 MB
          Mohamed Mohideen Meeran

          Issue Links

            Activity

              People

              • Assignee:
                openinx Zheng Hu
                Reporter:
                mohamed.meeran Mohamed Mohideen Meeran
              • Votes:
                3 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: