Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15035

bulkloading hfiles with tags that require splits do not preserve tags

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.98.0, 1.0.0, 1.1.0, 1.2.0, 1.3.0, 2.0.0
    • 1.2.0, 1.3.0, 1.0.3, 1.1.3, 0.98.17, 2.0.0
    • HFile
    • None
    • Reviewed

    Description

      When an hfile is created with cell tags present and it is bulk loaded into hbase the tags will be present when loaded into a single region. If the bulk load hfile spans multiple regions, bulk load automatically splits the original hfile into a set of split hfiles corresponding to each of the regions that the original covers.

      Since 0.98, tags are not copied into the newly created split hfiles. (the default for "includeTags" of the HFileContextBuilder [1] is uninitialized which defaults to false). This means acls, ttls, mob pointers and other tag stored values will not be bulk loaded in.

      [1] https://github.com/apache/hbase/blob/master/hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContextBuilder.java#L40

      Attachments

        1. HBASE-15035.patch
          12 kB
          Jonathan Hsieh
        2. HBASE-15035-v2.patch
          13 kB
          Jonathan Hsieh
        3. HBASE-15035-v3.patch
          18 kB
          Jonathan Hsieh
        4. HBASE-15035-v4.patch
          15 kB
          Jonathan Hsieh

        Activity

          People

            jmhsieh Jonathan Hsieh
            jmhsieh Jonathan Hsieh
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: