Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14541

TestHFileOutputFormat.testMRIncrementalLoadWithSplit failed due to too many splits and few retries

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0, 1.3.0, 2.0.0
    • HFile, test
    • None
    • Reviewed

    Description

      This one seems worth a dig. We seem to be making progress but here is what we are trying to load which seems weird:

      2015-10-01 17:19:41,322 INFO  [main] mapreduce.LoadIncrementalHFiles(360): Split occured while grouping HFiles, retry attempt 10 with 4 files remaining to group or split
      2015-10-01 17:19:41,323 ERROR [main] mapreduce.LoadIncrementalHFiles(402): -------------------------------------------------
      Bulk load aborted with some files not yet loaded:
      -------------------------------------------------
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.bottom
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-B/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/ce11cbe2490d444d8958264004286aff.top
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.bottom
        hdfs://localhost:39540/user/jenkins/test-data/720ae36a-2495-456b-ba68-19e260685a35/testLocalMRIncrementalLoad/info-A/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/_tmp/30c58eeb23a6464da21117e6e1bc565c.top
      

      Whats that about?

      Making note here. Will keep an eye on this one.

      Attachments

        1. HBASE-14541-test.patch
          2 kB
          Matteo Bertozzi
        2. HBASE-14541-v0.patch
          3 kB
          Michael Stack
        3. HBASE-14541-v0.patch
          3 kB
          Matteo Bertozzi

        Issue Links

          Activity

            People

              mbertozzi Matteo Bertozzi
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: