Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19954

Separate TestBlockReorder into individual tests to avoid ShutdownHook suppression error against hadoop3

    XMLWordPrintableJSON

Details

    • Reviewed
    • hadoop3 minidfscluster removes all shutdown handlers when the cluster goes down which made this test that does FS-stuff fail (Fix was to break up the test so each test method ran with an unadulterated FS).

    Description

      TestBlockReorder fails against hadoop 3 due to the following error:

      2018-02-08 17:22:23,389 ERROR [RS:0;cn012:38253] helpers.MarkerIgnoringBase(159): ***** ABORTING region server cn012.l42scl.hortonworks.com,38253,1518110542271: Unhandled: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e *****
      java.lang.RuntimeException: Failed suppression of fs shutdown hook: org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6a0c707e
        at org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressHdfsShutdownHook(ShutdownHook.java:207)
        at org.apache.hadoop.hbase.regionserver.ShutdownHook.install(ShutdownHook.java:85)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:927)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:187)
      

      This is because when MiniDFSCluster is stopped in first subtest, hadoop 3 clears ShutdownHook.
      When the 2nd test starts, suppression of ShutdownHook fails.

      Attachments

        1. 19954.v1.txt
          5 kB
          Ted Yu
        2. 19954.v2.txt
          6 kB
          Ted Yu
        3. 19954.v3.txt
          30 kB
          Ted Yu
        4. 19954.v4.txt
          32 kB
          Ted Yu

        Issue Links

          Activity

            People

              yuzhihong@gmail.com Ted Yu
              yuzhihong@gmail.com Ted Yu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: