Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22462

Should run a 'mvn install' at the end of hadoop check in pre commit job

    XMLWordPrintableJSON

Details

    Description

      Now for branch-2.x, we will build with hadoop 3.x in the hadoop check stage, so in later unit check, if we run from a sub module, then the other hbase modules we depend on will depend on hadoop 3.x while the module we build will depend on 2.x, this will cause the following problem

      2019-05-23 04:47:41,156 WARN  [RS_CLOSE_META-regionserver/b001f91a596c:0-0] handler.AssignRegionHandler(157): Fatal error occurred while opening region hbase:meta,,1.1588230740, aborting...
      java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but interface was expected
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:496)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$400(FanOutOneBlockAsyncDFSOutputHelper.java:116)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:576)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:571)
      	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:584)
      	at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:51)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:169)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:166)
      	at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:105)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createAsyncWriter(AsyncFSWAL.java:664)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:670)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:832)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:538)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:479)
      	at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:156)
      	at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:61)
      	at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:293)
      	at org.apache.hadoop.hbase.regionserver.HRegionServer.getWAL(HRegionServer.java:2170)
      	at org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:133)
      	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      

      Attachments

        1. HBASE-22462.master.test.patch
          3 kB
          Guanghao Zhang
        2. HBASE-22462.master.addendum.patch
          0.8 kB
          Guanghao Zhang
        3. HBASE-22462.master.004.patch
          0.9 kB
          Guanghao Zhang
        4. HBASE-22462.master.003.patch
          0.9 kB
          Guanghao Zhang
        5. HBASE-22462.master.002.patch
          0.9 kB
          Guanghao Zhang
        6. HBASE-22462.master.001.patch
          2 kB
          Guanghao Zhang

        Activity

          People

            zghao Guanghao Zhang
            zhangduo Duo Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: