Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-22462

Should run a 'mvn install' at the end of hadoop check in pre commit job

    XMLWordPrintableJSON

    Details

      Description

      Now for branch-2.x, we will build with hadoop 3.x in the hadoop check stage, so in later unit check, if we run from a sub module, then the other hbase modules we depend on will depend on hadoop 3.x while the module we build will depend on 2.x, this will cause the following problem

      2019-05-23 04:47:41,156 WARN  [RS_CLOSE_META-regionserver/b001f91a596c:0-0] handler.AssignRegionHandler(157): Fatal error occurred while opening region hbase:meta,,1.1588230740, aborting...
      java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but interface was expected
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:496)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$400(FanOutOneBlockAsyncDFSOutputHelper.java:116)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:576)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:571)
      	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
      	at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:584)
      	at org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:51)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:169)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:166)
      	at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:105)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createAsyncWriter(AsyncFSWAL.java:664)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:670)
      	at org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:128)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:832)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:538)
      	at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:479)
      	at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:156)
      	at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:61)
      	at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:293)
      	at org.apache.hadoop.hbase.regionserver.HRegionServer.getWAL(HRegionServer.java:2170)
      	at org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:133)
      	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      

        Attachments

        1. HBASE-22462.master.001.patch
          2 kB
          Guanghao Zhang
        2. HBASE-22462.master.002.patch
          0.9 kB
          Guanghao Zhang
        3. HBASE-22462.master.003.patch
          0.9 kB
          Guanghao Zhang
        4. HBASE-22462.master.004.patch
          0.9 kB
          Guanghao Zhang
        5. HBASE-22462.master.addendum.patch
          0.8 kB
          Guanghao Zhang
        6. HBASE-22462.master.test.patch
          3 kB
          Guanghao Zhang

          Activity

            People

            • Assignee:
              zghao Guanghao Zhang
              Reporter:
              zhangduo Duo Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: