Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26646

WALPlayer should obtain token from filesystem

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.6.0, 3.0.0-alpha-3, 2.4.10, 2.5.5
    • None
    • None

    Description

      When we use WALPlayer, we got the following exceptions:

      2021-12-27 17:20:13,388 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Failed on local exception: java.io.IOException: org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: "c4-hadoop-tst-st95.bj/10.132.18.11"; destination host is: "c4-hadoop-tst-ct01.bj":58300; 
          at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:775)
          at org.apache.hadoop.ipc.Client.call(Client.java:1488)
          at org.apache.hadoop.ipc.Client.call(Client.java:1415)
          at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
          at com.sun.proxy.$Proxy13.getFileInfo(Unknown Source)
          at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:807)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          at java.lang.reflect.Method.invoke(Method.java:498)
          at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:249)
          at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:107)
          at com.sun.proxy.$Proxy14.getFileInfo(Unknown Source)
          at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2115)
          at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1221)
          at org.apache.hadoop.hdfs.DistributedFileSystem$20.doCall(DistributedFileSystem.java:1217)
          at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
          at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1233)
          at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
          at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168)
          at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:332)
          at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:314)
          at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:302)
          at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:444)
          at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.openReader(AbstractFSWALProvider.java:497)
          at org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.openReader(WALInputFormat.java:161)
          at org.apache.hadoop.hbase.mapreduce.WALInputFormat$WALRecordReader.initialize(WALInputFormat.java:154)
          at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:552)
          at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:790)
          at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
          at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
          at java.security.AccessController.doPrivileged(Native Method)
          at javax.security.auth.Subject.doAs(Subject.java:422)
          at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1885)
          at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 

      Attachments

        Activity

          People

            bbeaudreault Bryan Beaudreault
            meiyi Yi Mei
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: