Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15100

Configuration#Resource constructor change broke Hive tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Won't Fix
    • 2.8.3, 2.7.5, 3.0.0, 2.9.1
    • None
    • None
    • None

    Description

      In CDH's C6 rebased testing, the following Hive tests started failing:

      org.apache.hive.minikdc.TestJdbcWithMiniKdcCookie.org.apache.hive.minikdc.TestJdbcWithMiniKdcCookie
      org.apache.hive.minikdc.TestJdbcWithMiniKdcCookie.org.apache.hive.minikdc.TestJdbcWithMiniKdcCookie
      org.apache.hive.minikdc.TestHiveAuthFactory.org.apache.hive.minikdc.TestHiveAuthFactory
      org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthHttp.org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthHttp
      org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthHttp.org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthHttp
      org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs
      org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs.org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs
      org.apache.hive.minikdc.TestJdbcWithMiniKdc.org.apache.hive.minikdc.TestJdbcWithMiniKdc
      org.apache.hive.minikdc.TestJdbcWithMiniKdc.org.apache.hive.minikdc.TestJdbcWithMiniKdc
      org.apache.hive.minikdc.TestHs2HooksWithMiniKdc.org.apache.hive.minikdc.TestHs2HooksWithMiniKdc
      org.apache.hive.minikdc.TestHs2HooksWithMiniKdc.org.apache.hive.minikdc.TestHs2HooksWithMiniKdc
      org.apache.hive.minikdc.TestJdbcNonKrbSASLWithMiniKdc.org.apache.hive.minikdc.TestJdbcNonKrbSASLWithMiniKdc
      org.apache.hive.minikdc.TestJdbcNonKrbSASLWithMiniKdc.org.apache.hive.minikdc.TestJdbcNonKrbSASLWithMiniKdc
      org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthBinary.org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthBinary
      org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthBinary.org.apache.hive.minikdc.TestJdbcWithMiniKdcSQLAuthBinary
      org.apache.hive.minikdc.TestMiniHiveKdc.testLogin
      org.apache.hive.minikdc.TestMiniHiveKdc.testLogin
      org.apache.hive.minikdc.TestJdbcWithDBTokenStore.org.apache.hive.minikdc.TestJdbcWithDBTokenStore
      org.apache.hive.minikdc.TestJdbcWithDBTokenStore.org.apache.hive.minikdc.TestJdbcWithDBTokenStore
      org.apache.hadoop.hive.ql.TestMetaStoreLimitPartitionRequest.testQueryWithInWithFallbackToORM
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testSelectThriftSerializeInTasks
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testEmptyResultsetThriftSerializeInTasks
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testParallelCompilation2
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testJoinThriftSerializeInTasks
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testParallelCompilation
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testConcurrentStatements
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testFloatCast2DoubleThriftSerializeInTasks
      org.apache.hive.jdbc.TestJdbcWithMiniHS2.testEnableThriftSerializeInTasks
      org.apache.hive.service.cli.TestEmbeddedThriftBinaryCLIService.testExecuteStatementParallel
      

      The exception is

      java.lang.ExceptionInInitializerError: null
      	at sun.security.krb5.Config.getRealmFromDNS(Config.java:1102)
      	at sun.security.krb5.Config.getDefaultRealm(Config.java:987)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:483)
      	at org.apache.hadoop.security.authentication.util.KerberosUtil.getDefaultRealm(KerberosUtil.java:110)
      	at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:63)
      	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:332)
      	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:317)
      	at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:907)
      	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:873)
      	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:740)
      	at org.apache.hadoop.conf.Configuration$Resource.getRestrictParserDefault(Configuration.java:261)
      	at org.apache.hadoop.conf.Configuration$Resource.<init>(Configuration.java:229)
      	at org.apache.hadoop.conf.Configuration$Resource.<init>(Configuration.java:221)
      	at org.apache.hadoop.conf.Configuration.addResource(Configuration.java:916)
      	at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:3864)
      	at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:3816)
      	at org.apache.hive.minikdc.TestJdbcWithMiniKdcCookie.<clinit>(TestJdbcWithMiniKdcCookie.java:45)
      

      aihuaxu and stakiar_impala_496e helped to git bisect to a recent change on Configuration.

      We should fix this in Hadoop code base.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              xiaochen Xiao Chen
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: