Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6113

Upgrade DataNucleus [was: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient]

    XMLWordPrintableJSON

Details

    Description

      CLEAR LIBRARY CACHE

      When I exccute SQL "use fdm; desc formatted fdm.tableName;" in python, throw Error as followed.
      but when I tryit again , It will success.

      2013-12-25 03:01:32,290 ERROR exec.DDLTask (DDLTask.java:execute(435)) - org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
      at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1143)
      at org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1128)
      at org.apache.hadoop.hive.ql.exec.DDLTask.switchDatabase(DDLTask.java:3479)
      at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:237)
      at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)
      at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:65)
      at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1414)
      at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1192)
      at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1020)
      at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
      at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:260)
      at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:217)
      at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:507)
      at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:875)
      at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:769)
      at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:708)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
      Caused by: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
      at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1217)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:62)
      at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:72)
      at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2372)
      at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2383)
      at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1139)
      ... 20 more
      Caused by: java.lang.reflect.InvocationTargetException
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1210)
      ... 25 more
      Caused by: javax.jdo.JDODataStoreException: Exception thrown flushing changes to datastore
      NestedThrowables:
      java.sql.BatchUpdateException: Duplicate entry 'default' for key 'UNIQUE_DATABASE'
      at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)
      at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:165)
      at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:358)
      at org.apache.hadoop.hive.metastore.ObjectStore.createDatabase(ObjectStore.java:404)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:124)
      at $Proxy9.createDatabase(Unknown Source)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB_core(HiveMetaStore.java:422)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:441)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:326)
      at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.<init>(HiveMetaStore.java:286)
      at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:54)
      at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:59)
      at org.apache.hadoop.hive.metastore.HiveMetaStore.newHMSHandler(HiveMetaStore.java:4060)
      at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:121)
      ... 30 more
      Caused by: java.sql.BatchUpdateException: Duplicate entry 'default' for key 'UNIQUE_DATABASE'
      at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:2028)
      at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1451)
      at com.jolbox.bonecp.StatementHandle.executeBatch(StatementHandle.java:469)
      at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeBatch(ParamLoggingPreparedStatement.java:372)
      at org.datanucleus.store.rdbms.SQLController.processConnectionStatement(SQLController.java:628)
      at org.datanucleus.store.rdbms.SQLController.processStatementsForConnection(SQLController.java:596)
      at org.datanucleus.store.rdbms.SQLController$1.transactionFlushed(SQLController.java:683)
      at org.datanucleus.store.connection.AbstractManagedConnection.transactionFlushed(AbstractManagedConnection.java:86)
      at org.datanucleus.store.connection.ConnectionManagerImpl$2.transactionFlushed(ConnectionManagerImpl.java:454)
      at org.datanucleus.TransactionImpl.flush(TransactionImpl.java:199)
      at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:263)
      at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:98)
      ... 46 more
      Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry 'default' for key 'UNIQUE_DATABASE'
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
      at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
      at com.mysql.jdbc.Util.getInstance(Util.java:386)
      at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1039)
      at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3609)
      at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3541)
      at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2002)
      at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2163)
      at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2624)
      at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2127)
      at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2427)
      at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1980)
      ... 57 more

      Attachments

        1. HIVE-6113.patch
          2 kB
          Oleksiy Sayankin
        2. HIVE-6113-2.patch
          12 kB
          Oleksiy Sayankin
        3. HIVE-6113.3.patch
          12 kB
          Oleksiy Sayankin
        4. HIVE-6113.4.patch
          14 kB
          Oleksiy Sayankin
        5. HIVE-6113.5.patch
          17 kB
          Oleksiy Sayankin
        6. HIVE-6113.6.patch
          17 kB
          Oleksiy Sayankin
        7. HIVE-6113.with.reflection.patch
          17 kB
          Sergey Shelukhin
        8. HIVE-6113.7.patch
          18 kB
          Oleksiy Sayankin
        9. HIVE-6113.8.patch
          19 kB
          Oleksiy Sayankin
        10. HIVE-6113.9.patch
          17 kB
          Sergey Shelukhin
        11. HIVE-6113.10.patch
          18 kB
          Sergey Shelukhin

        Issue Links

          Activity

            People

              osayankin Oleksiy Sayankin
              shiw019 William Stone
              Votes:
              5 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: