Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18363

Not able to add jar from local path other than HIVE_HOME' path using beeline

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 1.2.1
    • None
    • Beeline, HiveServer2, Thrift API
    • None

    Description

      When I tried to add jar from local path to hive using beeline it fails. When I put jar in some directory in HIVE_HOME, I could add it using that local path. But for paths other than HIVE_HOME it did not worked.
      Note: For hive-cli I could add jar from any local paths.

      Command I tried : add jar /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar;

      Stack Trace for Hiveserver2:
      2018-01-03 18:43:03,086 DEBUG [HiveServer2-Handler-Pool: Thread-41]: transport.TSaslTransport (TSaslTransport.java:readFrame(459)) - SERVER: reading data length: 173
      2018-01-03 18:43:03,087 INFO [HiveServer2-Handler-Pool: Thread-41]: session.HiveSessionImpl (HiveSessionImpl.java:acquire(304)) - We are setting the hadoop caller context to ea0f9b24-89ff-4225-9948-6112bbb29189 for thread HiveServer2-Handler-Pool: Thread-41
      2018-01-03 18:43:03,087 INFO [HiveServer2-Handler-Pool: Thread-41]: operation.Operation (HiveCommandOperation.java:setupSessionIO(69)) - Putting temp output to file /tmp/hive/ea0f9b24-89ff-4225-9948-6112bbb291891944312414426376214.pipeout
      2018-01-03 18:43:03,088 DEBUG [HiveServer2-Handler-Pool: Thread-41]: parse.VariableSubstitution (VariableSubstitution.java:substitute(53)) - Substitution is on: jar /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar
      2018-01-03 18:43:03,089 ERROR [HiveServer2-Handler-Pool: Thread-41]: SessionState (SessionState.java:printError(932)) - /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
      java.lang.IllegalArgumentException: /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
      at org.apache.hadoop.hive.ql.session.SessionState.validateFiles(SessionState.java:970)
      at org.apache.hadoop.hive.ql.session.SessionState$ResourceType.preHook(SessionState.java:1074)
      at org.apache.hadoop.hive.ql.session.SessionState$ResourceType$1.preHook(SessionState.java:1063)
      at org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1163)
      at org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1121)
      at org.apache.hadoop.hive.ql.processors.AddResourceProcessor.run(AddResourceProcessor.java:67)
      at org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:105)
      at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
      at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
      at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
      at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
      at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
      at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
      at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
      at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
      at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
      at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
      at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)

      2018-01-03 18:43:03,089 INFO [HiveServer2-Handler-Pool: Thread-41]: session.HiveSessionImpl (HiveSessionImpl.java:release(318)) - We are resetting the hadoop caller context for thread HiveServer2-Handler-Pool: Thread-41
      2018-01-03 18:43:03,089 WARN [HiveServer2-Handler-Pool: Thread-41]: thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(492)) - Error executing statement:
      org.apache.hive.service.cli.HiveSQLException: Error while processing statement: /home/anuradha/shareinsights/udfs/hivexmlserde-1.0.5.3.jar does not exist
      at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315)
      at org.apache.hive.service.cli.operation.HiveCommandOperation.runInternal(HiveCommandOperation.java:108)
      at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257)
      at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:419)
      at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:406)
      at org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:274)
      at org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:486)
      at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1317)
      at org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1302)
      at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
      at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
      at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
      at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)
      2018-01-03 18:43:03,090 DEBUG [HiveServer2-Handler-Pool: Thread-41]: transport.TSaslTransport (TSaslTransport.java:flush(498)) - writing data length: 1731

      Attachments

        Activity

          People

            Unassigned Unassigned
            anuradha_gadge Anuradha Gadge
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: