Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22226

Getting Arrayoutofbound exception when using left join

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.3.1
    • Fix Version/s: None
    • Component/s: HiveServer2
    • Labels:
      None
    • Environment:

      production

    • Docs Text:
      Hide
      19/09/13 07:12:04 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:37645 with 4.1 GB RAM, BlockManagerId(8, servername.corp.com, 37645)
      19/09/13 07:12:04 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:52820) with ID 9
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:33041 with 4.1 GB RAM, BlockManagerId(9, servername.corp.com, 33041)
      19/09/13 07:12:05 INFO hive.HiveContext: Initializing execution hive, version 1.1.0
      19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:48136) with ID 11
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:39145 with 4.1 GB RAM, BlockManagerId(11, servername.corp.com, 39145)
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username
      19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/d16faa91-82cb-424a-907d-70d48c03b9ea_resources
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea
      19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/username/d16faa91-82cb-424a-907d-70d48c03b9ea
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea/_tmp_space.db
      19/09/13 07:12:05 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
      19/09/13 07:12:05 INFO hive.HiveContext: default warehouse location is /user/hive/warehouse
      19/09/13 07:12:05 INFO hive.HiveContext: Initializing metastore client version 1.1.0 using Spark classes.
      19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1dvpap.corp.com:50616) with ID 7
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1dvpap.corp.com:44921 with 4.1 GB RAM, BlockManagerId(7, lsdna1dvpap.corp.com, 44921)
      19/09/13 07:12:06 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1sjpappr.corp.com:57542) with ID 6
      19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/ca568677-0f11-4ef4-baef-cfea87c32f40_resources
      19/09/13 07:12:06 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1sjpappr.corp.com:37121 with 4.1 GB RAM, BlockManagerId(6, lsdna1sjpappr.corp.com, 37121)
      19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40
      19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/user/ca568677-0f11-4ef4-baef-cfea87c32f40
      19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40/_tmp_space.db
      19/09/13 07:12:06 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
      19/09/13 07:12:07 INFO hive.metastore: Trying to connect to metastore with URI thrift://servername.corp.com:9083
      19/09/13 07:12:07 INFO hive.metastore: Opened a connection to metastore, current connections: 1
      19/09/13 07:12:07 INFO hive.metastore: Connected to metastore.
      19/09/13 07:12:07 INFO metadata.Hive: Registering function hash256 com.bac.peaks.pksHash
      19/09/13 07:12:07 INFO metadata.Hive: Registering function tempfunction com.bac.qrt.udf.ConvertExponential
      19/09/13 07:12:07 INFO metadata.Hive: Registering function annual_value com.boa.rrsa.riskcalc.udf.CalculateAnnualValueUDF
      19/09/13 07:12:07 WARN controller.SparkFlowController: Metadata is not being logged. Please make sure this is intended!
      19/09/13 07:12:07 INFO controller.SparkFlowController: Instanciating Flow Class:com.bac.rctt.apps.flowbot.flows.OrderedStepFlow
      19/09/13 07:12:07 INFO controller.SparkFlowController: Running Flow:sp_cmrcl_tre_by_facility_02
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Starting OrderedStepFlow
      19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Validating steps...
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Verifying config
      19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-020
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-020
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-010
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-010
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-030
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-030
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Finished validating steps
      19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: New Instance of DataFrameEnvelope
      19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: Running mergeAttributes
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setDataFrame
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setExistingDataFrame
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Converting column names to lower case
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Collects stats attribute has value not found: flow.metadata.dataframe.collectStats
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: No collectStats columns were provided, so skipping calculation
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Registering new temp table: flow_metadata
      19/09/13 07:12:08 INFO flows.OrderedStepFlow: Processing step: flow.steps.step-010
      19/09/13 07:12:08 INFO processors.ExecuteCMD: ******Item to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql exehqldf1
      19/09/13 07:12:08 INFO processors.ExecuteCMD: New Step Name:flow.steps.step-010-1
      19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
      19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd name:exehqldf1
      19/09/13 07:12:08 INFO envelope.FlowEnvelope: Running clone attributes
      19/09/13 07:12:08 INFO processors.ExecuteCMD: found filesystem step! Going to pass 'flow.steps.step-010-1' to executeCommand
      19/09/13 07:12:08 INFO processors.ExecuteCMD: Executing command: sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
      Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
      Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
      Error: Error while compiling statement: FAILED: ArrayIndexOutOfBoundsException null (state=42000,code=40000)
      19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes
      19/09/13 07:18:51 INFO util.FeedSLA$: SLA check not enabled for step flow.steps.step-010
      19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes
      Show
      19/09/13 07:12:04 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:37645 with 4.1 GB RAM, BlockManagerId(8, servername.corp.com, 37645) 19/09/13 07:12:04 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:52820) with ID 9 19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8 19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:33041 with 4.1 GB RAM, BlockManagerId(9, servername.corp.com, 33041) 19/09/13 07:12:05 INFO hive.HiveContext: Initializing execution hive, version 1.1.0 19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4 19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4 19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:48136) with ID 11 19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:39145 with 4.1 GB RAM, BlockManagerId(11, servername.corp.com, 39145) 19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username 19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/d16faa91-82cb-424a-907d-70d48c03b9ea_resources 19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea 19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/username/d16faa91-82cb-424a-907d-70d48c03b9ea 19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea/_tmp_space.db 19/09/13 07:12:05 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 19/09/13 07:12:05 INFO hive.HiveContext: default warehouse location is /user/hive/warehouse 19/09/13 07:12:05 INFO hive.HiveContext: Initializing metastore client version 1.1.0 using Spark classes. 19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4 19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4 19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1dvpap.corp.com:50616) with ID 7 19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1dvpap.corp.com:44921 with 4.1 GB RAM, BlockManagerId(7, lsdna1dvpap.corp.com, 44921) 19/09/13 07:12:06 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1sjpappr.corp.com:57542) with ID 6 19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/ca568677-0f11-4ef4-baef-cfea87c32f40_resources 19/09/13 07:12:06 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1sjpappr.corp.com:37121 with 4.1 GB RAM, BlockManagerId(6, lsdna1sjpappr.corp.com, 37121) 19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40 19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/user/ca568677-0f11-4ef4-baef-cfea87c32f40 19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40/_tmp_space.db 19/09/13 07:12:06 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 19/09/13 07:12:07 INFO hive.metastore: Trying to connect to metastore with URI thrift://servername.corp.com:9083 19/09/13 07:12:07 INFO hive.metastore: Opened a connection to metastore, current connections: 1 19/09/13 07:12:07 INFO hive.metastore: Connected to metastore. 19/09/13 07:12:07 INFO metadata.Hive: Registering function hash256 com.bac.peaks.pksHash 19/09/13 07:12:07 INFO metadata.Hive: Registering function tempfunction com.bac.qrt.udf.ConvertExponential 19/09/13 07:12:07 INFO metadata.Hive: Registering function annual_value com.boa.rrsa.riskcalc.udf.CalculateAnnualValueUDF 19/09/13 07:12:07 WARN controller.SparkFlowController: Metadata is not being logged. Please make sure this is intended! 19/09/13 07:12:07 INFO controller.SparkFlowController: Instanciating Flow Class:com.bac.rctt.apps.flowbot.flows.OrderedStepFlow 19/09/13 07:12:07 INFO controller.SparkFlowController: Running Flow:sp_cmrcl_tre_by_facility_02 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Starting OrderedStepFlow 19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Validating steps... 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Verifying config 19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-020 19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-020 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-010 19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-010 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-030 19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-030 19/09/13 07:12:07 INFO flows.OrderedStepFlow: Finished validating steps 19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: New Instance of DataFrameEnvelope 19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: Running mergeAttributes 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setDataFrame 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setExistingDataFrame 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Converting column names to lower case 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Collects stats attribute has value not found: flow.metadata.dataframe.collectStats 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: No collectStats columns were provided, so skipping calculation 19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Registering new temp table: flow_metadata 19/09/13 07:12:08 INFO flows.OrderedStepFlow: Processing step: flow.steps.step-010 19/09/13 07:12:08 INFO processors.ExecuteCMD: ******Item to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql exehqldf1 19/09/13 07:12:08 INFO processors.ExecuteCMD: New Step Name:flow.steps.step-010-1 19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql 19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd name:exehqldf1 19/09/13 07:12:08 INFO envelope.FlowEnvelope: Running clone attributes 19/09/13 07:12:08 INFO processors.ExecuteCMD: found filesystem step! Going to pass 'flow.steps.step-010-1' to executeCommand 19/09/13 07:12:08 INFO processors.ExecuteCMD: Executing command: sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Error: Error while compiling statement: FAILED: ArrayIndexOutOfBoundsException null (state=42000,code=40000) 19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes 19/09/13 07:18:51 INFO util.FeedSLA$: SLA check not enabled for step flow.steps.step-010 19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes

      Description

      19/09/13 07:12:04 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:37645 with 4.1 GB RAM, BlockManagerId(8, servername.corp.com, 37645)
      19/09/13 07:12:04 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:52820) with ID 9
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:33041 with 4.1 GB RAM, BlockManagerId(9, servername.corp.com, 33041)
      19/09/13 07:12:05 INFO hive.HiveContext: Initializing execution hive, version 1.1.0
      19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (servername.corp.com:48136) with ID 11
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager servername.corp.com:39145 with 4.1 GB RAM, BlockManagerId(11, servername.corp.com, 39145)
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username
      19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/d16faa91-82cb-424a-907d-70d48c03b9ea_resources
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea
      19/09/13 07:12:05 INFO session.SessionState: Created local directory: /tmp/username/d16faa91-82cb-424a-907d-70d48c03b9ea
      19/09/13 07:12:05 INFO session.SessionState: Created HDFS directory: file:/tmp/spark-fdeb1fb6-d7f7-4daa-95b7-3d8539992bfd/scratch/username/d16faa91-82cb-424a-907d-70d48c03b9ea/_tmp_space.db
      19/09/13 07:12:05 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
      19/09/13 07:12:05 INFO hive.HiveContext: default warehouse location is /user/hive/warehouse
      19/09/13 07:12:05 INFO hive.HiveContext: Initializing metastore client version 1.1.0 using Spark classes.
      19/09/13 07:12:05 INFO client.ClientWrapper: Inspected Hadoop version: 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO client.ClientWrapper: Loaded org.apache.hadoop.hive.shims.Hadoop23Shims for Hadoop version 2.6.0-cdh5.14.4
      19/09/13 07:12:05 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1dvpap.corp.com:50616) with ID 7
      19/09/13 07:12:05 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1dvpap.corp.com:44921 with 4.1 GB RAM, BlockManagerId(7, lsdna1dvpap.corp.com, 44921)
      19/09/13 07:12:06 INFO cluster.YarnClientSchedulerBackend: Registered executor NettyRpcEndpointRef(null) (lsdna1sjpappr.corp.com:57542) with ID 6
      19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/ca568677-0f11-4ef4-baef-cfea87c32f40_resources
      19/09/13 07:12:06 INFO storage.BlockManagerMasterEndpoint: Registering block manager lsdna1sjpappr.corp.com:37121 with 4.1 GB RAM, BlockManagerId(6, lsdna1sjpappr.corp.com, 37121)
      19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40
      19/09/13 07:12:06 INFO session.SessionState: Created local directory: /tmp/user/ca568677-0f11-4ef4-baef-cfea87c32f40
      19/09/13 07:12:06 INFO session.SessionState: Created HDFS directory: /tmp/hive/user/ca568677-0f11-4ef4-baef-cfea87c32f40/_tmp_space.db
      19/09/13 07:12:06 INFO session.SessionState: No Tez session required at this point. hive.execution.engine=mr.
      19/09/13 07:12:07 INFO hive.metastore: Trying to connect to metastore with URI thrift://servername.corp.com:9083
      19/09/13 07:12:07 INFO hive.metastore: Opened a connection to metastore, current connections: 1
      19/09/13 07:12:07 INFO hive.metastore: Connected to metastore.
      19/09/13 07:12:07 INFO metadata.Hive: Registering function hash256 com.bac.peaks.pksHash
      19/09/13 07:12:07 INFO metadata.Hive: Registering function tempfunction com.bac.qrt.udf.ConvertExponential
      19/09/13 07:12:07 INFO metadata.Hive: Registering function annual_value com.boa.rrsa.riskcalc.udf.CalculateAnnualValueUDF
      19/09/13 07:12:07 WARN controller.SparkFlowController: Metadata is not being logged. Please make sure this is intended!
      19/09/13 07:12:07 INFO controller.SparkFlowController: Instanciating Flow Class:com.bac.rctt.apps.flowbot.flows.OrderedStepFlow
      19/09/13 07:12:07 INFO controller.SparkFlowController: Running Flow:sp_cmrcl_tre_by_facility_02
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Starting OrderedStepFlow
      19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Validating steps...
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Verifying config
      19/09/13 07:12:07 INFO envelope.FlowEnvelope: Running getSteps
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-020
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-020
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-010
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-010
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Checking flow.steps.step-030
      19/09/13 07:12:07 INFO processors.ExecuteCMD: Verifying flow.steps.step-030
      19/09/13 07:12:07 INFO flows.OrderedStepFlow: Finished validating steps
      19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: New Instance of DataFrameEnvelope
      19/09/13 07:12:07 INFO envelope.DataFrameEnvelope: Running mergeAttributes
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setDataFrame
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: setExistingDataFrame
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Converting column names to lower case
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Collects stats attribute has value not found: flow.metadata.dataframe.collectStats
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: No collectStats columns were provided, so skipping calculation
      19/09/13 07:12:08 INFO envelope.DataFrameEnvelope: Registering new temp table: flow_metadata
      19/09/13 07:12:08 INFO flows.OrderedStepFlow: Processing step: flow.steps.step-010
      19/09/13 07:12:08 INFO processors.ExecuteCMD: ******Item to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql exehqldf1
      19/09/13 07:12:08 INFO processors.ExecuteCMD: New Step Name:flow.steps.step-010-1
      19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd to execute:sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
      19/09/13 07:12:08 INFO processors.ExecuteCMD: cmd name:exehqldf1
      19/09/13 07:12:08 INFO envelope.FlowEnvelope: Running clone attributes
      19/09/13 07:12:08 INFO processors.ExecuteCMD: found filesystem step! Going to pass 'flow.steps.step-010-1' to executeCommand
      19/09/13 07:12:08 INFO processors.ExecuteCMD: Executing command: sh /path//sh/exehql.sh /path//hql/sp_cmrcl_tre_by_facility_001.hql
      Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
      Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
      Error: Error while compiling statement: FAILED: ArrayIndexOutOfBoundsException null (state=42000,code=40000)
      19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes
      19/09/13 07:18:51 INFO util.FeedSLA$: SLA check not enabled for step flow.steps.step-010
      19/09/13 07:18:51 INFO envelope.FlowEnvelope: Running mergeAttributes

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Rameshpgs Ramesh Pemmasani Srinivasalu
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Due:
                Created:
                Updated: