Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15570

LLAP: Exception in HostAffinitySplitLocationProvider when running in container mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.3.0
    • llap

    Description

      Sometimes user might prefer to run with "hive.execution.mode=container" mode when LLAP is stopped. If hive config for LLAP had "hive.llap.client.consistent.splits=true" in client side, it would end up throwing the following exception in Utils.java.

      Caused by: java.lang.reflect.InvocationTargetException
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
              at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68)
              ... 25 more
      Caused by: java.lang.IllegalStateException: org.apache.hadoop.hive.ql.exec.tez.HostAffinitySplitLocationProvider needs at least 1 location to function
              at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
              at org.apache.hadoop.hive.ql.exec.tez.HostAffinitySplitLocationProvider.<init>(HostAffinitySplitLocationProvider.java:52)
              at org.apache.hadoop.hive.ql.exec.tez.Utils.getSplitLocationProvider(Utils.java:54)
              at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:121)
              ... 30 more
      

      Attachments

        1. HIVE-15570.1.patch
          2 kB
          Rajesh Balamohan
        2. HIVE-15570.2.patch
          4 kB
          Zhiyuan Yang
        3. HIVE-15570.3.patch
          3 kB
          Zhiyuan Yang

        Activity

          People

            zhiyuany Zhiyuan Yang
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: