XMLWordPrintableJSON

Details

    Description

      In case of cloud deployments, multiple executors are launched on name node, and incase a fixed umbilical port is specified using spark.hadoop.hive.llap.daemon.umbilical.port=30006

      The job fails with BindException.

      Caused by: java.net.BindException: Problem binding to [0.0.0.0:30006] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:840)
      	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:741)
      	at org.apache.hadoop.ipc.Server.bind(Server.java:605)
      	at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:1169)
      	at org.apache.hadoop.ipc.Server.<init>(Server.java:3032)
      	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:1039)
      	at org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:438)
      	at org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:332)
      	at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848)
      	at org.apache.hadoop.hive.llap.tezplugins.helpers.LlapTaskUmbilicalServer.<init>(LlapTaskUmbilicalServer.java:67)
      	at org.apache.hadoop.hive.llap.ext.LlapTaskUmbilicalExternalClient$SharedUmbilicalServer.<init>(LlapTaskUmbilicalExternalClient.java:122)
      	... 26 more
      Caused by: java.net.BindException: Address already in use
      	at sun.nio.ch.Net.bind0(Native Method)
      	at sun.nio.ch.Net.bind(Net.java:433)
      	at sun.nio.ch.Net.bind(Net.java:425)
      	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:220)
      	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:85)
      	at org.apache.hadoop.ipc.Server.bind(Server.java:588)
      	... 34 more

      To counter this, better to provide a range of ports

      Attachments

        Issue Links

          Activity

            People

              ayushtkn Ayush Saxena
              ayushtkn Ayush Saxena
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m