Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-27140

Set HADOOP_PROXY_USER cause hiveMetaStoreClient close everytime

    XMLWordPrintableJSON

Details

    Description

      In order to use proxy user to access hive metastore server with kerberos, I set HADOOP_PROXY_USER = proxy user.

      this is the code of  HiveMetaStoreClient

      but when I run a spark job with hive metatsore client, the connection to  hive metatsore server always close 

      and I notice that some log before close :

      Mestastore configuration hive.metastore.token.signature changed from DelegationTokenForHiveMetaStoreServer to

      so we can find why the connection close always,  hive metatsore client will compare  currentMetaVars with hiveconf

      but if we set HADOOP_PROXY_USER and init  hive metatsore client, the  ConfVars.METASTORE_TOKEN_SIGNATURE always is set

      so I think this solutions can fix the bug:

      ConfVars.METASTORE_TOKEN_SIGNATURE  is no need to check in hive metatsore client

      obviously that is no more close

       

      Attachments

        1. image-2023-03-14-21-56-27-408.png
          371 kB
          chenruotao
        2. image-2023-03-14-21-56-06-605.png
          269 kB
          chenruotao
        3. image-2023-03-14-21-03-52-764.png
          242 kB
          chenruotao
        4. image-2023-03-14-21-00-18-049.png
          223 kB
          chenruotao
        5. image-2023-03-14-20-56-00-757.png
          203 kB
          chenruotao
        6. image-2023-03-14-20-53-40-132.png
          342 kB
          chenruotao
        7. image-2023-03-14-20-51-32-317.png
          218 kB
          chenruotao

        Issue Links

          Activity

            People

              chenruotao chenruotao
              chenruotao chenruotao
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m