Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5305

Yarn Application Log Aggregation fails due to NM can not get correct HDFS delegation token III

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.5.0
    • yarn
    • Reviewed

    Description

      Different with YARN-5098 and YARN-5302, this problem happens when AM submits a startContainer request with a new HDFS token (say, tokenB) which is not managed by YARN, so two tokens exist in the credentials of the user on NM, one is tokenB, the other is the one renewed on RM (tokenA). If tokenB is selected when connect to HDFS and tokenB expires, exception happens.

      Supplementary: this problem happen due to that AM didn't use the service name as the token alias in credentials, so two tokens for the same service can co-exist in one credentials. TokenSelector can only select the first matched token, it doesn't care if the token is valid or not.

      Attachments

        Issue Links

          Activity

            People

              pszucs Peter Szucs
              xinxianyin Xianyin Xin
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: