Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9698 [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
  3. YARN-10135

FS-CS converter tool: issue warning on dynamic auto-create mapping rules

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • Reviewed

    Description

      The converter tool should issue a warning whenever the conversion results in mapping rules similar to these:

      u:%user:[managedParentQueueName].[queueName]

      u:%user:[managedParentQueueName].%user

      u:%user:[managedParentQueueName].%primary_group

      u:%user:[managedParentQueueName].%secondary_group

      u:%user:%primary_group.%user

      u:%user:%secondary_group.%user

      u:%user:[managedParentQueuePath].%user

       

      The reason is that right now it's fully clear how we'll handle a case like "u:%user:%primary_group.%user", where "%primary_group.%user" might result in something like "users.john". 

      In case of "u:%user:[managedParentQueuePath].%user" , the [managedParentQueuePath] is a result of a full path from Fair Scheduler. Therefore it's not going to be a leaf queue. 

      The user might be required to do some fine tuning and adjust the property "auto-create-child-queues". We should display a warning about these additional steps.

       

       

      Attachments

        1. YARN-10135-001.patch
          8 kB
          Peter Bacsko
        2. YARN-10135-002.patch
          8 kB
          Peter Bacsko

        Activity

          People

            pbacsko Peter Bacsko
            pbacsko Peter Bacsko
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: