Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5445

Log aggregation configured to different namenode can fail fast

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.7.1
    • None

    Description

      Log aggregation is enabled and configured to write applogs to different cluster or different namespace (NN federation). In these cases, would like to have some configs on attempts or retries to fail fast in case the other cluster is completely down.

      Currently it takes default dfs.client.failover.max.attempts as 15 and hence adding a latency of 2 to 2.5 mins in each container launch (per node manager).

      Attachments

        1. YARN-5445-1.patch
          4 kB
          Chackaravarthy

        Activity

          People

            Unassigned Unassigned
            chackra Chackaravarthy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: