Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5044

Have AM trigger jstack on task attempts that timeout before killing them

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.0-beta
    • 2.8.0, 3.0.0-alpha1
    • mr-am
    • None
    • Reviewed

    Description

      When an AM expires a task attempt it would be nice if it triggered a jstack output via SIGQUIT before killing the task attempt. This would be invaluable for helping users debug their hung tasks, especially if they do not have shell access to the nodes.

      Attachments

        1. MAPREDUCE-5044.008.patch
          35 kB
          Eric Payne
        2. MAPREDUCE-5044.009.patch
          35 kB
          Eric Payne
        3. MAPREDUCE-5044.010.patch
          42 kB
          Eric Payne
        4. MAPREDUCE-5044.011.patch
          58 kB
          Eric Payne
        5. MAPREDUCE-5044.012.patch
          60 kB
          Eric Payne
        6. MAPREDUCE-5044.013.patch
          60 kB
          Eric Payne
        7. MAPREDUCE-5044.v01.patch
          67 kB
          Gera Shegalov
        8. MAPREDUCE-5044.v02.patch
          11 kB
          Gera Shegalov
        9. MAPREDUCE-5044.v03.patch
          6 kB
          Gera Shegalov
        10. MAPREDUCE-5044.v04.patch
          12 kB
          Gera Shegalov
        11. MAPREDUCE-5044.v05.patch
          15 kB
          Gera Shegalov
        12. MAPREDUCE-5044.v06.patch
          16 kB
          Gera Shegalov
        13. MAPREDUCE-5044.v07.local.patch
          35 kB
          Eric Payne
        14. Screen Shot 2013-11-12 at 1.05.32 PM.png
          40 kB
          Gera Shegalov
        15. Screen Shot 2013-11-12 at 1.06.04 PM.png
          191 kB
          Gera Shegalov

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue YARN-1515 Provide ContainerManagementProtocol#signalContainer processing a batch of signals

          • Major - Major loss of function.
          • Open
          is related to

          Task - A task that needs to be done. YARN-445 Ability to signal containers

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1119 When tasks fail to report status, show tasks's stack dump before killing

          • Major - Major loss of function.
          • Closed
          requires

          Task - A task that needs to be done. YARN-445 Ability to signal containers

          • Major - Major loss of function.
          • Open

          Activity

            People

              epayne Eric Payne
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: