Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7166

map-only job should ignore node lost event when task is already succeeded

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.5, 3.0.0, 3.1.1, 2.8.5, 2.7.7, 2.9.2
    • Fix Version/s: 3.3.0
    • Component/s: mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When node lost, all mappers on this node will be rescheduled, but it's unnecessary for succeeded map only task because map only job has no reducer, and map output has been written to HDFS when it become succeeded, so we can ignore this node lost event.

        Attachments

        1. MAPREDUCE-7166.003.patch
          9 kB
          Lei Li
        2. MAPREDUCE-7166.002.patch
          9 kB
          Lei Li
        3. MAPREDUCE-7166.001.patch
          8 kB
          Lei Li

          Activity

            People

            • Assignee:
              lorinlee Lei Li
              Reporter:
              uranus Zhaohui Xin
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: