Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6573

Reduce the time of calling scanIntermediateDirectory in getFileInfo

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • jobhistoryserver
    • None

    Description

      In getFileInfo of HistorFileManager, scanIntermediateDirectory is called multiple times. It can have an impact on periodic directory scan task.
      We can optimize to reducing the calling time.

      Attachments

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6684 High contention on scanning of user directory under immediate_done in Job History Server

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6436 JobHistory cache issue

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lewuathe Kai
            lewuathe Kai
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment