Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4594

container-executor fails to remove directory tree when chmod required

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1, 2.8.2
    • nodemanager
    • None
    • Reviewed

    Description

      test-container-executor.c doesn't work:

      • It assumes that realpath(/bin/ls) will be /bin/ls, whereas it is actually /usr/bin/ls on many systems.
      • The recursive delete logic in container-executor.c fails – nftw does the wrong thing when confronted with directories with the wrong mode (permission bits), leading to an attempt to run rmdir on a non-empty directory.

      Attachments

        1. YARN-4594.001.patch
          9 kB
          Colin McCabe
        2. YARN-4594.002.patch
          9 kB
          Colin McCabe
        3. YARN-4594.003.patch
          9 kB
          Colin McCabe
        4. YARN-4594.004.patch
          9 kB
          Colin McCabe

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. YARN-4731 container-executor should not follow symlinks in recursive_unlink_children

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. YARN-7333 container-executor fails to remove entries from a directory that is not writable or executable

        • Critical - Crashes, loss of data, severe memory leak.
        • Resolved
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-8887 Use a Maven plugin to build the native code using CMake

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cmccabe Colin McCabe Assign to me
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment