Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-9221

If some image layers are large, the image pulling may stuck due to the authorized token expired.

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.4.2, 1.5.0
    • None
    • containerization

    Description

      The image layer blobs pulling happen asynchronously but in the same libprocess process. There is a chance that one layer get the token then the thread switch to another layer curling which may take long. When the original layer curling resumes, the token already expired (e.g., after 60 seconds).

      $ sudo cat /var/lib/mesos/slave/store/docker/staging/0gx64f/sha256\:c75480ad9aafadef6c7faf829ede40cf2fa990c9308d6cd354d53041b01a7cda
      {"errors":[{"code":"UNAUTHORIZED","message":"authentication required","detail":[{"Type":"repository","Class":"","Name":"mesosphere/dapis","Action":"pull"}]}]}
      

      The impact is the task launch stuck and all subsequent task using this image would also stuck because it waits for the same image pulling future to become ready.

      Please note that this issue is not likely to be reproduced, unless on a busy system using images containing large layers.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            chhsia0 Chun-Hung Hsiao
            gilbert Gilbert Song
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment