Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-12709

Cut s3:// from trunk

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • fs/s3
    • None
    • Incompatible change
    • The s3 file system has been removed. The s3a file system should be used instead.

    Description

      UPDATE: This JIRA ticket is to track the effort of cutting the s3:// from trunk branch. Please see the cloned JIRA ticket HADOOP-13239 for deprecating s3:// from branch-2.

      The fact that s3:// was broken in Hadoop 2.7 and nobody noticed until now shows that it's not being used. while invaluable at the time, s3n and especially s3a render it obsolete except for reading existing data.

      I propose

      1. Mark Java source as @deprecated
      2. Warn the first time in a JVM that an S3 instance is created, "deprecated -will be removed in future releases"
      3. in Hadoop trunk we really cut it. Maybe have an attic project (external?) which holds it for anyone who still wants it. Or: retain the code but remove the fs.s3.impl config option, so you have to explicitly add it for use.

      Attachments

        1. HADOOP-12709.000.patch
          119 kB
          Mingliang Liu
        2. HADOOP-12709.001.patch
          146 kB
          Mingliang Liu
        3. HADOOP-12709.002.patch
          147 kB
          Mingliang Liu
        4. HADOOP-12709.003.patch
          168 kB
          Mingliang Liu
        5. HADOOP-12709.004.patch
          172 kB
          Mingliang Liu
        6. HADOOP-12709.005.patch
          172 kB
          Mingliang Liu
        7. HADOOP-12709-006.patch
          179 kB
          Steve Loughran

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            liuml07 Mingliang Liu
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment