Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18477 Über-jira: S3A Hadoop 3.3.9 features
  3. HADOOP-16432

Review S3A documentation to make sure it is consistent with the current codebase

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0
    • None
    • documentation, fs/s3
    • None

    Description

      We need to review the hadoop-aws docs and make sure that it is consistent with the current codebase

      • The performance.md doc is out of date w.r.t DDB on-demand and the threads, distcp (no -direct); maybe more.
      • We should review the assumed role doc and combine the S3 and S3Guard permissions into one list
      • the list of AWS regions is out of date (china 1 & 2, hong-kong, osaka)
      • benchmark rename performance of large & huge files
      • see if there is any current work on time-to-consistency for lists and updates

      We also need to pull up the classpath problems "don't mix JARs unless you like stack traces" as the #1 entry on the list, as its the recurrent problem downstream, someone adding a new hadoop-aws JAR to a spark installation and then complaining about CNFEs

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            stevel@apache.org Steve Loughran

            Dates

              Created:
              Updated:

              Slack

                Issue deployment