Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18477 Über-jira: S3A Hadoop 3.3.9 features
  3. HADOOP-18698

S3ABlockOutputStream doesn't collect stats on multipart block uploads

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 3.3.5
    • None
    • fs/s3
    • None

    Description

      assertion failures in HADOOP-18695 show that S3ABlockOutputStream isn't collecting stats on how long the individual post calls of multipart uploads: duration or number.
      that is despite some counters in the IOStatistics of the stream set up to do this and merge to the FS in close()

      Looks like the simplest fix is to instrument the FS to do collect these, rather than in-stream. in stream would be best for context stats

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: