Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-18028 High performance S3A input stream with prefetching & caching
  3. HADOOP-18221

stream warns Not all bytes were read from the S3ObjectInputStream when closed

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • None
    • None

    Description

      Issue: https://github.com/aws/aws-sdk-java/issues/1211 has resurfaced in the prefetching stream when it is closed before reading for blocks is complete. This can be fixed by draining the stream before closing 

      Attachments

        Issue Links

          is a parent of

          Sub-task - The sub-task of the issue HADOOP-18230 Use async drain threshold to decide b/w async and sync draining

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #4294

          Activity

            People

              ahmar Ahmar Suhail
              ahmar Ahmar Suhail
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m