Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14892

Close the output stream if createWrappedOutputStream() fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • encryption
    • None

    Description

      create() in an encryption zone is a two step process by the client. First, a regular FSOutputStream is created and then it is wrapped with an encrypted stream. When there is a system issue or a KMS ACL-based denial, the second phase will fail. If the client terminates right away, the shutdown hook closes the output stream opened in the first phase. But if the client lives on, the output stream will leak.

      Datanode's WebHdfsHandler, DFSClient, DistributedFileSystem, Hdfs (FileContext) and RpcProgramNfs3 do this.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16885 Encryption zone file copy failure leaks temp file ._COPYING_ and wrapped stream

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16884 Encryption zone file copy failure leaks temp file ._COPYING_ and wrapped stream

          • Major - Major loss of function.
          • Patch Available

          Bug - A problem which impairs or prevents the functions of the product. HDFS-15192 Leaking stream when access encrypted files hit exception via webhdfs

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              Unassigned Unassigned
              kihwal Kihwal Lee
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated: