Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4491 Encryption and Key Protection
  3. MAPREDUCE-5025

Key Distribution and Management for supporting crypto codec in Map Reduce

Add voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • security
    • None

    Description

      This task defines the work to enable Map Reduce to utilize the Crypto Codec framework to support encryption and decryption of data during MapReduce Job.

      According to the some real use case and discussions from the community, for encryption and decryption files in Map Reduce, we have the following requirements:
      1. Different stages (input, output, intermediate output) should have the flexibility to choose whether encrypt or not, as well as which crypto codec to use.
      2. Different stages may have different scheme of providing the keys.
      3. Different Files (for example, different input files) may have or use different keys.
      4. Support a flexible way of retrieving keys for encryption or decryption.

      So this task defines and provides the framework for supporting these requirements as well as the implementations for common use and key retrieving scenarios.

      The design document of this part is included in the Hadoop Crypto Design attached in HADOOP-9331.

      Attachments

        1. MAPREDUCE-5025.patch
          241 kB
          Haifeng Chen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jerrychenhf Haifeng Chen
            jerrychenhf Haifeng Chen

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 504h
                504h
                Remaining:
                Remaining Estimate - 504h
                504h
                Logged:
                Time Spent - Not Specified
                Not Specified

                Slack

                  Issue deployment