Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-3385

Error while connecting to S3 using Sqoop

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.4.7
    • Fix Version/s: None
    • Component/s: connectors
    • Labels:

      Description

      I am facing an issue while trying to import file from On Prem DB to S3 using Sqoop.

      Things I an able to do-

      1- I am connected to S3 , able to run aws s3 ls & other AWS cli commands

      2- Able to generate a file connecting to DB to local Unix box.

      But when I change the target directory to S3 instead of locat I am getting below error-

       
      "ERROR tool.ImportTool: Import failed: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or fs.s3.awsSecretAccessKey properties (respectively)."
       
      Ideally the Sqoop installation should be able to pick up the credentials from credential file inside .aws directory of the user running the command but  Is there a way I can specify the credentials?
       
      Thanks in advance.
       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              coolsm19 Suchit
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: