Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3453

Kite sdk issue with sqoop version 1.4.7

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.4.7
    • None
    • connectors/oracle
    • None

    Description

       

      Trying to run sqoop import command with sqoop version 1.4.7 and kite sdk version 1.1.0.

      /usr/lib/sqoop/bin/sqoop import -Dmapreduce.map.memory.mb=2048 -Dmapred.fairscheduler.pool=sqoop-coop -Doraoop.timestamp.string=false --connect jdbc:oracle:thin:@abc.net:1521/coopdvm --username abc --password-file s3://abc/user/app.ab.core_etl/credentials/coopdvm_coop --target-dir 's3://abc/dev/temp/TEST_MEIS/T1/master/timestamp=20191017103331' --direct --as-parquetfile -z --map-column-java ID=Integer --query "select ID from TEST_MEIS.T1 where \$CONDITIONS" -m 1 --verbose

      Failing with below issue:

      App > 19/10/23 05:58:04 DEBUG util.ClassLoaderStack: Restoring classloader: sun.misc.Launcher$AppClassLoader@642c39d2
      App > 19/10/23 05:58:04 DEBUG manager.OracleManager$ConnCache: Caching released connection for jdbc:oracle:thin:@abc:1521/coopdvm/coop
      App > 19/10/23 05:58:04 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset:s3://abc/dev/temp/TEST_MEIS/T1/master/timestamp=20191017103331
      App > Check that JARs for s3 datasets are on the classpath
      App > org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset:s3://abc/dev/temp/TEST_MEIS/T1/master/timestamp=20191017103331
      App > Check that JARs for s3 datasets are on the classpath
      App > at org.kitesdk.data.spi.Registration.lookupDatasetUri(Registration.java:128)
      App > at org.kitesdk.data.Datasets.exists(Datasets.java:624)
      App > at org.kitesdk.data.Datasets.exists(Datasets.java:646)
      App > at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:118)
      

       Can anyone help in debugging or suggest any workaround?

       

       

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              saiyam1712 Saiyam Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: