Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3239

Records lost while import from Teradata

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.4.6
    • None
    • sqoop2-jdbc-connector
    • None
    • 1.4.6-cdh5.5.6

    Description

      While importing data from relational DB(Teradata in this case) records are lost.
      This happens in situation while number of records in source tables is less than number of mappers specified using option --num-mappers.

      Checking the SQL statments created for data extract at Teradata. The problematic query has a where clause of
      WHERE "ID" >= '1' AND "ID" < '1'
      This condition never satisfies and the record with ID = 1 is left out.

      The source has 6 records with ID starting from 1 to 6. number of mappers specified is --num-mappers 8 . --split-by ID

      Attachments

        Activity

          People

            Unassigned Unassigned
            abin.peter123@gmail.com Abin Peter
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: