Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.4.6
-
None
-
None
-
1.4.6-cdh5.5.6
Description
While importing data from relational DB(Teradata in this case) records are lost.
This happens in situation while number of records in source tables is less than number of mappers specified using option --num-mappers.
Checking the SQL statments created for data extract at Teradata. The problematic query has a where clause of
WHERE "ID" >= '1' AND "ID" < '1'
This condition never satisfies and the record with ID = 1 is left out.
The source has 6 records with ID starting from 1 to 6. number of mappers specified is --num-mappers 8 . --split-by ID