Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Consider we have overlapping regions which contains reference files,
when -fixHdfsOverlaps hbck command is run due to region overlap,a new region is created and all data is merged into the new region along with the reference files if present.
For example:
1.create table 't'
2.Insert records {00,111,200} into the table 't'and flush the data
3.split the table 't' with split-key '100'
4.Now we have three regions( 1 parent and two daughter regions )
1.parent_region('Empty','Empty') => {00,111,200}
2.daughter_region-1('Empty','100')=>{00}
3.daughter_region-2('100','Empty')=>{111,200}
5.Make sure parent_region is not deleted and also references of parent region are not cleaned for the daughter regions in file system and run -fixHdfsOverlaps command
The command will copy all the data of overlapping regions along with the reference files into new_ region.
Run -fixMeta command to fix meta issues.
when -fixAssignments command is run to fix assignment issues in table,the new_region wont be assigned as reference files which is present in it will be pointing to the parent_region ( -fixHdfsOverlaps command will move all the data into new region and sideline the other overlapped regions) and it will try assigning the parent_region which does not exist.