Invalid result is occured while running sorting query.

Pre-test

I plan this test with two table. Origin table and Partitioned table.
To verify overall of this test, Checking the number of Above both table's row is required.

SELECT COUNT(*) FROM LINEITEM;

• Partitioned table

  • 600037902
    

• Origin table

  • 600037902
    

Test Result

To verify sorting result with partitioned table, I got the results of this query.

SELECT * FROM LINEITEM ORDER BY L_ORDERKEY DESC;

• Partitoned table

  • ID	State	Started	Finished	Running time	Progress	Succeeded/Total	Failed/Killed
    eb_1441779886367_0002_000001	SUCCEEDED	2015-09-10 13:01:24	2015-09-10 13:02:38	73.0 sec	100%	2526 / 2526	0 / 0
    eb_1441779886367_0002_000002	SUCCEEDED	2015-09-10 13:02:38	2015-09-10 13:33:12	1834.0 sec	100%	1024 / 1024	0 / 0

  • ERROR in 5860748 row! PRE = 594003335, CUR = 594140615
    ERROR in 7034019 row! PRE = 592448001, CUR = 592968743
    ERROR in 19922010 row! PRE = 580040134, CUR = 580078087
    ERROR in 24023839 row! PRE = 575849504, CUR = 575976519
    ERROR in 41021081 row! PRE = 558857479, CUR = 558984327
    ERROR in 48640111 row! PRE = 551040135, CUR = 551367143
    ERROR in 58011375 row! PRE = 540493670, CUR = 541992135
    ERROR in 58599138 row! PRE = 541302916, CUR = 541406183
    ERROR in 65635240 row! PRE = 534144706, CUR = 534374944
    ERROR in 76181838 row! PRE = 523109191, CUR = 523828039
    ERROR in 81458304 row! PRE = 518260352, CUR = 518554599
    ERROR in 84388040 row! PRE = 515293703, CUR = 515624928
    ERROR in 86731345 row! PRE = 512922276, CUR = 513281159
    ERROR in 87902192 row! PRE = 511768965, CUR = 512109287
    ERROR in 93760032 row! PRE = 506094497, CUR = 506249920
    ERROR in 144742500 row! PRE = 455242145, CUR = 455273314
    ERROR in 154706478 row! PRE = 445227847, CUR = 445312359
    ERROR in 156464586 row! PRE = 443357569, CUR = 443554535
    ERROR in 161149080 row! PRE = 438786662, CUR = 438867047
    ERROR in 169353808 row! PRE = 430605447, CUR = 430663911
    ERROR in 200408724 row! PRE = 399423109, CUR = 399609191
    ERROR in 203340371 row! PRE = 396673285, CUR = 396679495
    ERROR in 207440299 row! PRE = 392273699, CUR = 392577927
    ERROR in 220335997 row! PRE = 379540387, CUR = 379687303
    ERROR in 221508476 row! PRE = 378434500, CUR = 378515431
    ERROR in 240261717 row! PRE = 359563844, CUR = 359765415
    ERROR in 241434898 row! PRE = 358428165, CUR = 358593543
    ERROR in 242019745 row! PRE = 357846851, CUR = 358007591
    ERROR in 259602141 row! PRE = 340391335, CUR = 340429447
    ERROR in 267799892 row! PRE = 332186944, CUR = 332226311
    ERROR in 268971553 row! PRE = 331008357, CUR = 331054439
    ERROR in 285964290 row! PRE = 313546273, CUR = 314062247
    ERROR in 288893871 row! PRE = 310836327, CUR = 311132551
    ERROR in 290066748 row! PRE = 309903778, CUR = 309960679
    ERROR in 302373607 row! PRE = 297340899, CUR = 297655975
    ERROR in 325809506 row! PRE = 274072704, CUR = 274218471
    ERROR in 328738013 row! PRE = 270401126, CUR = 271288775
    ERROR in 329323265 row! PRE = 270401126, CUR = 270702823
    ERROR in 336940177 row! PRE = 262139106, CUR = 263085639
    ERROR in 342216974 row! PRE = 257692614, CUR = 257812199
    ERROR in 345732067 row! PRE = 254056451, CUR = 254296580
    ERROR in 351590201 row! PRE = 247701159, CUR = 248437191
    ERROR in 367994513 row! PRE = 231879232, CUR = 232030919
    ERROR in 375614502 row! PRE = 224190530, CUR = 224413735
    ERROR in 406679538 row! PRE = 192772387, CUR = 193359015
    ERROR in 426605529 row! PRE = 173093953, CUR = 173437127
    ERROR in 434804748 row! PRE = 165067393, CUR = 165233991
    ERROR in 448283441 row! PRE = 151524260, CUR = 151757415
    ERROR in 451797834 row! PRE = 148145441, CUR = 148241799
    ERROR in 454727117 row! PRE = 145264580, CUR = 145312103
    ERROR in 456483585 row! PRE = 143458177, CUR = 143554279
    ERROR in 475821410 row! PRE = 123387398, CUR = 124218343
    ERROR in 482854933 row! PRE = 116963045, CUR = 117187079
    ERROR in 484027616 row! PRE = 115980640, CUR = 116015207
    ERROR in 509230546 row! PRE = 90806531, CUR = 90819878
    ERROR in 521534038 row! PRE = 78489349, CUR = 78515175
    ERROR in 526224426 row! PRE = 73512896, CUR = 73827655
    ERROR in 538528599 row! PRE = 61314754, CUR = 61522978
    ERROR in 542633727 row! PRE = 57126501, CUR = 57421412
    ERROR in 560783473 row! PRE = 38886304, CUR = 39257319
    ERROR in 561369664 row! PRE = 38639744, CUR = 38671396
    ERROR in 561955219 row! PRE = 37830561, CUR = 38085447
    ERROR in 568985164 row! PRE = 31048486, CUR = 31054183
    Total row : 600037965
    

• Origin table

  • ID	State	Started	Finished	Running time	Progress	Succeeded/Total	Failed/Killed
    eb_1441779886367_0003_000001	SUCCEEDED	2015-09-10 14:16:17	2015-09-10 14:17:44	87.0 sec	100%	593 / 593	0 / 0
    eb_1441779886367_0003_000002	SUCCEEDED	2015-09-10 14:17:44	2015-09-10 14:28:45	660.0 sec	100%	1024 / 1024	0 / 0

  • Total row : 600037902
    

Conclusion

I found that invalid result is occured while sorting partitioned table. I got Incorrectly ordered result. Furthermore, tajo gives me the abnormal number of total row in ordered result.