Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
2.8.1
-
None
-
None
Description
I upgraded Kafka from 2.12_2.4.1 to 2.13_2.8.1 version. From then, __consumer_offsets-45 log cannot clean.
kafka version：2.13_2.8.1
jdk version: openjdk 11.0.2
linux version: 4.4.71-1.el7.elrepo.x86_64 (mockbuild@Build64F25) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-11)
log-cleaner.log info
// more kafka_2.13-2.8.1/logs/log-cleaner.log.2022-03-23-11 [2022-03-23 11:59:03,571] INFO Starting the log cleaner (kafka.log.LogCleaner) [2022-03-23 11:59:03,633] INFO [kafka-log-cleaner-thread-0]: Starting (kafka.log.LogCleaner) [2022-03-23 11:59:04,234] INFO Cleaner 0: Beginning cleaning of log __transaction_state-9. (kafka.log.LogCleaner) [2022-03-23 11:59:04,235] INFO Cleaner 0: Building offset map for __transaction_state-9... (kafka.log.LogCleaner) [2022-03-23 11:59:04,294] INFO Cleaner 0: Building offset map for log __transaction_state-9 for 1 segments in offset range [0, 118584). (kafka.log.LogCleaner) [2022-03-23 11:59:04,435] INFO Cleaner 0: Offset map for log __transaction_state-9 complete. (kafka.log.LogCleaner) [2022-03-23 11:59:04,436] INFO Cleaner 0: Cleaning log __transaction_state-9 (cleaning prior to Tue Nov 30 17:52:18 CST 2021, discarding tombstones prior to Thu Jan 0 1 08:00:00 CST 1970)... (kafka.log.LogCleaner) [2022-03-23 11:59:04,443] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=152354, lastModifiedTime=1638265938290, largestRecordTimestamp=Some(1638265938290)) i n log __transaction_state-9 into 0 with deletion horizon 0, retaining deletes. (kafka.log.LogCleaner)
cleaner-offset-checkpoint info
[admin@XXXXXXXXXXXXXXX ~]$ cat data/kafka-logs/cleaner-offset-checkpoint 0 99 __transaction_state 7 85731 __consumer_offsets 25 2310286231 __transaction_state 0 47287 __transaction_state 6 53470 __transaction_state 18 29151 __consumer_offsets 22 2025808320 __transaction_state 42 188187 __consumer_offsets 30 432921676 __transaction_state 31 18666 __transaction_state 45 52156 __transaction_state 15 416390 __transaction_state 12 393816 __consumer_offsets 8 402586656 __consumer_offsets 21 1012193789 __consumer_offsets 4 473338672 __transaction_state 46 230722 __consumer_offsets 27 480427838 __consumer_offsets 7 524517122 __transaction_state 48 42549 __consumer_offsets 9 441859835 __transaction_state 49 47535 __consumer_offsets 46 571154678 __consumer_offsets 35 450957687 __transaction_state 28 19026 __transaction_state 2 45994 __transaction_state 20 30522 __transaction_state 24 47341 __consumer_offsets 41 630630351 __consumer_offsets 33 1264879478 __consumer_offsets 23 501207312 __transaction_state 13 439134 __consumer_offsets 49 729019855 __consumer_offsets 47 522662343 __consumer_offsets 16 3750767931 __consumer_offsets 28 411700445 __transaction_state 37 29689 __transaction_state 3 46614 __consumer_offsets 31 1032954867 __transaction_state 21 30525 __consumer_offsets 36 497613885 __transaction_state 29 18879 __consumer_offsets 42 498365278 __consumer_offsets 3 411713277 __consumer_offsets 18 1389078671 __transaction_state 39 32046 __consumer_offsets 37 693879385 __transaction_state 38 29483 __consumer_offsets 15 459557511 __consumer_offsets 24 472248935 __transaction_state 14 354101 __transaction_state 10 154090 __transaction_state 44 279604 __transaction_state 9 118584 __transaction_state 22 47669 __transaction_state 43 183150 __transaction_state 4 51629 __transaction_state 30 19312 __transaction_state 33 19110 __consumer_offsets 38 426170690 __consumer_offsets 48 901521233 __consumer_offsets 17 572951951 __transaction_state 32 19257 __transaction_state 25 30406 __transaction_state 17 29094 __consumer_offsets 19 480121644 __consumer_offsets 11 414732877 __transaction_state 23 48148 __transaction_state 47 51783 __consumer_offsets 13 502754270 __consumer_offsets 2 671995606 __consumer_offsets 43 1653739033 __consumer_offsets 6 561249470 __consumer_offsets 14 420688971 __transaction_state 26 30074 __transaction_state 36 30105 __transaction_state 5 61932 __transaction_state 8 125395 __consumer_offsets 0 378236239 __consumer_offsets 44 1318426000 __transaction_state 11 128083 __consumer_offsets 20 646102919 __transaction_state 16 421407 __consumer_offsets 39 574972378 __consumer_offsets 12 557238642 __transaction_state 40 163727 __consumer_offsets 1 500129407 __consumer_offsets 5 577571358 __consumer_offsets 26 735426985 __transaction_state 19 29236 __transaction_state 27 22656 __consumer_offsets 34 425587446 __consumer_offsets 29 579775801 __transaction_state 41 164107 __transaction_state 1 45750 __consumer_offsets 10 421962673 __consumer_offsets 32 464195167 __transaction_state 34 19492 __transaction_state 35 19083 __consumer_offsets 40 410754361