Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8411

Option to keep tombstones forever in compacted logs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • log cleaner
    • None

    Description

      Log compaction is great to balance between having all data in a topic and reducing the amount of messages in a topic.

      However the delete tombstones are cleaned after a certain period. For some use cases we would really like to keep the latest message of each key, which means also the tombstone of that ID should be kept forever.

      An option to configure delete.retention.ms to e.g. -1 to enable this functionality would be great.

      Attachments

        Activity

          People

            Unassigned Unassigned
            lukaswelte Lukas Welte
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: