Kafka Tiered Storage V1

KAFKA-15341 Enabling TS for a topic during rolling restart causes problems

• 
• Open

KAFKA-15678 [Tiered Storage] Stall remote reads with long-spanning transactions

• 
• Open

KAFKA-15660 File-based Tiered Storage should delete folders upon topic deletion

• 
• Open

KAFKA-15331 Handle remote log enabled topic deletion when leader is not available

• 
• In Progress

KAFKA-15481 Concurrency bug in RemoteIndexCache leads to IOException

• 
• Resolved

KAFKA-15511 Exception not handled correctly if indexFile is corrupted.

• 
• Resolved

KAFKA-15620 Duplicate remote log DELETE_SEGMENT metadata is generated when there are multiple leader epochs in the segment

• 
• Resolved

KAFKA-15695 Local log start offset is not updated on the follower after rebuilding remote log auxiliary state

• 
• Resolved

KAFKA-15802 Trying to access uncopied segments metadata on listOffsets

• 
• Resolved

KAFKA-16073 Kafka Tiered Storage: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

• 
• Resolved

KAFKA-16511 Leaking tiered segments

• 
• Resolved

KAFKA-15609 Corrupted index uploaded to remote tier

• 
• Resolved

KAFKA-15388 Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

• 
• Patch Available

KAFKA-15931 Cached transaction index gets closed if tiered storage read is interrupted

• 
• Patch Available

KAFKA-16228 Add --remote-log-metadata-decoder to kafka-dump-log.sh

• 
• Open

KAFKA-15132 Implement disable & re-enablement for Tiered Storage

• 
• In Progress

KAFKA-14915 Option to consume multiple partitions that have their data in remote storage for the target offsets.

• 
• Open

KAFKA-15166 Add deletePartition API to the RemoteStorageManager

• 
• Open

KAFKA-15195 Regenerate segment-aligned producer snapshots when upgrading to a Kafka version supporting Tiered Storage

• 
• Open

KAFKA-15231 Add ability to pause/resume Remote Log Manager tasks

• 
• Open

KAFKA-15265 Remote copy/fetch quotas for tiered storage.

• 
• Open

KAFKA-15313 Delete remote log segments partition asynchronously when a partition is deleted.

• 
• Open

KAFKA-15433 Follower fetch from tiered offset

• 
• Open

KAFKA-15857 Introduce LocalLogStartOffset and TieredOffset in OffsetSpec.

• 
• Open

KAFKA-15864 Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage.

• 
• Open

KAFKA-14877 refactor InMemoryLeaderEpochCheckpoint

• 
• Open

KAFKA-15094 Add RemoteIndexCache metrics like misses/evictions/load-failures.

• 
• In Progress

KAFKA-15434 Tiered Storage Quotas

• 
• In Progress

KAFKA-14912 Introduce a configuration for remote index cache size, preferably a dynamic config.

• 
• Resolved

KAFKA-15047 Handle rolling segments when the active segment's retention is breached incase of tiered storage is enabled.

• 
• Resolved

KAFKA-15147 Measure pending and outstanding Remote Segment operations

• 
• Resolved

KAFKA-15241 Compute tiered offset by keeping the respective epochs in scope.

• 
• Resolved

KAFKA-15245 Improve Tiered Storage Metrics

• 
• Resolved

KAFKA-15432 RLM Stop partitions should not be invoked for non-tiered storage topics

• 
• Resolved

KAFKA-16161 Avoid creating remote log metadata snapshot file in partition data directory.

• 
• Resolved

KAFKA-15401 Segment with corrupted index should not be uploaded to remote storage

• 
• Resolved

KAFKA-15529 Flaky test ReassignReplicaShrinkTest.executeTieredStorageTest

• 
• Open

KAFKA-9578 Kafka Tiered Storage - System Tests

• 
• Open

KAFKA-15169 Add tests for RemoteIndexCache

• 
• Resolved

KAFKA-15439 Add transaction tests enabled with tiered storage

• 
• Resolved

KAFKA-15453 Enable `testFencingOnTransactionExpiration` in TransactionsWithTieredStoreTest

• 
• Resolved

KAFKA-15499 Fix the flaky DeleteSegmentsDueToLogStartOffsetBreachTest

• 
• Resolved

KAFKA-15671 Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

• 
• Resolved

KAFKA-15206 Flaky test RemoteIndexCacheTest.testClose()

• 
• Resolved

KAFKA-13560 Load indexes and data in async manner in the critical path of replica fetcher threads.

• 
• Open

KAFKA-15300 Include remotelog size in complete log size and also add local log size and remote log size separately in kafka-log-dirs tool.

• 
• Open

KAFKA-15431 Add support to assert offloaded segment for already produced event in Tiered Storage Framework

• 
• Open

KAFKA-15682 Ensure internal remote log metadata topic does not expire its segments before deleting user-topic segments

• 
• Open

KAFKA-15777 Configurable remote fetch bytes per partition from Consumer

• 
• Open

KAFKA-15859 Introduce delayed remote list offsets to make LIST_OFFSETS async

• 
• Open

KAFKA-16454 Snapshot the state of remote log metadata for all the partitions

• 
• Open

KAFKA-15214 Add metrics for OffsetOutOfRangeException when tiered storage is enabled

• 
• Open

KAFKA-15376 Explore options of removing data earlier to the current leader's leader epoch lineage for topics enabled with tiered storage.

• 
• Reopened

KAFKA-15535 Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

• 
• Resolved

KAFKA-15703 Update Highwatermark while building the remote log auxiliary state

• 
• Resolved

KAFKA-16146 Checkpoint log-start-offset for remote log enabled topics

• 
• Resolved

KAFKA-14467 Add a test to validate the replica state after processing the OFFSET_MOVED_TO_TIERED_STORAGE error, especially for the transactional state

• 
• Patch Available

KAFKA-15776 Update delay timeout for DelayedRemoteFetch request

• 
• Patch Available

KAFKA-16452 Bound highwatermark offset to range b/w local-log-start-offset and log-end-offset

• 
• Patch Available

KAFKA-15038 Use topic id/name mapping from the Metadata cache in the RemoteLogManager

• 
• Patch Available