Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7024

Rocksdb state directory should be created before opening the DB

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.2.0
    • streams

    Description

      After enabling rocksDB logging, We continually see these errors in kafka stream logs, everytime a new window segment is created
      ```
      Error when reading <rocksdb-directory-path>
      ```
      While its not a problem in itself, since rocksDB internally will create the directory but It will do so only after logging the above error. It would avoid unnecessary logging if the segment directory can be created in advance. Right now, only the parent directories are created for a rocksDB segment. Logging is more prominent when there are many partitions and segment size is smaller (minute or two).

      Attachments

        Issue Links

          Activity

            People

              Yohan123 Richard Yu
              abhishek.agarwal Abhishek Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: