Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-923

Improve controller failover latency

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • controller

    Description

      During controller failover, we do the following things -

      1. Increment controller epoch
      2. Initialize controller context
      3. Initialize replica state machine
      4. Initialize partition state machine

      During step 2 above, we read the information of all topics and partitions, the replica assignments and leadership information. During step 3 and 4, we re-read some of this information from zookeeper. Since the zookeeper reads are proportional to the number of topics and the reads are serial, it is important to optimize this. The zookeeper reads in steps 3 and 4 are not required.

      Attachments

        1. kafka-923-v2.patch
          5 kB
          Neha Narkhede
        2. kafka-923-v1.patch
          3 kB
          Neha Narkhede

        Activity

          People

            nehanarkhede Neha Narkhede
            nehanarkhede Neha Narkhede
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: