Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-16114

Fix partiton not retention after cancel alter intra broker log dir task

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.2, 3.6.1
    • None
    • log
    • None

    Description

      The deletion thread will not work on partition after cancel alter intra broker log dir task 

      The steps to reproduce are as follows:
      1、Create reassignment.json file
      test01-1 on the /data01/kafka/log01 directory of the broker 1003,then move to /data01/kafka/log02 

      {
          "version": 1,    
          "partitions": [
              {
                  "topic": "test01",  
                  "partition": 1,
                  "replicas": [1001,1003],
                  "log_dirs": ["any","/data01/kafka/log02"]
              }
          ]
      }

      2、Kick off the reassignment

      bin/kafka-reassign-partitions.sh -bootstrap-server localhost:9092 --reassignment-json-file reassignment.json  -execute 

      3、Cancel the reassignment

      bin/kafka-reassign-partitions.sh -bootstrap-server localhost:9092 --reassignment-json-file reassignment.json  -cancel 

      4、Result, The partition test01-1 on 1003 will not be deleted 

      The reason for this problem is the partition has been filtered:

      val deletableLogs = logs.filter {
        case (_, log) => !log.config.compact // pick non-compacted logs
      }.filterNot {
        case (topicPartition, _) => inProgress.contains(topicPartition) // skip any logs already in-progress
      } 

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              albedooooooo wangliucheng
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: