Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-16727 Support Node Autoscaling in coordination with the Solr Operator
  3. SOLR-16816

AffinityPlacementPlugin should utilize the size of new replicas when making placements

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 9.0
    • 9.3
    • AutoScaling
    • None

    Description

      The AffinityPlacementPlugin has logic to make sure that nodes are not loaded up with more indexes than they can handle. It does this by filtering out nodes in the selection process that have less free disk space than the minimalFreeDiskGB configured.

      However it doesn't take into account the size of the replicas it will create when doing this. So if the minimalFreeDiskGB is 30 GB, and the free disk space on a node is 50G, and a new replica's shard's leader uses 40GB for its index, then the plugin will happily choose this node, even though its likely that the node's free disk space will be 10GB after the replica is created, which is much smaller than the configured minimalFreeDiskGB.

      This information should also be used when sorting on prioritizedFreeDiskGB.

      Attachments

        Issue Links

          Activity

            People

              houston Houston Putman
              houston Houston Putman
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h