Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-15681

Customization of S3 client retry/throttling logic

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Workaround
    • None
    • 8.11
    • None

    Description

      Currently there are very few configuration options for users to customize how the s3-repository module interacts with S3.

      One such option that would be very beneficial, especially given how many files Solr backups can use, would be retry and throttling logic. The AWS client provides a few options to customize the number of retries, and backoff logic, when requests do not succeed.

      We don't want to give users a 1000 options to configure the S3 client in the solr.xml, but we can definitely give a few popular options that would help optimize for their use cases. Retries and throttling backoff logic seem like 2 good options to start with.

      Attachments

        Issue Links

          Activity

            People

              houston Houston Putman
              houston Houston Putman
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: