Request might retry forever even if the user API timeout expires

If the request timeout in the background thread, it will be completed with TimeoutException, which is Retriable.  In the TopicMetadataRequestManager and possibly other managers, the request might continue to be retried forever.

There are two ways to fix this

1. Pass a timer to the manager to remove the inflight requests when it is expired.
2. Pass the future to the application layer and continue to retry.