2.29.0 cherrypick: WindmillStateCache has a 0% hit rate in 2.29

After upgrading to 2.29, I noticed that our jobs have a 0% state cache hit rate.  I see a very high eviction rate from the cache as well (it used to be ~0, now its ~100,000+ evictions / second).

We never were on 2.28, so I can't say if it worked there, but it did work on 2.27.