Details
-
Improvement
-
Status: Resolved
-
P3
-
Resolution: Won't Fix
-
None
-
None
Description
Dataflow Java runner uses 0.1 secs interval for polling bundle progress from SDK Harness, and use the result to decide whether data transfer should be throttled. This can potentially overload SDK Harness.
We should try to come up with a way to avoid the throttling and lower the bundle progress request frequency significantly.
Code reference:
Attachments
Issue Links
- is caused by
-
BEAM-5791 Bound the amount of data on the data plane by time.
- Open