[BEAM-12776] Improve parallelism of closing files in FileIO - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: P3
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: io-java-files
Labels:
None

Description

Currently close happens in processElement which is per-window.
If there are many windows firing this can throttle throughput waiting for IO instead of closing in parallel in finishBundle.

Attachments

Issue Links

links to

GitHub Pull Request #15354

Activity

People

Assignee:: Unassigned

Reporter:: Sam Whittle

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 19/Aug/21 09:10

Updated:: 04/Jun/22 21:34

Time Tracking

Estimated:

Not Specified

Remaining:

Logged: