[SPARK-47941] Propagate ForeachBatch worker initialization errors to users for PySpark - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 4.0.0
Fix Version/s: 4.0.0
Component/s: Connect, PySpark, Structured Streaming
Labels:
- pull-request-available

Description

Ensure that errors and exceptions thrown during foreachBatch worker initialization are propagated to the user, instead of just stderr.

Attachments

Issue Links

links to

GitHub Pull Request #46125

Activity

People

Assignee:: Eric Marnadi

Reporter:: Eric Marnadi

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 22/Apr/24 17:53

Updated:: 23/Apr/24 23:45

Resolved:: 23/Apr/24 23:45