[FLINK-22865] Optimize state serialize/deserialize in PyFlink - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Done
Affects Version/s: 1.14.0
Fix Version/s: 1.14.0
Component/s: API / Python
Labels:
- auto-unassigned
- pull-request-available

Description

Currently we use Pickle to serialize/deserialize all types of state. If we can use dedicated serializers to serialize/deserialize these state of python basic object. It can provide 3X performance improvement in serialize/deserialize.

Attachments

Issue Links

links to

GitHub Pull Request #16069

Activity

People

Assignee:: Huang Xingbo

Reporter:: Huang Xingbo

Votes:: 1 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 03/Jun/21 08:38

Updated:: 14/Dec/21 09:05

Resolved:: 14/Jul/21 04:02