Details
-
Bug
-
Status: Open
-
P2
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently, we can't use the logical types defined in java JDBC IO in XLang pipelines for JDBC IO in Go SDK as it throws the following error:
unmarshalling coder jFYvjSCanTRowCoder_length_prefixed_windowed unmarshalling coder jFYvjSCanTRowCoder_length_prefixed cannot convert schema field role_name to field caused by: unknown logical type: beam:logical_type:javasdk:v1
This is the structure of table and its corresponding struct:
// roles=> CREATE TABLE roles( // role_id serial PRIMARY KEY, // role_name VARCHAR (255) UNIQUE // ); type JdbcTestRow struct { Role_id int32 `beam:"role_id"` Role_name string `beam:"role_name"` }
Similar error seems to be appearing on Python SDK pipeline based on this stack overflow question: (https://stackoverflow.com/questions/68758361/error-beamlogical-typejavasdkv1-while-using-apache-beam-io-jdbc-readfromjdbc)