-
Notifications
You must be signed in to change notification settings - Fork 4.4k
Closed
Description
What happened?
Iceberg uses SchemaCoder in several locations.
beam/sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/SnapshotInfo.java
Line 153 in 6d24c3d
| coder = registry.getSchemaCoder(SnapshotInfo.class); |
beam/sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/ReadTask.java
Line 42 in c236996
| coder = SchemaRegistry.createDefault().getSchemaCoder(ReadTask.class); |
beam/sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/ReadTaskDescriptor.java
Line 37 in c236996
| coder = SchemaRegistry.createDefault().getSchemaCoder(ReadTaskDescriptor.class); |
Using SchemaCoder (as opposed to RowCoder, for example) can result in update compatibility issues for Dataflow Runner v2. These can be addressed by adding SchemaFieldNumber annotations similar to #36295.
Issue Priority
Priority: 2 (default / most bugs should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner