flink-proto-confluent¶
A Confluent Schema Registry Protobuf format for Apache Flink SQL and the Table API. Read and write Kafka topics whose values (and keys) are Protobuf messages framed in the Confluent wire format, with the schema resolved from Schema Registry.
This project is an improved, standalone derivative of amstee/flink-proto-confluent, repackaged under com.bbrownsound.
What you get¶
- A
proto-confluentformat you reference from any Flink Kafka table:'value.format' = 'proto-confluent'. - Dynamic or explicit schemas. Derive the Protobuf schema from the table's row type, or pin a generated message class.
- Poison-record handling. Skip bad records and route them to a dead-letter topic instead of crashing the job.
- Secured registries. TLS, mutual TLS, basic auth and bearer-token auth.
- Schema evolution. Records are decoded with the writer schema named in the wire header, so mixed versions on one topic just work.
Where to go next¶
- Getting Started — add the dependency and run your first query.
- Demos — terminal recordings of the format in action.
- How-to Guides — task-oriented recipes.
- Configuration reference — every option, default and precedence rule.