Connect CDC SQData

The Kafka Replicator Engine for relational databases beginning with Db2 12 z/OS, fully automates the propagation of source schema changes and Kafka message production using AVRO and the Confluent Schema Registry. The AVRO formatted Kafka Topics produced by the Replicator Engine represent the complete before and after image of the source data from the Capture Agent. The Replicator also supports parallel processing of the replication workload through multiple Workers with the number of threads specified at run-time. Connect CDC SQData truly becomes a utility function within your enterprise architecture, reacting to Relational schema changes without interruption and without maintenance of the SQData Kafka producer configuration running in your Linux environment.

This section guides you through the following tasks:

1.Identify the Source platforms and Relational Tables

2.Determine the Target Kafka URL

3.Create the Kafka Replicator Configuration Script

4.Execute the Replicator Engine

Notes:

•A Confluent Schema Registry must be installed and configured for use by the Replicator Engine.

•The Confluent AVRO convention consists of a small header in each Kafka topic providing the Schema_id used to encode each AVRO formatted Kafka message.

•The Replicator Engine can produce either JSON or AVRO formatted Kafka message payloads.  are produced by a Replicator Engine.