Enabling integrated Kafka custom operation processors (KCOP)

Integrated Kafka custom operation processors (KCOPs) run "out-of-the-box" with the CDC Replication Engine for Kafka. You can select them by simply referring to them in the User Exit context menu in Management Console.

About this task

You can use KCOPs to control the Kafka producer records that are written to Kafka topics in response to insert, update, and delete operations on source database tables. The CDC Replication Engine for Kafka provides integrated KCOPs for several use cases, including writing to topics in JSON, specifying user-defined topic names, and writing audit records. For more information, see Kafka custom operation processor (KCOP) for the CDC Replication Engine for Kafka.

1. In Management Console, click Configuration > Subscriptions.
2. Select the subscription.
3. Right-click the subscription and select Kafka Properties.
4. Verify that Zookeeper is selected as the method for Kafka apply.
5. Click OK.
6. Right-click the subscription and select User Exit.
7. Enter values for Class Name and Parameter based on the integrated Kafka custom operation processor that you want:

   KcopLiveAuditSingleRowIntegrated

   Writes audit records in comma-separated values (CSV) format.

   KcopJsonFormatIntegrated

   Writes records in JSON format.

   KcopDefaultBehaviorIntegrated

   Connects to a Confluent-compatible schema registry and writes to Kafka.

   KcopTopicMappingIntegrated

   Enables you to specify topic names and set up mappings between multiple source tables and target topics.

   KcopMultiRowAvroLiveAuditIntegrated

   Writes audit records in Avro format and registers the schema in a Confluent schema registry or a Hortonworks Schema Registry Service.

   KcopSingleRowAvroAuditIntegrated

   Writes audit records in Avro format with before- and after-image records on the same row.

   KcopJsonSingleRowAuditFormatIntegrated

   Writes audit records in JSON format with before and after images in one row.

8. Click OK.