Managing events by using Apache Kafka
You can use Apache Kafka to manage events that are created by IBM® InfoSphere® Information Server. Use this open source infrastructure to react to events such as workflow engines or emails and to create your own events.
About this task
Apache Kafka is an open source, publish-and-subscribe messaging system that is built for high throughput, speed, availability, and scalability.
Kafka topics are feeds of messages in categories. Processes that publish messages to a topic are called producers. Processes that subscribe to topics and process the feed of published messages are called consumers. For details and examples, see consumer sample and producer sample.
InfoSphere Information Server has a ready-to-use installation of Kafka and a Kafka topic that provides all InfoSphere Information Server events as Kafka messages. You can see all messages from all suite products, and you can consume these messages with any Kafka client implementation.
A command-line consumer directs messages to a command window. You use the consumer to see messages that are created by InfoSphere Information Server. Kafka uses the Zookeeper API, which is a centralized service that maintains configuration information.
Kafka message consumers are not limited to capturing messages from InfoSphere Information Server. You can also retrieve messages from your own applications when you implement your own Kafka producer.