You’ve got streams of data that you want to process and store? You’ve got events from which you’d like to derive state or build aggregates? And you want to do all of this in a scalable and fault-tolerant manner? It’s just as well that Kafka and ksqlDB exist!
This talk will be built around a live demonstration of the concepts and capabilities of ksqlDB. We’ll see how you can apply transformations to a stream of events from one Kafka topic to another. We’ll use ksqlDB connectors to bring in data from other systems and use this to join and enrich streams—and we’ll serve the results up directly to an application, without even needing an external data store.
Attendees will learn:
- How to process streams of events
- The semantics of streams and tables, and of push and pull queries
- How to use the ksqlDB API to get state directly from the materialised store
- What makes ksqlDB elastically scalable and fault-tolerant.
Resources
-
👾Demo code
Try out the ksqlDB demo for yourself - all you need is Docker and Docker Compose.
-
👾 Building a Telegram Bot Powered by Apache Kafka and ksqlDB
A fun blog showing what you can do with ksqlDB and Kafka
-
ℹ️ Confluent Developer
Tutorials, videos, blogs, podcasts, and more - all for developers working with Apache Kafka and Confluent Platform
-
Confluent Hub
Huge list of connectors for Kafka Connect
-
☁️Confluent Cloud
Fully Managed Apache Kafka, Schema Registry, KSQL, and Connectors
-
📚Free eBooks
Free eBooks to download, including Kafka: The Definitive Guide.
- 💬 Confluent Community Slack group
-
📌From Zero to Hero with Kafka Connect
Learn all about Kafka Connect (including the connectors available with ksqlDB)
- 📌The Changing Face of ETL: Event-Driven Architectures for Data Engineers