Imagine youâve got a stream of data; itâs not âbig data,â but itâs certainly a lot. Within the data, youâve got some bits youâre interested in, and of those bits, youâd like to be able to query information about them at any point. Sounds fun, right? Since I mentioned âquerying,â Iâd hazard a guess that youâve got in mind an additional datastore of some sort, whether relational or NoSQL.
But what if I told youâŠthat you didnât need any datastore other than Kafka itself? What if you could ingest, filter, enrich, aggregate, and query data with just Kafka? With ksqlDB we can do just this, and I want to show you exactly how.
In this hands-on talk weâll walk through an example of building a Telegram bot in which ksqlDB provides the key/value lookups driven by a materialised view on the stream of events in Kafka. Weâll take a look at what ksqlDB is and its capabilities for processing data and driving applications, as well as integrating with other systems.
Resources
-
Confluent Developer
Your destination for learning all about ConfluentâTutorials, examples, documentation, blogs, podcasts, and lots more!
-
đŸCode for you to try the full demo yourself
The demo is built on Docker so anyone can easily spin it up and give it a try.
-
âïžConfluent Cloud
Fully Managed Apache Kafka, Schema Registry, ksqlDB, and Connectors. Use promo code RMOFF200 to get an additional $200 of free Confluent Cloud usage. Be sure to activate it by June 30 2021, and to use it within 90 days after activation. Any unused promo value on the expiration date will be forfeited and there are a limited number of codes available, so donât miss out!
- đ Kafka as a Platform: the Ecosystem from the Ground Up
- đ„ Kafka Connect tutorials on YouTube