Thoughts on Kafka Connect

Kafka Connect is a really cool technology. At its core, its a processing cluster for ingesting and digesting data from a database to kafka. But its goal is greater: it aims to make it easier for developers to use Kafka in the first place. Confluent wants to make it simple to pull data from a datastore like S3 writing no code. Pulling (Source Connectors) and pushing (Sink Connectors) to and from a streaming data system is very common. Additionally, it is generally some of the first tasks any developer will do when starting to work with Kafka.

(full-post)
(all-posts)