Streaming Data
-
Tales from the Frontline of Kafka – #kafka #confluent #podcast
Listen now >>>>> https://developer.confluent.io/podcast/tales-from-the-frontline-of-apache-kafka-devops-ft-jason-bell The podcast has been up a while now but I’ve been busy. It was definitely fun to do. There’s a lot of opinion especially about how teams, developers and others embrace Kafka. We also confirmed that Dave Klein is not omnipresent, I was convinced that he was.
-
Kafka Is A Team Sport Redux – #kafka #apachekafka #streamingdata #data #confluentkafka
The feedback from Saturday’s blog post Kafka Is A Team Sport was very positive. I still felt I hadn’t quite got my point across though, well not clearly enough. Then it hit me. The Three Functions I see the current ecosystem as three distinct parts. Development, DevOps Engineering and Data Engineering. They all have different…
-
Kafka Is A Team Sport – #kafka #apachekafka #streamingdata #data #confluentkafka
One of the nice things about being an early adopter is watching things grow. Another is observing how that adoption happens from organisation to organisation. The questions I get tend to be varied and in the oddest of locations, doing an impromptu Q&A at London City Airport is still a highlight of data related daftness.…
-
Extending Topic Retention in Kafka – #kafka #apachekafka #confluent
There’s a part in my internal body clock that worries about Kafka messages, especially production Kafka messages, especially LOSING Kafka messages…. Even when I know that the retention policies work perfectly well and do as they are told I still wake up and worry. If you maintain a Kafka cluster then you’ll understand. When it…
-
Adding file logging to Kafka Connect – #Kafka #Connect #Streaming #Data #Devops
More of a memory aid for me as I’ll forget….. Kafka Connect’s default logging goes to the console, I prefer tailing and grepping files instead. I’m using Confluent Kafka 5.1.2 but the file locations will be pretty much similar if you are using the Apache version. Open up the connect-log4.properties file in $KAFKA_HOME/etc/kafka directory. Add…