Streamingdata

Stream Processing & Real-Time Data · Data Communities, Media & Events

Overview

Thoughts about data streaming, stream processing, and real-time data pipelines. Click to read Data Streaming Journal, by Yaroslav Tkachenko, a Substack publication with thousands of subscribers.

News

Blog 4 months ago
The New Wave of the Streaming Log Technologies
Apache Kafka was open-sourced in 2011, and it made a huge impact a few years after that. The Streaming log became a very popular abstraction. Today, 15 years later, I believe we're experiencing the third wave of streaming log technologies. The abstraction
Read more
Report
Blog 5 months ago
Introducing Streamling: Performant and Extensible Data Streaming Runtime
Streamling is a performant and extensible data streaming runtime built with the RAD stack (Rust, Arrow, DataFusion). I shared some progress before (post one, post two), but it's finally open-sourced! I've been working on Streamling together with a great t
Read more
Report
Blog 6 months ago
Can Kafka Queues Make Consumers Faster? Part 2: Head-Of-Line Blocking
A few weeks ago, I published my findings about the new Apache Kafka feature: Queues. Check the post if you haven't already! I kept receiving the same feedback: Obviously, with all the additional overhead that comes with Queues, it won't be faster than a c
Read more
Report
Blog 7 months ago
Can Kafka Queues Make Consumers Faster?
For a while, messaging systems like RabbitMQ, ActiveMQ, and AWS SQS have been used as a foundational component of many enterprise architectures. Enterprise Integration Patterns is still one of my favourite books. I had my first exposure to messaging syste
Read more
Report
Blog 8 months ago
Advanced Apache Flink On-Demand Course
A few months ago, I announced the Advanced Apache Flink Bootcamp, a deeply technical training focused on Apache Flink internals, production deployment, and advanced patterns.I ran the first cohort in January and also had the chance to conduct several corp
Read more
Report
Blog 9 months ago
Benchmarking CDC Tools: Supermetal vs Debezium vs Flink CDC
If you've been following my writing recently, you likely know I'm very bullish on the Rust & Apache Arrow data stack. So when I first learned about Supermetal (almost 2 years ago), I got really excited! Finally, some innovation in the Change Data Capture
Read more
Report
Blog 11 months ago
Why Apache Flink Is Not Going Anywhere
Astrologers proclaim the month of criticizing Apache Flink1, I thought to myself recently. In the last few months, I have read many posts on social media, company blogs, and newsletters that attack Flink from different angles. So, today, I'd like to reply
Read more
Report
Blog 1 year ago
Current New Orleans 2025
Current 2025 happened last week in New Orleans, USA. I've had a chance to attend it, and I'd love to share some of my notes with you.Keynotes & AnnouncementsConfluent Intelligence likely was the biggest announcement. It's a combination of three products:B
Read more
Report
Blog 1 year ago
Announcing Data Streaming Academy
Over the past few years, many of you have suggested the same thing: "You should write a book or launch a course." It's something I've always taken seriously (even started writing a book during Covid), but the time commitment never quite aligned with havin
Read more
Report
Blog 1 year ago
Flink Forward 2025
Flink Forward conference happened last week in Barcelona, Spain. It's the main Apache Flink event organized by Ververica, which includes many practitioners from companies like Netflix, Apple, Shopify, LinkedIn, etc.Ververica AnnouncementsVerverica has mad
Read more
Report
Show more news