Session

Co-Designing Raft + Thread-per-Core Execution Model for the Kafka-API

Sometimes you get to reinvent the wheel when the road changes. Redpanda is a drop-in replacement for Apache Kafka®, designed from the ground up for modern hardware. Hardware looks nothing like it did 10 years ago. NVMe disks are 1000X faster than spinning disks. Cloud computers offer 30X more cores than they did a decade ago with NICs offering 100x higher throughput.  

In this talk we will talk over the lessons learned building a new storage engine from scratch with no virtual memory, no page cache, with purpose-built read-ahead and write-behind strategies for predictable latencies, co-designed with Raft - our data replication model.


SPEAKER

Alex Gallego

Founder and CEO @VectorizedIO
Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing... Read more Find Alex Gallego at:
DATE

Wednesday May 19 / 10:10AM EDT (40 minutes)

TRACK Modern CS in the Real World TOPICS Applied Computer Science ADD TO CALENDAR Calendar IconAdd to calendar
SHARE
Logo

Build your learning journey and level-up on the skills most in-demand in 2021. Attend QCon Plus (May 17-28, 2021).

Save your spot for $599 before May 28th

Register
Shape
TOP