Leveraging Determinism

Determinism is a very powerful concept when paired with fast business logic. We discuss both intuitive and not-so-obvious architecture choices that can be made to dramatically scale and simplify systems with these properties.

We built our latency sensitive exchange around a blazing fast open source raft cluster. After some time in production, observations about the nature of our request and event messages coupled with some timely advice led us to upend our service topology. Find out how rerunning core logic at the edges of a system can:

  • Decrease bandwidth usage and buffering across the system
  • Protect against thundering herd problems by making network usage more predictable
  • Simplify the logic of gateway and persistence services downstream from your core logic

Speaker

Frank Yu

Senior Engineering Manager @Coinbase

Frank is an engineering leader at Coinbase, focusing on distributed low latency trading platforms. Prior to Coinbase, he served as Principal Engineer and later Director of Software Engineering at FairX, leading the design and build of what would become the Coinbase Derivatives Exchange post acquisition. Frank has spent over a decade making tradeoffs on mission critical systems with submillisecond response times and loves chatting about complexity, testing, and performance.

Read more
Find Frank Yu at:

Date

Thursday Dec 1 / 12:30PM PST ( 50 minutes )

Topics

Backends Latency Architecture Scale Engineering Computer Science Systems

Share

From the same track

Session Backends

24/7 State Replication

Thursday Dec 1 / 10:10AM PST

Systems that operate non-stop, 24/7 are standard in many consumer-facing industries. Often, but definitely not always, these systems do not have aggressive SLAs nor high availability needs to the degree that some financial systems demand. But that is changing.

Speaker image - Todd Montgomery
Todd Montgomery

Ex-NASA Researcher and High Performance Distributed Systems Whisperer

Session Backends

Backends in Dart

Thursday Dec 1 / 09:00AM PST

Dart's popularity has surged in the past few years, as it's the language behind Flutter - Google's cross platform front end framework. That's now driving a notion of 'Full Stack Dart', where if you've spent time learning Dart for the front end, why not also use it for the back end.

Speaker image - Chris Swan
Chris Swan

Engineer @atsigncompany

Session

Data Mesh: Are We There Yet?

Thursday Dec 1 / 01:40PM PST

Standing at an inflection point is a magical experience. It’s where we look at what has come before, learn from it, and choose a new path. Data Mesh has motivated many organizations to stand at an inflection point of their approach to data.

Speaker image - Zhamak Dehghani
Zhamak Dehghani

CEO and Founder @Stealth Startup, Data Mesh Founder, Author, Speaker

Session

Ubiquitous Caching: A Journey of Building Efficient Distributed and In-Process Caches at Twitter

Thursday Dec 1 / 11:20AM PST

Modern web applications widely deploy cache across the stack to speed up data access and improve throughput. In this talk, I will discuss three trends in hardware, workload, and cache usage that shape the design of modern caches.

Speaker image - Juncheng Yang
Juncheng Yang

Ph.D. student @CarnegieMellon, Focus on Efficiency and Performance, Previously @Twitter & @Cloudflare, Facebook Fellow