Amazon DynamoDB: Evolution of a Hyper-Scale Cloud Database Service

Amazon DynamoDB is a cloud database service that provides consistent performance at any scale. Hundreds of thousands of customers rely on DynamoDB for its fundamental properties: consistent performance, availability, durability, and a fully managed serverless experience. In 2022, during the Amazon Prime Day shopping event, Amazon systems -- including Alexa, the Amazon.com sites, and Amazon fulfillment centers -- made trillions of API calls to DynamoDB, peaking at 105.2 million requests per second, while experiencing high availability with single-digit millisecond performance. Reliability is essential, as even the slightest disruption can significantly impact customers. 

Since the launch of DynamoDB in 2012, its design and implementation have evolved in response to our experiences operating it. The system has successfully dealt with issues related to fairness, traffic imbalance across partitions, monitoring, and automated system operations without impacting availability or performance. This talk presents our experience operating DynamoDB at massive scale and how the architecture continues to evolve to meet the ever-increasing demands of customer workloads.

 


Speaker

Akshat Vig

Principal Engineer NoSQL databases @awscloud

Akshat Vig is a Principal Engineer at AWS. Akshat has been working on DynamoDB since its inception. He is one of the primary authors on the DynamoDB paper published at USENIX. DynamoDB is one of the largest and most mission critical distributed systems in the world, and underpins much of AWS, Amazon, and the internet ecosystem today. As a Principal engineer, Akshat solves some of the most difficult distributed systems problems at Amazon across multiple services. He has filed close to 100 patents, served on IEEE program committees, and has given keynotes around the world. He is excited to solve the next big challenge in distributed systems. 

Read more

Date

Wednesday Nov 30 / 09:20AM PST ( 50 minutes )

Topics

Architecture Cloud Database Service Serverless Performance Availability Durability Traffic Imbalance Monitoring Automated System Operations

Share

From the same track

Session Architecture

Azure Cosmos DB: Low Latency and High Availability at Planet Scale

Wednesday Nov 30 / 11:40AM PST

Azure Cosmos DB is a fully-managed, multi-tenant, distributed, shared-nothing, horizontally scalable database that provides planet-scale capabilities and multi-model APIs for Apache Cassandra, MongoDB, Gremlin, Tables, and the Core (SQL) APIs.

Mei-Chin Tsai

Partner Director of Software Eng Manager @Microsoft

Vinod Sridharan

Principal Software Engineering Architect @Microsoft

Session Architecture

Honeycomb: How We Used Serverless to Speed Up Our Servers

Wednesday Nov 30 / 10:30AM PST

Honeycomb is the state of the art in observability: customers send us lots of data and then compose complex, ad-hoc queries. Most are simple, some are not. Some are REALLY not; this load is both complex, spontaneous, and urgent.

Jessica Kerr

Principal Developer Evangelist @honeycombio

Session Architecture

From Zero to A Hundred Billion: Building Scalable Real Time Event Processing At DoorDash

Wednesday Nov 30 / 12:50PM PST

At DoorDash, real time events are an important data source to gain insight into our business but building a system capable of handling billions of real time events is challenging.

Allen Wang

Software Engineer @DoorDash

Session Architecture

Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System

Wednesday Nov 30 / 02:00PM PST

Magic Pocket is used to store all of Dropbox’s data.

Facundo Agriel

Software Engineer / Tech Lead @Dropbox, previously @Amazon