You are viewing content from a past/completed QCon Plus - November 2020

Session

Improving Video Encoding System Efficiency @Netflix

Every show on Netflix is encoded for the device type and bit rate that is optimal for the customers. For any one show that can be tens of different encodes, generated by a large-scale system that scales up to hundreds of thousands of CPU cores concurrently. As the performance team at Netflix, we are motivated to tune the system to generate encodes quickly and efficiently. 

In this talk, we explore the challenges of improving the efficiency of video encoding systems at Netflix scale, and cover actions we take to achieve it by leveraging high-resolution telemetry tools, hardware features, and resource-aware task scheduling.

Main Takeaways

1 Find out what the video encoding system at Netflix looks like.

2 Learn the tools and techniques to analyze performance and to improve the system efficiency.


What is that work you're doing today?

I'm from the Netflix performance engineering team. Our team is responsible for bringing higher efficiency to the Netflix streaming and studio environments, identifying bottlenecks and optimizing systems with creative tooling and analysis. I have been focusing on making video encoding systems fast and efficient, also spending time on building self-service performance analysis tools based on bpftrace.

What is the goal for your talk?

I would like to introduce the video encoding systems at Netflix and some great tools and techniques that we applied to deliver a faster encode and to run them on resources more efficiently.

What do you want people to leave your talk with?

I want my audience to leave with three techniques of improving compute intensive workload performance:  use high resolution tools to know where and how to optimize, leverage hardware features to go full speed and think of how to fit workloads together to maximize throughput. I’d also like to encourage the audience to check out some amazing open-source tools that help in this domain, such as FlameScope, FlameGraph and Vector etc.


Speaker

Susie Xia

Senior Performance Engineer @Netflix

Susie works on the Performance Engineering team at Netflix. The team is responsible for bringing higher efficiency to the Netflix streaming and studio environments, identifying bottlenecks and optimizing systems with creative tooling and analysis. On the team, she has been focusing on making...

Read more

Date

Wednesday Nov 18 / 12:00PM EST (40 minutes)

Track

Mechanical Sympathy: The Software/Hardware Divide

Add to Calendar

Add to calendar

Share

From the same track

Session

It’s Not Your Machine; It’s Your Code.

Wednesday Nov 18 / 12:50PM EST

Can we use information in tweets to decide how and when to trade stocks? Yes. But can we do this efficiently at scale, and on a tight budget? Well, this talk will discuss what such a task entails. We will look at some of the performance issues encountered in a simulated high frequency trading...

Adekunle Adepoju

Senior Software Engineer @Netflix

Session

Pragmatic Performance - Tales from the Trenches

Wednesday Nov 18 / 01:40PM EST

In industry, one if often required to retrofit existing systems to extract more performance out of them. These performance optimization efforts are also performed under deadlines that make the "best'' solution, however attractive, often infeasible. In this talk, we would like to...

Ramesh Subramonian

Principal Engineer @TargetNews

PANEL DISCUSSION

Mechanical Sympathy Panel

Wednesday Nov 18 / 02:30PM EST

In this panel, we’ll continue the conversation about mechanical sympathy by bringing our speakers back to discuss where they see future trends and new ideas they have yet to try. We will touch on new tools that can provide even better insights into what is happening in our systems. We will...

Susie Xia

Senior Performance Engineer @Netflix

Adekunle Adepoju

Senior Software Engineer @Netflix

Ramesh Subramonian

Principal Engineer @TargetNews

View full Schedule

Less than

15

weeks until QCon Plus May 2022

Level-up on the emerging software trends and practices you need to know about.

Deep-dive with world-class software leaders at QCon Plus (Nov 1-12, 2021).

Save your spot for $549 before February 7th

Register