Latency & The problem of Netflix’s Live Streaming

Netflix, a pioneer in on-demand streaming, ventured into live programming to stay ahead in the entertainment industry. However, as Elizabeth Stone, Netflix’s CTO, explains, live streaming posed a unique set of challenges distinct from traditional on-demand content delivery. While on-demand streaming benefits from meticulous pre-encoding and storage across content delivery networks, live streaming demands real-time processing.

“When we’re streaming video on demand we get the benefit of planning ahead. That content is in its final format; the video, images, audio are in nicely packaged files, and they’ve already gone through all the production steps, the encoding steps, they’re ready to be placed on servers around the world through our content delivery network and through internet service providers. So when a member clicks play, we’re really ready for them to click play.” — Elizabeth Stone, Netflix’s CTO

For events like the Jake Paul vs. Mike Tyson fight, viewed by over 65 million subscribers in November 2024, Netflix had to encode raw camera feeds, transmit them through their CDN, and deliver them to devices worldwide — all within seconds. The stakes were high, but so were the technical hurdles. Unlike their well-optimized on-demand platform, Netflix faced uncharted territory with unpredictable traffic spikes and real-time encoding complexities. These challenges highlighted the intricacies of scaling live streaming for massive, simultaneous viewership.

The Streaming Problem:

The platform encountered latency issues, leading to buffering and degraded video quality, especially during popular live broadcasts like the Jake Paul Vs Mike Tyson fight, which attracted over 65 million viewers.

Impact on User experience & Business

Viewers experienced interruptions and delays, diminishing the quality of real-time content consumption. The performance issues risked Netflix’s reputation as a reliable streaming service, potentially affecting subscriber growth and retention.

To understand the impact of interruptions and delays during live streaming, let’s break it down in a way that’s relatable and easy to follow:

Imagine you’re watching an intense live cricket match, and it’s the final over. Every ball counts, and you’re glued to your screen. Suddenly, the video pauses to buffer, and you miss a critical moment — a six that changes the game. You will feel frustrated and upset over the quality of service. This is exactly what happens when live streaming experiences interruptions and delays. For viewers, the experience isn’t just about watching — it’s about being in the moment, feeling the excitement, and sharing it with millions of others in real time. When the stream falters, it pulls viewers out of that immersive experience, leaving them dissatisfied.

These interruptions often happen because live streaming technology has to process and deliver video content instantly. Unlike on-demand streaming, where videos are preloaded and ready, live streaming must handle video feeds, process them, and send them to millions of devices simultaneously — all in a matter of seconds. If any part of this process is delayed or overwhelmed, it results in buffering, low-quality video, or even a complete stream outage.

Such issues can lead viewers to switch to other platforms, complain about the service, or lose trust in its ability to deliver reliable live content. For a platform like Netflix or Disney Hot Star hosting high-stakes live events, even a few seconds of delay can tarnish its reputation and lead to significant viewer dissatisfaction.

How Netflix Solved Live Streaming Challenges

Netflix took a multi-faceted approach to address the interruptions and delays in live streaming. Let’s break down the technical solutions into easy-to-understand concepts:

1. Customized FreeBSD Implementation

What’s FreeBSD? Think of FreeBSD as the brain of the servers that Netflix uses to stream content. It’s like the operating system of your computer but designed specifically for managing big tasks on powerful machines.

What Netflix Did: Netflix customized this brain to better suit its needs. Imagine tweaking the engine of a car so it runs smoother and faster without overheating. Netflix made changes to how this operating system handled large amounts of data so their servers could work faster and more efficiently during live streaming.

Impact on Viewers: By making these optimizations, Netflix ensured that their servers could handle more traffic without slowing down, reducing the chances of delays and interruptions during live events.

2. Open Connect Content Delivery Network (CDN)

What’s a CDN? A Content Delivery Network is like a network of mini warehouses spread across the globe. Instead of everyone accessing a product from one big warehouse (which can cause delays), these mini warehouses store the product closer to the customer for faster delivery.

What Netflix Did: Netflix built its own CDN called Open Connect. Instead of relying on third-party services, Netflix placed their “warehouses” (servers) closer to their viewers. This means if you’re in India, the video you’re streaming is likely coming from a nearby server, not from a faraway data center in the US.

Impact on Viewers: This reduces the time it takes for video data to travel to your device, resulting in faster streaming and fewer interruptions, even during high-traffic events like live sports or concerts.

3. Adaptive Streaming Algorithms

What’s Adaptive Streaming? Imagine watching a YouTube video on a train. As the train moves, your internet connection might get weaker, and the video quality drops to prevent buffering. That’s adaptive streaming in action — it adjusts the quality of the video based on your internet speed.

What Netflix Did: Netflix used advanced algorithms that constantly monitor your internet connection while you stream. If the connection weakens, the system automatically lowers the video quality just enough to keep the stream going without interruptions. It also preloads small chunks of video (buffering) intelligently so that you don’t notice any hiccups.

Impact on Viewers: This ensures that even if your internet isn’t perfect, you can still enjoy a smooth streaming experience without frequent pauses or buffering, especially during live events.

Outcome:

Performance Achievements:

NFL Christmas Day Games: On December 25, 2024, Netflix broadcasted two NFL games, attracting nearly 65 million viewers in the U.S. The second game peaked at over 27 million viewers during Beyoncé’s halftime performance, setting new streaming records.

Technical Enhancements: Following earlier challenges, Netflix implemented infrastructure improvements to support high concurrent viewership, ensuring smoother live streaming experiences.

Impact on User Experience:

Enhanced Engagement: The successful streaming of live events, particularly the NFL games, provided viewers with seamless, real-time access to high-demand content, elevating overall satisfaction.

Positive Reception: The high-quality broadcast of live sports and entertainment, including the Beyoncé halftime show, received widespread acclaim, reinforcing Netflix’s reputation for delivering premium content.

Business Growth:

Strengthened market position as a leading streaming service, fostering subscriber loyalty and attracting new users.

Subscriber Expansion: In 2024, Netflix’s subscriber base grew significantly, reaching over 280 million, driven by live event offerings and strategic initiatives like password-sharing crackdowns.

Revenue Increase: The company reported a 15% revenue growth year-over-year in Q3 2024, reflecting the financial benefits of diversified content and enhanced streaming capabilities.

Stock Performance: Netflix’s stock surged nearly 90% in 2024, elevating its market valuation to approximately $400 billion, indicating strong investor confidence.

Netflix’s Christmas Day NFL Games Set a Streaming Record

Latency played a crucial role in Netflix’s live streaming challenges, causing delays and buffering during high-demand events. By deploying a dedicated Open Connect CDN, FreeBSD for faster server performance, and adaptive streaming algorithms, Netflix reduced latency issues and improved real-time content delivery. This enhanced the user experience boosting subscriber growth, revenue, and market share in a short time. Their successful handling of live streaming has strengthened their market position as a leading entertainment platform.