SetupAI
繁
SourceStalecollected in 2h

Scaling AV1 for Real-Time Communication at Meta

Read original on Meta Engineering Blog
#video-compression#rtc#video-engineering

Learn how Meta scaled AV1 for real-time video, a critical optimization for high-bandwidth AI and media applications.

30-Second TL;DR

What Changed

Overcoming hardware and software constraints for AV1 deployment at scale.

Why It Matters

This deployment demonstrates how high-efficiency codecs can reduce bandwidth costs while maintaining high-fidelity video in massive-scale RTC applications. It provides a blueprint for developers looking to optimize video delivery in resource-constrained environments.

What To Do Next

Review Meta's engineering blog to identify if your video streaming stack can benefit from AV1's superior compression efficiency compared to H.264 or VP9.

Who should care:Developers & AI Engineers

Key Points

  • •Overcoming hardware and software constraints for AV1 deployment at scale.
  • •Developing advanced rate control mechanisms to optimize call quality.
  • •Implementing robust error resilience strategies for real-time video streaming.
  • •Multi-year effort focusing on codec selection and device eligibility.

Deep Insight

AI-generated analysis for this event — not the original article.

Enhanced Key Takeaways

  • •Meta utilized a custom-built AV1 encoder, 'SVT-AV1-Meta', optimized specifically for low-latency CPU-based encoding on server-side infrastructure.
  • •The deployment strategy leveraged a tiered device eligibility model, prioritizing high-end mobile chipsets with hardware AV1 decoders to minimize battery impact.
  • •Meta integrated AV1 into their existing WebRTC-based stack, requiring significant modifications to the packetization layer to handle AV1's unique OBU (Open Bitstream Unit) structure.
  • •To address the high computational cost of AV1, Meta implemented a dynamic 'codec-switching' mechanism that falls back to VP9 or H.264 when device thermal thresholds are exceeded.
  • •The project involved a massive A/B testing framework across WhatsApp and Messenger, measuring 'Good Minutes' (a composite metric of resolution, frame rate, and latency) to validate AV1's superiority over VP9.

Competitor Analysis

Primary Codec
Meta (AV1)
AV1 (Hybrid)
Google (Meet/Duo)
VP9 / AV1
Zoom (AV1)
H.264 / AV1
Hardware Acceleration
Meta (AV1)
High (Tiered)
Google (Meet/Duo)
High (Android focus)
Zoom (AV1)
Moderate
Latency Optimization
Meta (AV1)
Custom Rate Control
Google (Meet/Duo)
Standard WebRTC
Zoom (AV1)
Proprietary SVC
Deployment Scope
Meta (AV1)
Massive (WhatsApp/Messenger)
Google (Meet/Duo)
Moderate (Meet)
Zoom (AV1)
Enterprise-focused

Technical Deep Dive

  • Implementation of a constrained-quality (CQ) rate control mode that balances visual fidelity with strict bandwidth caps.
  • Utilization of temporal scalability layers to allow for graceful degradation during packet loss without requiring full keyframe requests.
  • Integration of a custom frame-dropping algorithm that prioritizes motion vectors during high-congestion scenarios to maintain audio-video synchronization.
  • Optimization of the AV1 bitstream to reduce overhead in the RTP packetization process, specifically targeting MTU size constraints.

Future ImplicationsAI analysis grounded in cited sources

AV1 will become the default codec for all Meta real-time video products by 2027.
The successful rollout of hardware-accelerated AV1 on mobile devices removes the primary barrier to universal adoption across Meta's user base.
Meta will open-source specific components of their AV1 rate control logic.
Meta's historical pattern of contributing to the AOMedia ecosystem suggests they will share optimizations to improve the broader AV1 ecosystem.

Timeline

2018-03
AOMedia releases the AV1 bitstream specification.
2021-09
Meta begins internal testing of AV1 for video-on-demand services.
2023-05
Meta initiates large-scale A/B testing of AV1 for real-time video calls.
2024-11
Meta achieves widespread hardware-accelerated AV1 support on flagship mobile devices.
2026-02
Meta completes the global rollout of AV1 for real-time communication across Messenger and WhatsApp.
Read original article on Meta Engineering Blog

Weekly AI Recap

Read this week's curated digest of top AI events →

PostLinkedIn

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Meta Engineering Blog ↗

This is a summary, not the original. Read the source, or get the weekly briefing.

The weekly digest

One email a week. Unsubscribe anytime.