When you buy through affiliate links in our content, we may earn a commission at no extra cost to you. Learn 
ByteDance unveiled X-Portrait 2, an AI system that turns photos into realistic video performances, sparking concerns over digital misinformation.
Developed by TikTok’s creator, X-Portrait 2 transforms still images into lifelike movie scenes, adding subtle expressions and emotional nuance that make them nearly indistinguishable from actual footage.
ByteDance just announced X-Portrait 2!
This AI brings photos to life with realistic emotions and expressions from a single video.
10 wild examples:
1. Expressive Emotion pic.twitter.com/EjdbyLTWIy
— Min Choi (@minchoi) November 7, 2024
The system reenacts iconic film scenes, like The Shining, Face Off, and No Strings Attached, capturing fine expressions. A single photo can now convey emotions like fear, rage, or joy with actor-level detail while maintaining the person’s identity.
ByteDance AI System Stirs Debate on Digital Authenticity
To achieve this, ByteDance developed a state-of-the-art expression encoder that trains on large datasets to capture even the slightest facial movements. This encoder is integrated with advanced generative diffusion models to create fluid, expressive videos.
While OpenAI and Anthropic emphasize language, ByteDance uses TikTok‘s video data to enhance AI models with real-world expressions, setting it apart from competitors. ByteDance’s system captures the natural facial flow and complex expressions, while X-Portrait 2 adapts to rapid speech and varied angles.
Amid rising concerns regarding digital misinformation and the aftermath of the US presidential election, X-Portrait 2’s ability to create realistic videos from photos is causing alarm. While competitors released their code publicly, ByteDance kept X-Portrait 2 private, citing risks of misuse for unauthorized performances or deceptive content.
X-Portrait 2’s launch coincides with ByteDance’s global AI expansion, including new European research centers and a $2.13 billion center in Malaysia. Despite regulatory challenges in Western markets, ByteDance continues to enhance its technical advancements.
