AI Warps Live Video in Real Time
AI Transforms Live Video: Decart’s Mirage Puts Real-Time Video Manipulation in Your Hands
Table of Contents
The future of live video is getting a surreal makeover, thanks to Decart, a startup that has developed a groundbreaking artificial intelligence model capable of manipulating live video in real time. Imagine transforming yourself into a gold-tinged, subaquatic Julius Caesar with a poncho, or watching a familiar video game scene morph into an underwater world - all as it happens.This is the reality Decart’s technology, dubbed Mirage, is bringing to life.
The dawn of Real-Time AI Video Remixing
“I have no idea what’s going to happen,” laughs Decart founder Leitersdorf, his own on-screen image oscillating wildly as the AI model predicts and generates new frames. With long hair tumbling down his back and a pen dancing between his fingers, Leitersdorf embodies the creative chaos his technology unleashes. As he speaks, his features shift, becoming more feminine, his pen changing colors and shapes, and new prompts plunge the video into psychedelic realms.
This real-time video-to-video model is not just an notable feat of engineering; it signals a seismic shift for the live streaming industry. While AI models like OpenAI’s Sora can already generate increasingly realistic video from text prompts, Mirage takes it a step further by enabling dynamic, on-the-fly manipulation of live video feeds.
Decart’s Mirage: A New Era for Content Creation
Decart is launching a website and app that empowers users to create thier own videos and modify existing YouTube clips. The platform offers a variety of pre-set themes, including “anime,” ”Dubai skyline,” “cyberpunk,” and “Versailles Palace.” During a presentation, Leitersdorf uploaded a clip of someone playing Fortnite, and the familiar Battle Royale surroundings was instantly transformed into a captivating underwater setting.
Gaming: A Prime Frontier for AI Video Innovation
The potential for decart’s technology in the gaming sector is immense. In November 2024, the company showcased “Oasis,” a game that utilized a similar AI approach to generate a playable Minecraft-like world dynamically. Players could interact with textures, zooming in and out to create entirely new playable scenes within the game itself. This ability to generate and modify game environments in real-time opens up unprecedented possibilities for immersive and ever-evolving gaming experiences.
The Engineering Behind the Magic: Speed and Efficiency
Manipulating live video streams in real-time presents significant computational challenges. Decart has tackled this by writing low-level code optimized to extract high-speed calculations from Nvidia chips.The result is Mirage, which generates video at 20 frames per second with a resolution of 768×432 and a remarkably low latency of 100 milliseconds per frame. This performance is more than sufficient for creating engaging, high-quality content for platforms like TikTok.
Decart’s innovation is poised to democratize advanced video manipulation, offering creators powerful new tools to express their vision and redefine the boundaries of live visual storytelling. As AI continues to evolve, the line between reality and digital creation blurs, and Decart’s Mirage is leading the charge into this exciting new frontier.