An Israeli startup, Decart, has unveiled its groundbreaking video-to-video AI model, Mirage, capable of manipulating live video in real-time. This innovation, as highlighted by Techmeme, could significantly impact the livestreaming industry by allowing instantaneous visual transformations of video feeds. Mirage's debut positions Decart as a key player in the rapidly evolving field of generative media, offering capabilities beyond existing AI video generation tools.
Mirage operates at an impressive 20 frames per second at a resolution of 768x432, with a reported latency of approximately 100 milliseconds per frame, optimized for NVIDIA Hopper chips. Unlike other AI video models that struggle with accumulated errors and significant delays, Decart’s technology employs an autoregressive architecture and custom low-level GPU code to maintain temporal coherence and stability. This allows for continuous, high-quality transformation of live or pre-recorded content.
The technology holds substantial potential for various applications, including livestreaming, video conferencing, and gaming. Users can apply text prompts to instantly change the visual style of a live stream, transform a video call, or even alter a game environment in real-time, as demonstrated with Decart's previous "AI Minecraft" model, Oasis. This marks a shift from fixed video assets to a more dynamic, adaptive visual medium.
Decart, founded in 2023 by CEO Dean Leitersdorf and CTO Oran Gafni, recently secured a $10 million seed funding round. The investment was led by prominent venture capital firms Sequoia Capital and Zeev Ventures, underscoring investor confidence in the startup's vision. "We believe that real-time AI video generation will revolutionize how we interact with digital content," Leitersdorf stated, emphasizing the company's goal to democratize this advanced technology.
With the launch of the Mirage website and app, users can already experiment with modifying YouTube clips using default themes. Decart plans future updates to include support for full HD and 4K resolutions, improved facial consistency, and more precise object control. Mirage aims to differentiate itself from competitors like OpenAI's Sora and Google's Veo by focusing on true real-time, continuous video transformation, potentially reshaping how digital content is created and consumed.