Scaling AI filmmaking with collaborative networking
Haohong Wang, Daniel Smith, Ugur DemirAbstract
In this work, MineStudio is introduced, a novel AI filmmaking framework designed to facilitate future creative collaborative networks. MineStudio uses a hybrid digitization approach that involves reconstructing 3D digital environments, capturing 2D live‐action performances, employing AI tools to generate synthetic images and videos, and compositing with AI assistance. This method effectively addresses the main challenges in the current AI video generation, including consistency, directability, and issues with human actions and interactions. MineStudio has been utilized to create pioneering AI films, such as the love story “Next Stop Paris” and the sci‐fi short film “Message in a Bot”, and has been recognized as a trailblazer in the AI filmmaking industry.