Chad Nelson and the OpenAI team showcase innovative AI-powered tools like Storyboard and the Sora 2 API, developed in collaboration with the Critters animation team, that accelerate and customize creative workflows by transforming sketches into detailed images and full-motion videos. These technologies empower artists to maintain creative control while significantly reducing production time, heralding a new era of AI-augmented storytelling and design across various industries.
In this presentation, Chad Nelson, a creative director at OpenAI, introduces a new wave of creative production tools designed to enhance and accelerate artistic workflows. Drawing from his extensive experience in content creation across films, video games, and television, Chad highlights the common challenge creatives face: finding the right tools that fit their specific project needs without being overly generalized or complicated. He emphasizes the rapid emergence of AI tools and poses the question of whether it’s possible to develop highly customized tools tailored to individual creative workflows quickly. This led to a collaboration with the UK-based team behind the animated feature film “Critters,” who sought to integrate OpenAI’s latest models into their storyboarding process while keeping artists in control.
Olivia Morgan, a solutions engineer at OpenAI, demonstrates the “Storyboard” application developed for the Critters team. This tool leverages GPT-5, Codex, and image APIs to transform rough sketches into high-fidelity renders and potentially final frames, significantly speeding up the storyboarding process that traditionally takes about a year. Olivia walks through the interface, showing how users can upload sketches, add descriptive prompts, and select characters, locations, and props to guide the AI in generating detailed images. The tool offers presets for black-and-white sketches and full-color realistic renderings, allowing artists to choose the output that best fits their vision. Additionally, the project setup and history features provide control over style, assets, and version tracking, enabling bulk processing and easy export of storyboard data.
Allison August, another solutions engineering leader at OpenAI, explains how the Storyboard tool was built in just 48 hours during an internal hackathon. Using technologies like Next.js, Supabase, and Vercel, the team integrated GPT-5, Codex, and the new Sora 2 API to create a responsive and customizable application. Allison highlights the importance of close collaboration with the Critters team, whose feedback drove rapid iterations and feature additions. Codex played a crucial role in accelerating development by handling coding tasks and troubleshooting, allowing the team to implement nearly ten feature requests daily. This tight feedback loop and use of AI-assisted coding drastically reduced the typical development cycle from weeks to days.
Chad then showcases a live demonstration where he sketches a new scene of a critter entering a cave, which is quickly transformed by the Storyboard tool into detailed black-and-white and full-color images. This example illustrates the tool’s ability to rapidly visualize creative ideas, empowering artists to iterate faster and with greater confidence. The presentation also teases the capabilities of the Sora 2 API, which extends the workflow from static images to full-motion video with sound, showcasing a short animated clip created by the Critters team. This integration promises to revolutionize how creatives produce content by combining visual quality, motion understanding, and audio in a seamless AI-driven pipeline.
In conclusion, the presenters emphasize the transformative potential of AI-powered custom tools like Storyboard and Sora 2 in creative industries. By enabling artists to maintain control while accelerating production timelines, these technologies open new possibilities for storytelling and design across various sectors, from entertainment to marketing and automotive campaigns. The collaboration with the Critters team serves as a compelling example of how AI can augment human creativity, and the OpenAI team expresses excitement about the innovations developers and creatives will build using these tools in the future. The session closes with gratitude and encouragement for attendees to explore and contribute to this evolving landscape of AI-driven creative production.