The Genie 4 world model comes to the Gemini API: interactive 720p worlds at 24 fps with synchronized native audio, from a text prompt or reference image
Genie 4 opened to Google AI Ultra subscribers on 11-18, and a day later developers can call it through the API. What the API can do, for teams working on interactive content, spatial design or agent training environments.
// Key points
- Developers can use Genie 4 through the Gemini API (via the Interactions API) and Google AI Studio, generating continuous 720p worlds at 24 fps with synchronized native audio, from ambient sound to character dialogue, starting from text, a reference image or both.
- Real-time keyboard controls let you navigate while live text prompts change weather, lighting, objects or events, with Gemini reasoning keeping the world state consistent.
- Every output carries an imperceptible watermark; AI Studio offers an interactive canvas and starter apps.
- In the 11-18 Project Genie update, Genie 3 exploration grew from 60 seconds to up to 3 minutes per generation.
Builder's takeThis is the first time a world model is open to everyday developers through an API, but I'd treat it as a prototyping tool, not a production component: the announcement gives no price or length limits, so try it in AI Studio first. The use worth watching is training environments for agents; teams building computer-use or robotics agents can use it to make test scenarios cheaply.
// Background · from #Google
Full timeline →- Nov 20 Gemini API previews Tool Retrieval: tool parameter schemas load on demand instead of sending the whole tool library on every request
- Nov 20 The Gemini app for Mac gets computer use: it completes multi-step tasks across local files, desktop apps and the web in an isolated background window, with key actions needing your approval
- Nov 19 Google releases Gemini 4 Neon at $3 input and $15 output per million tokens, with 32% lower cost per task than Carbon at its default high level