Microsoft debuted Muse, a generative AI model that can be trained to output video game visuals and predict controller inputs. The company describes the technology as the future of gameplay ideation, not as something to be used in place of human creativity during game development.

This generative AI model, which Microsoft has named Muse, was developed by Microsoft’s Game intelligence team in collaboration with Ninja Theory. It will be made open source to help other researchers explore these models and build on their work, Microsoft said.

Microsoft debuts Muse, a world and human action model that uses generative AI to put together gameplay snippets.

Microsoft unveiled its Muse AI, which can generate chunks of games based on an image or just a few frames totaling as little as one second.

Microsoft has announced a new generative AI model called Muse, which the company claims can generate "game visuals, controller actions, or both".