worldmodels.fyi
← Catalog
PaperGoogle · 2024

Diffusion Models Are Real-Time Game Engines (GameNGen)

A neural game engine that runs DOOM interactively at ~20 FPS, with the next frame generated by a diffusion model conditioned on past frames and actions.

Summary

GameNGen shows a diffusion model can simulate a full game (DOOM) in real time: an RL agent generates training play, then a conditioned diffusion model predicts the next frame from action + frame history. Demonstrates playable, visually-stable neural game simulation — a concrete point on the 'world model as game engine' curve.

Metadata

Authors
Valevski et al., Google
Year
2024
arXiv
2408.14837
Venue
ICLR 2025

Relationships

Introduces

GameNGen
#diffusion#gaming#real-time