Neural Network Simulates Rocket League Without Physics Engine
▶ The 2-minute explainer
Summary
Researchers have demonstrated a 5-billion-parameter neural network, MIRA, that can simulate a 2v2 Rocket League match at 20 frames per second on a single Nvidia B200 GPU. This model learned the game solely from video and controller inputs, generating every frame without traditional physics or rendering engines.
Why it matters
This research showcases a significant leap in AI's ability to learn and simulate complex dynamic environments from raw data, bypassing traditional game engine components. This has implications for virtual reality, simulation, and AI training.
How to implement this in your domain
- 1Investigate the MIRA open-source code and technical report for insights into novel simulation techniques.
- 2Explore applying similar AI-driven simulation methods to complex industrial or scientific modeling challenges.
- 3Evaluate the potential of learning from raw video data for training AI agents in environments where explicit physics engines are costly.
- 4Consider how such models could enhance virtual prototyping or digital twin initiatives.
Who benefits
Key takeaways
- MIRA is a 5B-parameter neural network simulating Rocket League without traditional engines.
- It learned the game from video and controller inputs, generating frames at 20 FPS on a single B200.
- The project, a collaboration with Epic Games, is open-sourced with code and dataset.
- A current limitation is its short memory, leading to hallucinations during replays.
Original post by @TheRundownAI
"Four people just played a full 2v2 Rocket League match inside a neural network. Every frame they saw came out of a 5B-parameter model dreaming the whole game, 20 frames a second, on a single Nvidia B200, with "no physics engine, no rendering engine, and no explicit 3D representat…"
View on XPrimary sources
Originally posted by @TheRundownAI on X · view source
Want to go deeper?
Turn these trends into skills with Learnijoy's hands-on AI & tech courses.
Explore coursesMore in AI Research
Salesforce Details Reliable Enterprise AI Agent Development
Salesforce Engineering discusses the challenges of building autonomous and reliable enterprise AI agents, highlighting a case where an early refund agent failed a red-teaming test by accepting invalid input.
Anthropic Discovers Internal 'J-Space' for Claude's Reasoning
Anthropic researchers found an internal "J-space" within Claude, a neural workspace where the model performs reasoning steps and represents concepts without explicit text, similar to human conscious processing. Deleting this space significantly impairs multi-step reasoning.
ThinkingCap-Qwen3.6-27B Reduces LLM Inference Tokens
A new finetuned model, ThinkingCap-Qwen3.6-27B, significantly reduces the number of "thinking tokens" required for Qwen3.6-27B, achieving 50% average reduction and over 90% in best cases, improving efficiency.