Both Google Deepmind and John Carmack Are Building Videogame Simulations for Training AGI

The video explores John Carmack’s innovative approach to training Artificial General Intelligence by using physical robots to play video games, aiming to develop AI that can generalize learning across multiple games. It also highlights a broader trend among AI researchers, including Google DeepMind, who utilize complex video game simulations to advance AI development, raising philosophical questions about the nature and future of increasingly realistic virtual worlds.

The video discusses John Carmack, the renowned creator of the classic video game Doom, and his current work on Artificial General Intelligence (AGI). Carmack’s innovative approach involves using physical robots to play video games as a method for training AGI. The setup includes a robotic camera and a mechanical device that manipulates an Atari controller, allowing the robot to physically interact with the game environment. This hands-on method aims to bridge the gap between virtual gameplay and real-world physical interaction.

The core objective of Carmack’s project is to develop an AI system capable of generalizing its learning across multiple games. For instance, if the AI learns to play Miss Pac-Man effectively, it should be able to transfer that knowledge to other games like Tetris or Space Invaders. This generalization is crucial for advancing AGI, as it moves beyond specialized, single-task AI towards more flexible and adaptable intelligence that can handle a variety of challenges.

The video also highlights a broader trend among leading AI researchers, including teams at Google DeepMind, who are increasingly focusing on video games and 3D simulated worlds as training grounds for AI. These virtual environments provide rich, complex scenarios where AI agents can learn, adapt, and develop sophisticated behaviors. The use of simulations is seen as a natural progression for civilizations at advanced technological stages, where creating immersive, realistic virtual worlds becomes essential for AI development.

An interesting philosophical point is raised about the nature of these simulations. The video suggests that as these virtual worlds become more detailed and populated with AI-driven characters, it becomes important for these entities to “feel” like real individuals who matter. This sense of significance encourages the AI agents to contribute meaningful data and behaviors to the simulation, enhancing the overall quality and realism of the virtual environment.

Finally, the video reflects on the future implications of building such simulations. It questions whether the creation of these advanced AI-driven worlds will be a singular milestone or just one step in an ongoing chain of increasingly sophisticated simulations. This contemplation underscores the evolving relationship between technology, AI, and the simulated realities we create, hinting at a future where the boundaries between real and virtual intelligence may continue to blur.