I Survived AI Minecraft

This is the Viral AI Generated Minecraft. How it works will blow your mind, so let me explain while playing.

So every time I move my mouse or press a key, I'm not actually telling Minecraft to turn or break a block. Instead, the AI is generating a new screenshot, based on the keys I press. There is no typical game engine or world.

It's just an AI with 3 key parts:

First, it is auto regressive. Meaning it predicts the next frame, by looking at some of the previous frames. But it can't remember everything. So if I look down then up, I'm somewhere else.

Next, it is diffusion based. Which means the image is generated step by step from randomised pixels.And finally, it is a transformer model. Which means it learns the relationship between previous frames, in the same way that ChatGPT does with words.

Sources: https://oasis.decart.ai/overview https://oasis-model.github.io/