Roblox Teases an Open-Source AI 3D World Creator

Artificial intelligence has spread to many aspects of our daily lives; you have most likely interacted with an AI-powered product or service by now.

Similarly, video games are no strangers to having AI in them. Cyberpunk 2077, the popular game set in a dystopian future (one of my favorites), uses an AI-powered software called “JALI” to automate facial animation and lip-syncing of dialogues to provide realistic interactions with the game's NPCs.

There is another game, Roblox, which has been experimenting with AI-powered tools to improve productivity and output for some time now. But, as part of this year's Roblox Developers Conference (RDC), they have announced something really cool.

Roblox Launches A 3D Foundational Model

Yes, that is what Roblox calls their upcoming open-source generative AI platform. It can take in text prompts to quickly create 3D environments. As demonstrated by the video above, you can see that the 3D foundation model created a racetrack with different environments, such as a desert and a forest.

As for how the tech works, it “tokenizes” the 3D blocks from the wide range of in-game worlds created by users in Roblox and interprets the blocks as things that can be assigned a numerical value. This enables the AI model to anticipate the subsequent blocks and generate 3D environments.

If you were wondering, what if the output is all messed up?

Well, to mitigate that, there's a second AI model that has been trained on 2D data from both open-source and licensed data sets to moderate the first one's output.

When in conversation with MIT Technology Review, Anupam Singh, VP of Engineering, Growth & AI Platform at Roblox, said that:

We’re doing it in open source, which means anybody, including our competitors, can use this model. Getting it into as many hands as possible also opens creative possibilities for developers who are not as skilled at creating Roblox environments.

Want To Check It Out?

At first glance, this foundational model seems like it could be a great thing for those who want to create game worlds quickly without having to dabble too much with code while focusing more on the creative side of things.

Being open-source means that it will be very accessible. But, the code is yet to show up, and we are not sure which license it would be provided under. My best guess would be one of the OSI-approved licenses.

Meanwhile, you can keep an eye on Roblox's GitHub project page, where it is bound to show up eventually.

Roblox (GitHub)

Suggested Read 📖