Roblox is a popular game platform that has a passionate community of gamers behind it. The platform lets them make, share, and play games, while also giving them a way to make money with tools like Roblox Studio.
Six months after teasing an open source AI 3D world creator, they have now open sourced the first release of the foundational model that makes it all happen.
Roblox Cube 3D: What to Expect?
Named Cube 3D, this foundational AI model can be used to generate 3D objects and environments from simple text prompts. Roblox has showcased a demo (the video above) that shows it in action, effortlessly creating new 3D elements according to prompts.
The basis for this model is a novel 3D tokenization technique spearheaded by Roblox, where 3D objects are represented as tokens. With this approach, complex 3D structures are broken down into smaller, more manageable components, similar to how words are tokenized in natural language processing.
Using these tokens, the model predicts the next 'shape token' in sequence to construct complete 3D objects or even entire scenes. This approach allows Cube 3D to quickly generate functional and structurally accurate 3D models that are fully compatible with game engines.
Roblox describes the 3D generation process like this:
To achieve 3D generation, we designed a unified architecture for autoregressive generation of single object, shape completion, and multiobject/scene layout generation. Autoregressive transformers are neural networks that use previous inputs to predict the next component.
This architecture provides both scalability and multimodal compatibility so that as we expand the model, it will work with many different kinds of input (text, visual, audio, and 3D).
The source for Cube 3D is set to appear on Roblox's GitHub page later this week, if you are interested in learning more about the inner workings of the model, I highly suggest you go through the announcement blog.
It's FOSS turns 13! 13 years of helping people use Linux ❤️
And we need your help to go on for 13 more years. Support us with a Plus membership and enjoy an ad-free reading experience and get a Linux eBook for free.
To celebrate 13 years of It's FOSS, we have a lifetime membership option with reduced pricing of just $76. This is valid until 25th June only.
If you ever wanted to appreciate our work with Plus membership but didn't like the recurring subscription, this is your chance 😃
Sourav Rudra
