Frame December 2024 Update: Splats, Performance, and More

Frame is the easiest way to come together with others in an immersive space to collaborate and create, right on the web. We have a bunch of sweet new features to show you.

Splats Are Here!

Gaussian Splatting is a powerful new way to create 3D scenes. By taking just a few pictures with your smartphone, you can generate incredibly lifelike 3D models with detailed lighting and reflections.

Instead of using lots of tiny triangles like traditional modeling methods, Gaussian splats use soft, colorful blobs to fill space. These blobs work together to form shapes or scenes.

We expect lots of improvements to keep happening in this area of 3D scene rendering, not just with Gaussian Splatting but with other rendering techniques too.

Soon, we'll also support Niantic's new Splat format: spz. They call it "the .jpg for 3D Gaussian Splats".

Follow the Leader

You can now have other users follow you around your Frame automatically. This can come in handy if you want to give a walkthrough of your Frame without making your guests manually move around the space. Herding cats can be hard in the metaverse!

Performance Improvements

We know that Frame users often want to bring loads of assets into their Frames - images, 3D models, streaming screens, and a lot more. We've introduced some strategies this past year that can help you find this balance between the asset-rich, vibrant Frame you want and the smooth performance you need.

We now have a "hide at a distance" switch for many more kinds of assets, like text areas, polls, videos, stock tickers, pdfs, whiteboards, and more.

AI Video Generation

You can now ask an AI agent to create videos for you and it will generate 5 second clips, either using a text prompt or an image reference.

AI Agents

We have rebranded NPCs to "Agents", and you will see a new "AI Dashboard" linked right from the sidebar. In the AI Dashboard you can modify your agents, view your meeting transcripts, and add things to a knowledge base that all your agents are trained on.

We are only getting started with the AI features in Frame. The AI agents in Frame will soon be able to do work in between meetings, helping you prepare for the next one and contributing as valuable players on your team.