Entity identification remains a key element in the development of AR experiences, with an effective AR system able to identify different objects in the world around you to better provide additional, functional insight, overlaid on screen.

We’ve already such in the development of AR face filters and tools on different social apps – the better the system is at understanding eye placement, movement, etc., the better the on-screen effects, at least visually speaking. Over time, such systems have gotten better at responding to different elements. Now, Meta has released a new model and dataset which could help take things to the next level.

Development in Progress

As seen in this clip, Meta’s new ‘Segment Anything’ project aims to provide researchers and developers with more means to help identify objects in frame. Here’s how Meta lays it out:

“We are releasing both our general Segment Anything Model (SAM) and our Segment Anything 1-Billion mask dataset (SA-1B), the largest ever segmentation dataset, to enable a broad set of applications and foster further research into foundation models for computer vision.”

Ideally, the process will provide users with more capacity to power AR experiences. However, as noted, Meta also says that it will have applications in AI and VR creation processes, too. On top of this, Meta also states that there are several ways in which its new dataset could be used, which could prove to be a big step in assisting the broader development of AR models. For Meta, specifically, it could help to build out its Project Aria smart glasses, which may or may not be shelved due to the recent cost-cutting efforts at Meta.

Last June, The Information reported that Meta had delayed the planned release of its AR glasses as part of broader cost-cutting measures. According to the report, Meta opted to scrap the first iteration of its AR wearables, which were set to hit the market next year, in favor of focusing on the second generation of its AR device, which now has no release date in frame. Of course, Meta also released its ‘Ray Ban Stories’ smart glasses in 2021, which seemed like some sort of precursor to its next push into AR wearables – which, at the time, also seemed like they might soon be coming. However, tougher economic conditions and focusing a huge portion of its investment towards its Metaverse push might force Meta into a hard decision of throwing its AR wearables initiatives under the bus.

The Wrap

While we can’t say for certain how much the project has been set back, this new dataset does seem to point to its ongoing development on this front, which could see the release of another version of its smart glasses sometime in the future. That ‘when’ is what remains the gray area here, and with VR remaining its big investment focus, and generative AI coming into frame, it has seemed like AR has been the big loser in terms of resource allocation.

Maybe, just maybe, it’s coming. Perhaps developments like this point to that next stage, where full, interactive, engaging AR experiences will soon be a reality – or maybe it’s all set to be tied into VR, merging your real and digital experiences into a more immersive process. It’s honestly an interesting development, and this dataset release could help the broader developer community in building next-generation experiences.

Sources

http://bit.ly/3GmRN47