that he is creating a new product team solely focused on building generative AI tools like artificial personas, Instagram filters and chat-based features in WhatsApp and Instagram. Zuckerberg reportedly spends most of his time with the new AI team.
The SAM tool is built for those who don’t have the AI infrastructure or the data capacity to create their own models to “segment” or identify different components of an image, say Meta AI researchers Alexander Kirillov and Nikhila Ravi.
But there are limitations of a computer vision model trained on a database of two-dimensional images, says Powers. For example, for the tool to detect and select a remote held upside down, it would need to be trained on different orientations of the same object. Models trained on 2D images won’t help detect images that are partly covered or partially exposed, he says.
For the company, which rebranded itself from Facebook to Meta in late 2021 and inked its commitment to the Metaverse, the most obvious use for this object detection tool is in its virtual reality spaces such as its online VR game Horizon Worlds. Kirillov and Ravi say that their object detection tool can be used for “gaze-based” detection of objects through virtual reality and augmented reality headsets.
The model can detect unknown objects and work across domains with underwater, microscopic, aerial and agricultural images. Kirillov says he was inspired to create a generalized image segmenting model while talking to PhD researchers.
No thanks!