Ray-Ban Meta Smart Glasses have received a software update, which enables live AI, live translation, and support for Shazam.
- ENGAGE 3.10 Update Enhances Meta Llama AI Integrations, Desktop Support, and Session Accessiblity
- Microsoft, Meta Quest Usher in New Spatial Productivity Tools
- Meta and Lightstorm Vision Pioneer 3D Movie Technology
Users can now apply Meta AI technology to their surroundings with live AI, take advantage of the new live translation capabilities while in real-time conversations, or leverage Shazam to find out the name of a song.
The tech giant believes that these changes will make your smart glasses more “capable, useful, and fun” than ever.
Babak Damavandi, Director, AI at Meta, commented on the new Live AI feature via a LinkedIn post: “Excited to launch ‘Live AI’: Our real-time video Multimodal AI Assistant on Ray-Ban Meta glasses.
“We are proud to be the first in our industry to offer a Wearable multimodal video AI experience to the public.
“Our vision for the AI Assistant of the future is a contextual, proactive, and present AI, seamlessly integrating into daily life.
“We believe that the key to achieving this vision is building and shipping real products, to real users.”
Live AI: With Live AI, Meta’s AI technology is capable of seeing what you see so you can engage with it regarding your surroundings. This means you can get hand-free assistance with activities from meal preparation and gardening to exploring your local area.
You can ask questions, interrupt at any time during your exchange with the AI, and even reference previous conversations you have had with it. Meta imagines that one day AI will be able to offer you helpful suggestions before you have even asked.
Live translation: Live translation, as the names suggests, can translate speech in real-time from English to Spanish, French, and Italian.
While you are talking to someone, you will be able to hear a translation of what they are saying through the open-ear speakers or see a transcript of the translation on your phone.
Meta sees this as a useful tool for traveling as it helps to remove the language barrier from conversations.
Shazam support: Meanwhile, support for Shazam allows users can simply ask Meta to find out the name of a song.
‘By Far the Best Form’
In a recent Meta blog post, Andrew Bosworth, Meta CTO + Head of Reality Labs, shared his finding that smart glasses are one of the best ways of leveraging AI in the real world: “While mixed reality headsets are on track to becoming a general purpose computing platform much like today’s PCs, we saw glasses as the natural evolution of today’s mobile computing platforms.
“The biggest thing we’ve learned is that glasses are by far the best form factor for a truly AI-native device.
“In fact they might be the first hardware category to be completely defined by AI from the beginning.
“For many people, glasses are the place where an AI assistant makes the most sense, especially when it’s a multimodal system that can truly understand the world around you.
The version 11 software update for Ray-Ban Meta begins rolling out today in the US and Canada via its Early Access Program.
Meta does warn that it is still testing these features and you may therefore encounter issues, but it is welcoming feedback for those that choose to enrol.
