Meta Connect 2024: AR, VR, AI Advances & Developer Focus

Meta Connect 2024, an event focused on developers, featured a presentation by CEO Mark Zuckerberg. He introduced new hardware and software supporting Meta’s key goals in AI and metaverse technology. The showcase included new Quest virtual reality headsets, improvements to Meta’s Llama AI model, and a prototype of fully augmented reality glasses.

The event began at 10 a.m. PT on Wednesday, September 25. Recordings are available on the Meta Connect website and Meta’s developer Facebook page. For those seeking a more immersive experience, the event can still be accessed through Horizon Worlds using a Meta Quest headset.

We will gather all announcements and reveals from Meta Connect 2024 in the following section. This compilation will be continually updated during and after the event, including subsequent reactions and analyses.

Meta introduces Orion, hailed as “the most advanced glasses the world has ever seen”

Zuckerberg made an unexpected announcement, introducing Orion, which Meta claims will eventually become their pioneering “consumer full holographic AR glasses.” However, these won’t be available to consumers in the near future. Zuckerberg emphasized Orion’s lightweight design, compatibility with hand and eye tracking, and ambitiously, a neural interface. 

He also mentioned some notable early testers, including Nvidia CEO Jensen Huang. Orion was presented as the future of Meta’s AR technology, with ongoing coverage of this significant reveal from Meta Connect available.

Meta launches Quest 3S headset priced at $299

The introduction of the Quest 3S at Connect 2024 confirmed earlier leaks. The Meta Quest 3S is positioned as a more affordable option compared to the Quest 3, with prices starting at $299 for the 128GB model and $399 for the 256GB version. 

This wireless headset is compatible with the existing Quest app and game library, with Meta particularly highlighting its mixed-reality capabilities. Following the Quest 3S announcement, the Quest 3’s price will decrease from $649 to $499.

Quest 2 and Quest Pro phased out

Meta is discontinuing the Quest 2 and Quest Pro headsets following the Quest 3S launch. The company said, “With Quest 3S on the shelf, we’re officially winding down sales of Quest 2 and Pro. We’ll be selling our remaining headsets through the end of the year or until they’re gone, whichever comes first.”

Meta AI introduces voice features

Meta AI Assistant now supports voice interactions across Messenger, Facebook, WhatsApp, and Instagram. Users can verbally communicate with the AI and receive vocal responses. The assistant will offer multiple voice options, including AI-generated celebrity voices such as Dame Judi Dench, John Cena, Awkwafina, Kristen Bell, and Keegan-Michael Key.

Meta AI voice interaction capabilities were introduced shortly after OpenAI launched its updated Advanced Voice Mode. OpenAI’s feature includes a fresh interface and five new voice options. In related news, Zuckerberg announced a significant milestone for Meta AI, reporting that it has now reached 500 million users.

Llama 3.2 AI model released with multimodal capabilities

Following its previous release of Llama 3.1, Meta has released version 3.2 of its multilingual Llama family of models, introducing multimodal features to several Llama models. Llama 3.2 11B and 90B can now interpret charts and graphs, caption images, and identify objects in pictures based on simple descriptions. These models can analyze maps to estimate path lengths and terrain difficulty or interpret business data visualizations like revenue graphs.

However, due to EU Act restrictions, Llama 3.2 11B and 90B are not accessible in Europe. As a result, several Meta AI features available elsewhere, such as image analysis, are disabled for European users.

Ray-Ban’s Meta smart glasses get AI and feature upgrades

Ray-Ban’s Meta smart glasses are receiving new capabilities as Meta continues to position them as a significant consumer device. The primary addition is real-time AI video processing, allowing users to ask the glasses questions about what they see.

The sunglasses will also feature a reminder function similar to smartphones, live language translation between English and three other languages (French, Italian, and Spanish), and complete integration with music streaming platforms, including Amazon Music, Audible, and iHeart Radio.

Zuckerberg’s shirt makes a statement

Zuckerberg’s fashion choice at Meta Connect featured a shirt with the Latin phrase “Act Zuck aut nihil,” meaning “either Zuck or nothing.” This phrase, adapted from one associated with Julius Caesar, aligns with Zuckerberg’s known interest in Roman history.

Meta AI introduces visual search capabilities

Meta demonstrated its AI’s ability to process and respond to image-based prompts, similar to features offered by OpenAI, Google, and Apple. The AI can edit photos based on user feedback and share them directly to Instagram Stories.

AI’s expanding role in Facebook Feed

Meta is increasing its AI presence in Facebook feeds. Users may encounter AI-generated content, sometimes unknowingly. Recently, Meta reduced the size of labels indicating AI-edited content. Now, Facebook will suggest AI-generated content it believes users might want to share or engage with.

Meta tests AI-powered content translation

Meta announced a trial of AI translation tools for creator content. This technology translates and dubs videos, synchronizing lip movements accordingly. The test currently involves creator videos from the U.S. and Latin America, translating between English and Spanish.

Zuckerberg demonstrated this technology during Connect. He interviewed an AI version of creator Don Allen Stevenson III while the actual Stevenson was present on stage, creating a unique showcase of the AI’s capabilities.

Expanding Quest’s appeal to mobile developers

At Connect, Meta showcased new features to attract mobile developers to its VR platform. The company introduced Android app support for Quest, along with compatibility for 3D and spatial applications. This initiative aims to diversify the Quest app store’s offerings and strengthen Meta’s developer relationships.

Quest platform’s game lineup expands

Batman: Arkham Shadow leads the lineup, set to release on October 22. It will be included with Quest 3 and 3S purchases through April 2025. Other notable titles include the horror-themed Alien: Rogue Incursion, a revamped version of Arizona Sunshine, and surprisingly, a VR adaptation of Wordle. The VR puzzle game will be freely accessible without requiring a New York Times subscription.