Exclusive: We tried Meta's AR glasses with Mark Zuckerberg

The Nugget

  • Meta's Orion AR glasses showcase the potential future of augmented reality technology, combining eye tracking, hand gestures, and generative AI for a more interactive experience. However, the product remains a prototype, highlighting both its innovative features and the challenges Meta faces in readiness for commercial launch.

Make it stick

  • 🕶️ Orion features a 70-degree field of view, significantly wider than current AR glasses, enhancing the immersive experience.
  • 🤖 The neural wristband interprets finger gestures to control the glasses, offering intuitive navigation without traditional inputs.
  • 🌐 Generative AI can identify objects and create contextual recipes, indicating a blend of everyday utility and advanced technology.
  • 🎮 The demo showcased interaction with live video calls, albeit with the potential for disruption in real-world settings.

Key insights

Innovation in Augmented Reality

  • Orion consists of:
    1. The glasses with a wide field of view.
    2. A neural wristband for intuitive controls.
    3. A wireless compute puck for offloading processing.

Advanced Interaction Modes

  • Users navigate using:
    • Eye tracking and hand tracking.
    • Voice commands.
    • Finger pinching gestures recognized by the wristband.

Future Prospects and Challenges

  • The glasses are not currently for sale, with only around 1,000 prototypes made for internal use.
  • There are operational snags, such as window overlap disrupting real-world interactions.
  • Despite current limitations, the experience provides a glimpse into a future where AR glasses could transform user interaction and daily tasks, potentially replacing smartphones.

Key quotes

  • "Orion is a peek at what Meta has coming for hardware it's releasing over the next few years."
  • "This is gonna be the whole interview. It's just an hour of us-"
  • "The band is just gonna keep getting better and better."
  • "He called them the holy grail device that will eventually replace smartphones."
  • "These glasses are the end state of Zuckerberg's big bet on the Metaverse."
This summary contains AI-generated information and may have important inaccuracies or omissions.