TL;DR

A recent analysis of Meta’s Stella app reveals a fully functional facial recognition system on its smart glasses, capable of detecting and identifying faces locally. While not confirmed as active for users, the presence of this technology signals potential future features and privacy concerns.

Meta’s Stella app for its smart glasses contains a fully assembled facial recognition system capable of detecting and identifying faces locally on the device, according to a recent technical analysis. While the system is present and functional in the app’s code, it is not confirmed whether this feature is active or enabled for ordinary users at this time. The discovery raises questions about future capabilities and privacy implications.

A researcher examining version 273.0.0.21 of Meta’s Stella app found that the app includes all necessary components for on-device facial recognition, including face detection models, biometric embedding generation, and a local database for storing face profiles. The recognition pipeline can detect a face, generate a 2048-dimensional biometric fingerprint, and perform local matching against stored profiles, triggering notifications when a match occurs. However, the user interface elements for recognition are not active on stock, unenrolled accounts, and there is no evidence that Meta is currently pushing identity data to servers during normal operation.

The facial recognition system comprises three models: SCRFD for detection, KPSAligner for alignment, and SFace for embedding generation, all of which are standard open-source architectures scaled for Meta’s use. The system uses a cosine similarity index to compare face embeddings against stored profiles. The app’s code suggests the capability to recognize faces locally and store new biometric data, but this functionality appears gated or inactive for typical users, with no observed server-side data transmission.

Why It Matters

The presence of a complete facial recognition pipeline on Meta’s smart glasses indicates potential future deployment of on-device identification features, raising privacy and security concerns. If activated for users, it could enable real-time face recognition without server interaction, impacting user privacy and data security. The discovery also underscores the increasing integration of biometric capabilities into wearable technology, prompting regulatory and ethical considerations.

Lockin Veno Solar Face Smart Lock - Facial Recognition Keyless Entry Deadbolt - Solar Powered for Perpetual Battery Life - Built-in WiFi - Works with Apple Home, Alexa & Google Home - No Subscription

Lockin Veno Solar Face Smart Lock – Facial Recognition Keyless Entry Deadbolt – Solar Powered for Perpetual Battery Life – Built-in WiFi – Works with Apple Home, Alexa & Google Home – No Subscription

Industry-First Perovskite Solar Power: Near-perpetual battery life via integrated 37Wh battery and solar panel that captures 11hrs of…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background

Meta has been developing smart glasses for several years, with previous focus on augmented reality and hands-free communication. The Stella app is the companion interface for these glasses, and recent code analysis reveals that Meta has integrated facial recognition technology into the device software, though it remains unclear whether this feature is active or planned for release. Similar on-device recognition features have been explored by other tech companies, but Meta’s implementation appears to be more comprehensive, including detection, alignment, embedding, and local storage capabilities.

“The entire computational and storage stack for on-device facial recognition is present and wired together in the app, capable of detecting and recognizing faces locally.”

— Researcher analyzing the Stella app

“N/A”

— Meta spokesperson (not yet available)

OrCam MyEye 3 Pro 2024 Advanced Vision Impairment Wearable: Text Reading, Face Recognition, Product ID & Smart Magnifier - Unique Solution for Books, Screens & More (ORCAM MYEYE 3 PRO US)

OrCam MyEye 3 Pro 2024 Advanced Vision Impairment Wearable: Text Reading, Face Recognition, Product ID & Smart Magnifier – Unique Solution for Books, Screens & More (ORCAM MYEYE 3 PRO US)

ADVANCED ASSISTIVE TECHNOLOGY: The OrCam MyEye 3 Pro is a new cutting-edge level, wearable device designed to empower…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What Remains Unclear

It is not yet clear whether Meta plans to activate this facial recognition system for users or keep it as an inactive feature. There is no evidence of server-side data transmission during normal operation, but the potential for future deployment remains uncertain. Additionally, the privacy safeguards and user controls associated with this technology have not been disclosed.

MLVISION Ultra-Light AR Smart Glasses World's First Clip-On Micro-LED AR Display, Immersive Private Screen, AI Productivity, Real-Time Translation & Navigation

MLVISION Ultra-Light AR Smart Glasses World's First Clip-On Micro-LED AR Display, Immersive Private Screen, AI Productivity, Real-Time Translation & Navigation

World's First Clip-On AR Glasses Design: Innovative clip-on structure lets you easily attach the AR display to your…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What’s Next

Meta may choose to activate or further develop these facial recognition capabilities, potentially announcing new features for its smart glasses. Regulatory scrutiny and user privacy concerns are likely to influence future decisions. Observers will watch for official statements, updates to the app, or deployment of recognition features in upcoming software releases.

Lightweight Rimless Smart Glasses with Self-Tinting Lenses - Bluetooth Open-Ear Audio, No Camera for Privacy, All-Day Comfort

Lightweight Rimless Smart Glasses with Self-Tinting Lenses – Bluetooth Open-Ear Audio, No Camera for Privacy, All-Day Comfort

【All-Day Comfort, Lightweight Design】 Rimless, frameless build designed for extended wear. Customers report a comfortable, barely-there feel with…

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Is Meta currently using facial recognition on its smart glasses?

There is no confirmed evidence that Meta is actively deploying facial recognition features for users. The system components are present in the app code, but activation appears to be gated or inactive for normal operation.

While the technical system exists, it remains unclear if or when Meta would activate it for user-facing features. Ethical and privacy considerations are likely to influence deployment decisions.

What are the privacy implications of on-device facial recognition?

If activated, facial recognition on the device could process biometric data locally, reducing transmission risks, but also raising concerns about surveillance, data security, and user consent.

Has Meta announced plans to release facial recognition features?

No official announcements have been made. The presence of the system in the code suggests potential future development, but specifics remain undisclosed.

Source: Hacker News

You May Also Like

The Augmented Employee: Boosting Productivity With AI Tools

Jump into the world of AI tools and discover how they can elevate your productivity—are you ready to unlock your full potential?

Every AI Subscription Is a Ticking Time Bomb for Enterprise

Major AI providers are subsidizing enterprise subscriptions at a loss, risking future cost surges for companies built on these cheap AI services.

Tech CEOs are apparently suffering from AI psychosis

Tech industry leaders are reportedly experiencing ‘AI psychosis,’ leading to widespread layoffs and misguided AI optimism, raising concerns about organizational chaos.

AI looms over Japan’s near-record employment rate for new grads

Japan’s strong graduate employment rate faces potential decline as companies consider AI-driven hiring cutbacks, raising concerns about future job prospects.