AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Roblox launched an AI-based age verification system last week, but it has quickly become problematic, misidentifying users’ ages and sparking widespread complaints. The company claims it’s still refining the process amid privacy and safety concerns.

Roblox’s recently launched AI-powered age verification system is experiencing significant failures, with many users reporting misidentification of their ages, leading to widespread dissatisfaction and safety concerns. The platform, which requires users to verify their age to access chat functions, is now under scrutiny as the system misclassifies both young and adult users, undermining its safety goals.

Buying for a business?Offer from Amazon

Get business pricing on tech for your team

  • Business-only prices and quantity discounts
  • Tax-exempt purchasing
  • Multiple users, one account, clear invoices
As an affiliate, we earn on qualifying purchases.

Roblox introduced the AI-based age verification last week in several countries, including the US, Australia, New Zealand, and the Netherlands, aiming to create a safer environment by restricting chat access based on verified age groups. Users are asked to submit a short video or upload a government-issued ID, with all data reportedly deleted after processing, according to Roblox.

However, within days, players and parents began reporting that the system frequently misidentified ages, placing young children into adult categories and vice versa. Some users, claiming to be in their twenties or teens, reported being classified as much younger or older, with instances of users tricking the system using avatars or fabricated images. Several videos circulated online show children drawing wrinkles or stubble on photos to deceive the AI, which then assigns them an incorrect age rating.

Why It Matters

This development is significant because the system’s failures threaten to undermine Roblox’s safety efforts, potentially exposing children to predators or restricting legitimate users’ access. The controversy also raises concerns about privacy, as many users are hesitant to submit personal data, and questions about the reliability of AI-based verification methods in sensitive environments.

Products Worth Considering

Kindle Paperwhite Signature Edition 32GB (2024 Model) - Metallic Black

Kindle Paperwhite Signature Edition 32GB (2024 Model) – Metallic Black

As an affiliate, we earn on qualifying purchases.

Background

Roblox announced the age verification feature last July, amid mounting legal pressures and lawsuits alleging inadequate protection for young users. The platform, with over 150 million daily active users, has faced criticism for facilitating predatory behavior, prompting the company to implement stricter safety measures. The AI system’s rollout was part of these efforts, but technical issues have quickly emerged, casting doubt on its effectiveness and safety.

“Expecting the system to be flawless overnight is ignoring the scale of this undertaking.”

— Roblox Chief Safety Officer Matt Kaufman

“The most widespread danger is the large number of accounts that have been mistakenly filed into the wrong age category, complicating efforts to protect children.”

— Independent researcher Ry Terran

“We are removing listings that violate our policies for selling age-verified accounts.”

— eBay spokesperson Maddy Martinez

What Remains Unclear

It remains unclear how widespread the misclassification issues are, how Roblox plans to improve the accuracy of its AI system, and whether the company will roll back or modify the verification process. The effectiveness of the company’s proposed rechecking measures and safeguards is also still uncertain.

What’s Next

Roblox has stated it is working on solutions to address the misidentification issues and privacy concerns, with updates expected soon. The company will likely refine its AI algorithms and possibly introduce additional verification safeguards. Monitoring user feedback and safety reports will be critical in assessing the system’s future effectiveness.

Key Questions

Why is Roblox implementing AI-based age verification?

Roblox aims to create a safer environment by restricting chat and interaction features to users verified to be within appropriate age groups, reducing the risk of predatory behavior and ensuring compliance with safety regulations.

What are the main problems with the current system?

Many users report that the AI system misclassifies ages, placing children in adult categories and adults in children’s categories, often based on misleading or manipulated images. There are also concerns about privacy and the system’s overall reliability.

Can users bypass the verification process?

Yes, some users have used avatars, manipulated images, or even photos of deceased celebrities to trick the system, raising concerns about its effectiveness and potential exploitation.

Will Roblox roll back or fix the system?

Roblox has indicated it is working on improvements and solutions to address the issues, but specific plans or timelines have not been publicly detailed yet.

You May Also Like

10 Best OLED Gaming Monitors for Faster, Richer Play in 2026

Explore the 10 best OLED gaming monitors in 2026, featuring fast refresh rates, deep blacks, and premium features for immersive gameplay.

What The Shared AI Training Opt-Out Covers—and What It Leaves Out

OpenAI, Google, Microsoft and Anthropic say they will honor a shared robots.txt training preference, but it is voluntary and does not block AI answers.

The Trojan Horse in Your Living Room: How Smart TVs Became the World’s Most Sophisticated Ad Surveillance Network

Smart TVs collect detailed screen fingerprints every 500ms, selling viewer data for targeted advertising. This practice is now under legal scrutiny.

4 Top Picks: AI Laptops For Content Creation In 2027

A source-based comparison of four Windows laptops for content creation, led by two 15.6-inch NIMO Ryzen 7 models.