TL;DR
Roblox launched an AI-based age verification system last week, but it has quickly become problematic, misidentifying users’ ages and sparking widespread complaints. The company claims it’s still refining the process amid privacy and safety concerns.
Roblox’s recently launched AI-powered age verification system is experiencing significant failures, with many users reporting misidentification of their ages, leading to widespread dissatisfaction and safety concerns. The platform, which requires users to verify their age to access chat functions, is now under scrutiny as the system misclassifies both young and adult users, undermining its safety goals.
Roblox introduced the AI-based age verification last week in several countries, including the US, Australia, New Zealand, and the Netherlands, aiming to create a safer environment by restricting chat access based on verified age groups. Users are asked to submit a short video or upload a government-issued ID, with all data reportedly deleted after processing, according to Roblox.
However, within days, players and parents began reporting that the system frequently misidentified ages, placing young children into adult categories and vice versa. Some users, claiming to be in their twenties or teens, reported being classified as much younger or older, with instances of users tricking the system using avatars or fabricated images. Several videos circulated online show children drawing wrinkles or stubble on photos to deceive the AI, which then assigns them an incorrect age rating.
Why It Matters
This development is significant because the system’s failures threaten to undermine Roblox’s safety efforts, potentially exposing children to predators or restricting legitimate users’ access. The controversy also raises concerns about privacy, as many users are hesitant to submit personal data, and questions about the reliability of AI-based verification methods in sensitive environments.
ID verification webcam
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Background
Roblox announced the age verification feature last July, amid mounting legal pressures and lawsuits alleging inadequate protection for young users. The platform, with over 150 million daily active users, has faced criticism for facilitating predatory behavior, prompting the company to implement stricter safety measures. The AI system’s rollout was part of these efforts, but technical issues have quickly emerged, casting doubt on its effectiveness and safety.
“Expecting the system to be flawless overnight is ignoring the scale of this undertaking.”
— Roblox Chief Safety Officer Matt Kaufman
“The most widespread danger is the large number of accounts that have been mistakenly filed into the wrong age category, complicating efforts to protect children.”
— Independent researcher Ry Terran
“We are removing listings that violate our policies for selling age-verified accounts.”
— eBay spokesperson Maddy Martinez
Cyber-AI Arms Race: Defending the Digital World in the Age of Intelligent Threats
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
What Remains Unclear
It remains unclear how widespread the misclassification issues are, how Roblox plans to improve the accuracy of its AI system, and whether the company will roll back or modify the verification process. The effectiveness of the company’s proposed rechecking measures and safeguards is also still uncertain.
BioScrypt/L-1 Identity 4GFXS V-Flex 4G (S) Fingerprint Reader w/Secugen Sensor
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
What’s Next
Roblox has stated it is working on solutions to address the misidentification issues and privacy concerns, with updates expected soon. The company will likely refine its AI algorithms and possibly introduce additional verification safeguards. Monitoring user feedback and safety reports will be critical in assessing the system’s future effectiveness.
ID Scanner for Bars and Clubs – Easy to Use and Reliable ID Checker for Your Business that Detects Expired IDs & Underage Customers – Works in All 50 States – Includes Optional Fake ID Detection
Unlimited Standard ID Scanning — Always Free – Instantly verifies age and expiration on every scan and automatically…
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
Why is Roblox implementing AI-based age verification?
Roblox aims to create a safer environment by restricting chat and interaction features to users verified to be within appropriate age groups, reducing the risk of predatory behavior and ensuring compliance with safety regulations.
What are the main problems with the current system?
Many users report that the AI system misclassifies ages, placing children in adult categories and adults in children’s categories, often based on misleading or manipulated images. There are also concerns about privacy and the system’s overall reliability.
Can users bypass the verification process?
Yes, some users have used avatars, manipulated images, or even photos of deceased celebrities to trick the system, raising concerns about its effectiveness and potential exploitation.
Will Roblox roll back or fix the system?
Roblox has indicated it is working on improvements and solutions to address the issues, but specific plans or timelines have not been publicly detailed yet.
