Millennials remember the warning labels. We were told Wikipedia was a minefield. Forum posts? Skip them. Go to primary sources. Start with Google.
Now, Gen Alpha is logging in. And advocates are screaming that the tool we trusted is the very thing breaking them.
A fresh report from child safety watchdog Common Sense Media declares Google’s AI-powered Search an “unacceptable risk.” Their verdict is stark: students should stop using it entirely. Until educators can flip the switch, the AI needs to go.
You might think Chatbots are the villain. They are, obviously. But a simple search? That’s the hidden threat.
The AI Mode Backdoor in Education
Google launched AI Mode for Search last year overnight. No beta testing for schools. No gradual rollout. If you had an education account, you got it. Immediately.
This panicked experts. Common Sense Media and others told Mashable why. Google’s AI Mode runs on Gemini models. These are the same models age-gated across other Google services. But here? No gates.
Robbie Torney, senior director of AI programs for Common Sense Media, calls Google an “outsized player” in search and education. It’s true. The company pushed Chromebooks into every classroom. Google Workspace for Education powers the admin suites. They evangelized AI, scaled it back, then scaled it up again with Gemini for Education. Millions of students, from Kindergarten to post-grads, are locked in.
By making generative AI fundamental—even invisible—they’ve eroded years of trust.
Googling isn’t simple anymore.
Misinformation and the Illusion of Authority
Researchers found Google’s AI Overviews repeat misinformation. The tech giant hasn’t fixed it. Chatbots have always had this problem. They sound authoritative. They sound sure. Adults get confused. Children get misled.
Common Sense Media found something else disturbing. Google’s AI tools finish homework for minor users. Experts say this is a cheat code. The design is misleading. The responses vary. The chatbot is agreeable. Students don’t know they’re cheating. Or worse, they think learning just got harder.
“They are infusing AI in developmentally inappropriate ways.”
Amanda Bickerstaff, deputy director for AI at Education, put it bluntly. AI Mode is a backdoor. It replicates the worst chatbot design in a previously reliable space.
“There is no reason why a 10- or 13- or even 15-year-old should have AI Mode.”
When you teach AI literacy, you have to be intentional. AI Mode is the opposite. You search for facts, not a chatbot’s opinion.
Mental health risks loom too. The report cites safety concerns for kids.
Google doesn’t let you turn off just AI features. Search stays. Guardrails stay up in the school, but kids can still trigger generative AI while doing schoolwork. Parents can block Search entirely. Administrators can theoretically brick Google Search for Workspace accounts.
But what do you tell teachers? That kids can’t look up answers?
“What are you going to say? That kid’s can’t search the web?”
Google pushed back. They said Common Sense Media’s testing was narrow. Not an “effective way to measure safety.” They noted the group only tested consumer accounts, not education ones. But Torney points out the experience is the same for everyone.
Legal Nightmares for School Districts
Sources tell Mashable it might be time to dump Google.
“Google’s AI Overview and AI Mode… are putting their very lives at risk.”
David Monahan, campaign director for Fairplay for Kids, says if Google won’t disable AI for students, schools should drop the products altogether.
Anya Meksin, deputy director at Schools Beyond Screens, sees this as a wake-up call. Her coalition pushes for tech limits in schools. Los Angeles Unified School District recently banned screens for K-1 classes.
Fairplay and Schools Beyond Screens want a moratorium on Gen AI in schools. Meksin says the alarm was already raised about AI Search. Not just chatbots.
“We have to treat this as an emergency.”
Big Tech has colonized education. Democracy’s foundation is at stake.
Schools are violating their own AI policies because tech moves faster. LAUSD bans students under 13 from using generative AI. But Chromebooks with AI Mode bypass that. Instant violation.
K-12 spent billions on edtech over two decades. Meksin heard districts claim it’s impossible to disable it all. Laughable, she says. School districts are liable for exposing kids to known harms. They’re walking into the same legal trouble social media companies faced.
Alphabet and Google faced a wrongful death lawsuit last. A user died by suicide after conversations with Gemini. YouTube was found guilty of negligent design for harming minors.
Torney compares AI Search rollout to YouTube in classrooms. Both came under fire from child safety advocates.
Instead of risking liability, Meksin wants districts to push back. Stronger controls. If Google refuses? Void the contracts.
The largest purchasers have power. Why aren’t they using it? The students are waiting. The teachers are stuck. And the search results keep rolling out, whether we’re ready or not.
