.9B AI scam ring
Google teamed up with the FBI to sue Outsider Enterprise, a Chinese operation that used AI to scam hundreds of thousands of victims. Total losses tied to this kind of scam are estimated at
.9 billion since July 2023. The complaint filed June 12 puts a name on a fraud machine most people had only experienced through suspicious text messages.
The Gist
- Outsider Enterprise sent 2.5 million scam text messages in just two weeks using AI-built fake websites.
- The group abused Google’s Gemini to spin up fraudulent pages impersonating real brands.
- Google, the FBI, and Lumen’s Black Lotus Labs jointly seized domains and shut down storefronts.
Have ChatGPT Recap This Article
ChatGPTWho Outsider Enterprise is and what they did
Outsider Enterprise is a Chinese cybercrime operation that ran a massive phishing campaign targeting people across the United States. Phishing is the practice of pretending to be a real company in a message to trick you into typing your password or card number on a fake website.
The brand they impersonated most often was Google itself. Other major retail and delivery brands were used too. The bait usually came through a simple text message saying there was a problem with your package, your account, or your card, and a link to “fix” it.
Anyone who clicked landed on a fake website built to look real. Once you typed in your password, your credit card number, or your multi-factor authentication code, the data went straight to the scammers. Multi-factor authentication is the second code you get by text or app when you log in, and that code is what attackers want most.
The scale of Outsider Enterprise is what makes this case stand out. The group sent 2.5 million scam texts in two weeks. To do that, they deployed about 9,000 fake websites spread across roughly 1 million fraudulent domains.
According to FBI data going back to July 2023, this style of scam has cost American victims an estimated $1.9 billion. Google’s own complaint says the operation has caused “millions” in direct losses tied to its brand alone.
How they used Google’s own AI to scale
The new piece here is the AI angle. Outsider Enterprise used Google’s Gemini to help build the fake websites that powered the campaign. Gemini is Google’s AI model, the kind of tool that can write code or design web pages when you ask it to.
In a normal use, that is great. You ask Gemini to draft a landing page for a side project and it gives you a working starting point. The Outsider Enterprise crew used the exact same shortcut for the opposite purpose, generating fake brand pages much faster than a human team ever could.
This is why the count is in the millions. Hand-coding a thousand fake pages would take a team weeks. AI lets a small group produce them in hours, change the look on demand, and rotate domains as soon as Google starts blocking them.
Google did not stop there. The company partnered with the FBI and with Lumen’s Black Lotus Labs, a security research team that specializes in tracking large-scale fraud. Together they seized the domains used to host the fake pages, took down Shopify storefronts the scammers were using to cash out, and shut down the accounts behind the operation.
The lawsuit asks the court for compensatory and punitive damages, plus orders to stop Outsider Enterprise from running the same playbook again. With the defendants based in China, collecting money is unlikely, but the orders give Google a legal anchor to keep cutting infrastructure off in the future.
Keep learning on AI Noobies:
- OpenAI Ohio data center: 10 GW with Nvidia behind it
- Deezer AI music detector flags Spotify and Apple too
- AI spending hits $7,500 per employee at top firms
What this means for you in the next few weeks
The first concrete consequence is short term. Expect a drop in random scam texts impersonating Google and a handful of major delivery brands over the coming days. The infrastructure used by Outsider Enterprise has been cut, and rebuilding it takes time.
The drop will not last. Other groups using the same AI-powered approach will fill the space. The cost of building a fake brand page has fallen so much that any motivated team can pick up where Outsider Enterprise left off. The defense work is now permanent infrastructure for Google and its peers.
For you as a regular user, the lesson is simple. The fake pages are now good enough that a quick glance no longer protects you. The reliable defense is to never click a link inside an unexpected text message about your account, your package, or your card. Open the official app or type the website yourself instead.
A second habit worth taking right away is to never read your multi-factor authentication code out loud, never type it on a page you arrived on through a link, and never give it to anyone calling you. That single code is the prize the entire industry of scams like Outsider Enterprise is chasing.
Over the next three to six months, expect Google and other major platforms to tighten the way their AI tools generate brand pages. Gemini specifically is likely to add stricter checks when prompts target real company names or login flows. The Outsider Enterprise case is the one that will be cited internally to justify it.
Follow the story on AI Noobies.
About the Author
