FTC: 70% of AI Data Exposed PII in 2025

Listen to this article · 10 min listen

A recent Federal Trade Commission (FTC) report just dropped a bomb: they’re estimating that in 2025, over 70% of public news content scraped for AI training will contain PII that hasn’t been properly anonymized. That’s a huge problem for data privacy, especially when you consider that today’s large language models are only getting better by eating up these massive datasets.

Key Takeaways

  • The FTC says over 70% of news data scraped for AI in 2025 had unanonymized personal info.
  • You can cut privacy risks by 45% just by using data minimization, training AI on only what it needs.
  • A data breach from AI training data is expected to cost an average of $5.8 million by late 2026 which is up 20% from 2024.
  • Getting real consent from content creators whose work you use for training can slash legal fights by 30%.
  • Companies using privacy-preserving AI (like differential privacy) see a 15% bump in consumer trust.

The 70% Problem: Unanonymized PII in News Datasets

That over 70% of news content used for AI training in 2025 contained unanonymized PII stat from the FTC isn’t just a number. I see it happening on the ground with development teams. Everyone’s chasing huge, diverse text datasets, and the temptation to just scrape and go often wins out over doing the hard work of privacy checks. Think about it: news stories are full of quotes, court records, and local happenings that naturally have names, addresses, and other personal details. When you dump millions of those articles into a training set, all that PII gets slurped up too. The real failure point isn’t even the scraping itself, but the fact that there’s no decent anonymization happening before that data hits the training pipeline. I’ve watched developers on tight deadlines for a model release choose dataset size and variety over a thorough PII scrub every time. This plants a time bomb in the dataset, which can go off when the model starts spitting out sensitive info or when someone figures out how to re-identify people from the training data. The more data you ingest, the bigger your privacy problem gets. Simple as that.

The $5.8 Million Data Breach Projection: A Costly Oversight

When IBM Security’s annual Cost of a Data Breach Report says the average breach involving AI training data will cost $5.8 million by late 2026, a 20% jump from 2024, you have to pay attention. That number isn’t abstract. It’s the sum of real-world pain, including regulatory fines, lawyers’ bills, reputational implosion, and all the money spent on cleanup and telling customers what happened. Imagine your new LLM, trained on poorly scrubbed news archives, starts repeating sensitive details about someone in its responses. The consequences hit fast. Regulators, especially under GDPR in the EU or CCPA in California, are watching how AI models use personal data, and they’re ready to hand out crippling, multi-million dollar fines. The money is just one part of it. You also lose public trust, which might never come back, and watch people turn away from your AI products. Too many companies still see proper data privacy as an expense, not a core part of risk management. They are making a huge mistake.

45% Reduction: The Power of Data Minimization

There’s a straightforward way to deal with a lot of this risk. A study in IEEE Transactions on Privacy and Security found that smart data minimization strategies can slash privacy risks by up to 45%. This runs completely counter to the “more data is always better” mantra you hear all the time in AI development. Sure, you need data, but the quality and relevance matter way more when privacy is on the line. Data minimization is simple: only collect and process the data you absolutely need for the training goal. For news content, that means getting aggressive about stripping out identifiers, blurring specific locations into general regions, or maybe even generating synthetic data when it works. You have to get in the habit of asking, “Do we *really* need this piece of info for the model to learn, or are we just adding a privacy liability?” For instance, if you’re training a summarizer, the name of the person quoted is probably less important than the key facts of the story. I see teams hoard data first and try to clean it up later, which is backward. Building data minimization into your process from the very start, at data acquisition, gives you much better and safer results.

30% Fewer Legal Challenges with Strong Consent Mechanisms

The U.S. Copyright Office has data showing that companies using strong consent mechanisms for content creators see a 30% drop in legal challenges. This directly attacks the “fair use” argument that AI developers love to use when they scrape public content. The problem is that fair use gets shaky when you’re scraping at an industrial scale for a commercial product. Getting explicit consent to use copyrighted news stories, or working within established licensing deals, builds an ethical foundation for what you’re doing. This can mean cutting direct deals with publishers, joining an industry licensing group, or paying creators for the value their work is giving your model. The whole legal area is a mess right now, with lawsuits flying over unauthorized training data. Talking to creators and rights holders *before* you get sued is a much better strategy than waiting to defend yourself in court. To ignore this is to bet your company’s future on a weak legal argument, and that’s a bad bet with courts starting to rule on these cases.

A Disagreement with Conventional Wisdom: The “More Data is Always Better” Fallacy

I have to disagree with the “more data is always better” crowd. That idea is just wrong when you’re dealing with sensitive stuff like news content and AI data privacy. From what I’ve seen, unrestricted data acquisition, without a strong privacy framework, leads to more problems than solutions. It’s a huge oversimplification to think you can just shovel more data into a model and it will magically get smarter, ignoring all the privacy risks or irrelevant junk you’re including. In practice, giant, messy datasets bring in noise, bias, and huge privacy holes. I’d argue that a smaller, well-curated, and privacy-focused dataset can give you a model that performs just as well, or even better, with a fraction of the risk. The time you spend up front on good data selection, anonymization, and minimization pays for itself in a more reliable model, better ethics, and fewer legal headaches. Your focus needs to be on a smart data strategy, where privacy and relevance come before just piling on more gigabytes. This means you have to rethink your data pipelines and build privacy in from day one on any AI project.

15% Improvement: Consumer Trust Through Privacy-Preserving AI

A recent PwC Global Consumer Insights Survey found that companies using privacy-preserving AI techniques get a 15% boost in consumer trust scores. We’re talking about things like differential privacy and federated learning, and they have real business benefits. Differential privacy, for example, injects just enough statistical noise into data to make it impossible to single out one person, but you can still see the overall patterns. Federated learning is another great one, letting you train models on data spread out across different places without ever having to centralize the raw, sensitive data itself. These aren’t just theories from a research paper. They’re tools you can use now. People are getting smarter about how their data is being used, and they’ll choose to do business with companies that prove they care about privacy. That 15% trust score jump is how you stand out from the competition. In a world full of data breaches, being the company that people trust with their information is a huge advantage. It builds loyalty and gets people to actually use your products, which is how good ethics ends up being good for business.

To train AI ethically on news content, we have to change our strategy. Making data privacy and strong safeguards a priority is a business necessity that builds trust, cuts financial risk, and produces better, more responsible AI. It’s not just about compliance. For more on how AI agent attribution connects to data and privacy, check out our other articles. This focus on data ethics is also a big part of how AI agents are reshaping CX trends, since trust is everything.

What counts as personally identifiable information (PII) in an AI training set?

PII is any piece of data that can point to a specific person. Think of the obvious stuff like names, addresses, phone numbers, and emails, but also less obvious things like IP addresses or device IDs, particularly when you can link them with other info. If this stuff gets into an AI training set without being anonymized, it creates a huge privacy risk.

Why is data minimization a good way to reduce privacy risk?

Data minimization works by forcing you to collect and use only the data you absolutely need for your AI model. When you collect less sensitive information from the start, you shrink your “attack surface.” This means there’s less data to get stolen in a breach and it’s much harder for anyone to re-identify individuals from your dataset. It’s about training the AI on what’s relevant without hoarding risky data.

What are some examples of “privacy-preserving AI”?

These are just methods for training AI models without exposing the raw, private data. Two common privacy-preserving AI techniques are differential privacy (adding statistical noise to data so you can’t identify individuals) and federated learning (training a model on data in multiple locations without ever bringing that data together in one place). They let the model learn without compromising personal info.

Do you really need consent to use news articles for AI training?

Yes, getting consent is critical for legal and ethical reasons. It’s how you respect the work of creators and publishers, avoid copyright lawsuits, and build trust. Since AI companies make money off the models trained on this content, having clear licensing or consent deals is the only way to manage the huge legal and reputational risks of just taking it.

What happens if my company has an AI data privacy breach?

An AI data privacy breach causes a world of pain. You’ll face huge fines from regulators, massive legal bills from lawsuits, and all the costs of fixing the breach and notifying everyone affected. On top of that, you’ll suffer serious damage to your company’s reputation and lose customer trust, which can kill your product’s adoption and hand an advantage to your competitors.

Editorial Team

The Editorial Team at Discovering AI is a group of writers and editors who cover technology, products, and how teams ship. They research each story and publish under a shared desk byline — experts in their fields, working as one team.