Government & Policy

Meta faces more questions in Europe about child safety risks on Instagram

Comment

Instagram, WhatsApp, Facebook and other Apps on iPhone screen
Image Credits: Stockcam (opens in a new window) / Getty Images

Meta has received another formal request for information (RFI) from European Union regulators seeking more details of its response to child safety concerns on Instagram — including what it’s doing to tackle risks related to the sharing of self-generated child sexual abuse material (SG-CSAM) on the social network.

The request is being made under the bloc’s recently rebooted online rulebook the Digital Services Act (DSA), which started applying for larger in-scope platforms (including Instagram) in late August.

The DSA puts obligations on Big Tech to tackle illegal content — including by having measures and protections in place to prevent misuse of their services. The regulation also has a strong focus on the protection of minors so it’s not surprising to see a number of early RFIs made by the European Commission concern child safety.

The latest Commission request to Meta comes hard on the heels of a report by the WSJ that suggests Instagram is struggling to clean up a CSAM problem it exposed this summer — when it reported Instagram’s algorithms were connecting a web of accounts which were being used for making, buying and trading underage-sex content.

In June, following the WSJ’s exposé, the EU warned Meta it faces a risk of “heavy sanctions” if it doesn’t act quickly to tackle the child protection issues.

Now, months later, another report by the WSJ claims Meta has failed to rectify the issues identified — despite the company setting up a child safety task force to try to stop “its own systems from enabling and even promoting a vast network of pedophile accounts”, as the newspaper puts it.

“Five months later, tests conducted by the Journal as well as by the Canadian Centre for Child Protection show that Meta’s recommendation systems still promote such content [i.e. accounts dedicated to producing and sharing underage-sex content],” it reports. “The company has taken down hashtags related to pedophilia but its systems sometimes recommend new ones with minor variations. Even when Meta is alerted to problem accounts and user groups, it has been spotty in removing them.”

Spotty performance by Meta on tackling the sharing of illegal CSAM/SG-CSAM and failing to act effectively on associated child safety risks could get very expensive for the company in the EU: The DSA empowers the Commission to issue fines of up to 6% of global annual turnover if it finds the regulation’s rules have been broken.

Already, just over a year ago, Meta was fined under half a billion dollars after Instagram was found to have violated the bloc’s data protection rules for minors.

“The Commission is requesting Meta to provide additional information on the measures it has taken to comply with its obligations to assess risks and take effective mitigation measures linked to the protection of minors, including regarding the circulation of SG-CSAM on Instagram. Information is also requested about Instagram’s recommender system and amplification of potentially harmful content,” the EU wrote in a press release today, announcing its latest intel-gathering step on the platform.

As well as the possibility of financial sanctions there could be reputational concerns for Meta if EU regulators are repeatedly seen questioning its approach to safeguarding minors.

This is the third RFI Meta has received since DSA compliance begun to apply on the company — and the second to focus on child safety on Instagram. (The EU has also asked Meta for more details of its handling of content risks related to the Israel-Hamas war; and about what it’s doing to ensure election security.)

So far the EU hasn’t announced any formal investigation proceedings under the DSA. But the early flurry of RFIs show it’s busy making assessments which could lead to such a step — opening up the risk of penalties down the line should any breaches be confirmed.

Meta has been given a deadline of December 22 to provide the Commission with the latest tranche of requested child safety data. Failures to comply with RFIs — such as by sending incorrect, incomplete, or misleading information in response to a request — can also attract DSA sanctions.

Meta was contacted for comment on the latest RFI.

Meta and Snap latest to get EU request for info on child safety, as bloc shoots for ‘unprecedented’ transparency

Meta warned it faces ‘heavy sanctions’ in EU if it fails to fix child protection issues on Instagram

More TechCrunch

To give AI-focused women academics and others their well-deserved — and overdue — time in the spotlight, TechCrunch has been publishing a series of interviews focused on remarkable women who’ve contributed to…

Women in AI: Rep. Dar’shun Kendrick wants to pass more AI legislation

We took the pulse of emerging fund managers about what it’s been like for them during these post-ZERP, venture-capital-winter years.

A reckoning is coming for emerging venture funds, and that, VCs say, is a good thing

It’s been a busy weekend for union organizing efforts at U.S. Apple stores, with the union at one store voting to authorize a strike, while workers at another store voted…

Workers at a Maryland Apple store authorize strike

Alora Baby is not just aiming to manufacture baby cribs in an environmentally friendly way but is attempting to overhaul the whole lifecycle of a product

Alora Baby aims to push baby gear away from the ‘landfill economy’

Bumble founder and executive chair Whitney Wolfe Herd raised eyebrows this week with her comments about how AI might change the dating experience. During an onstage interview, Bloomberg’s Emily Chang…

Go on, let bots date other bots

Welcome to Week in Review: TechCrunch’s newsletter recapping the week’s biggest news. This week Apple unveiled new iPad models at its Let Loose event, including a new 13-inch display for…

Why Apple’s ‘Crush’ ad is so misguided

The U.K. Safety Institute, the U.K.’s recently established AI safety body, has released a toolset designed to “strengthen AI safety” by making it easier for industry, research organizations and academia…

U.K. agency releases tools to test AI model safety

AI startup Runway’s second annual AI Film Festival showcased movies that incorporated AI tech in some fashion, from backgrounds to animations.

At the AI Film Festival, humanity triumphed over tech

Rachel Coldicutt is the founder of Careful Industries, which researches the social impact technology has on society.

Women in AI: Rachel Coldicutt researches how technology impacts society

SAP Chief Sustainability Officer Sophia Mendelsohn wants to incentivize companies to be green because it’s profitable, not just because it’s right.

SAP’s chief sustainability officer isn’t interested in getting your company to do the right thing

Here’s what one insider said happened in the days leading up to the layoffs.

Tesla’s profitable Supercharger network is in limbo after Musk axed the entire team

StrictlyVC events deliver exclusive insider content from the Silicon Valley & Global VC scene while creating meaningful connections over cocktails and canapés with leading investors, entrepreneurs and executives. And TechCrunch…

Meesho, a leading e-commerce startup in India, has secured $275 million in a new funding round.

Meesho, an Indian social commerce platform with 150M transacting users, raises $275M

Some Indian government websites have allowed scammers to plant advertisements capable of redirecting visitors to online betting platforms. TechCrunch discovered around four dozen “gov.in” website links associated with Indian states,…

Scammers found planting online betting ads on Indian government websites

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn

Garena is quietly developing new India-themed games even though Free Fire, its biggest title, has still not made a comeback to the country.

Garena is quietly making India-themed games even as Free Fire’s relaunch remains doubtful

The U.S.’ NHTSA has opened a fourth investigation into the Fisker Ocean SUV, spurred by multiple claims of “inadvertent Automatic Emergency Braking.”

Fisker Ocean faces fourth federal safety probe