Europe To Force IMessage, WhatsApp To Implement Child Abuse Content Scan

European Union rolls out bill to remove child abuse content online. (photo: doc. Unsplash)

JAKARTA - The European Union (EU) recently launched a proposal for a new bill that would make it difficult for messaging app companies to more aggressively screen and remove child abuse content online.

The bill would allow EU countries to have courts order companies such as Meta and Apple to implement systems that can detect child sexual abuse content on their platforms.

That means messaging apps like WhatsApp, iMessage, and Messenger will have systems to detect child sexual abuse material.

The regulations will not only scan existing child abuse material, but also scan new child sexual abuse material or treatment, thereby giving authorities oversight powers to scan conversations taking place on some of the world's most popular messaging apps, if they receive a detectable order. will use artificial intelligence to scan images and text messages.

"Detection orders are time-restricted, targeting certain types of content on certain services," the European Commission said, adding that the orders would be issued by independent national courts or authorities.

“Detection technology should only be used for the purpose of detecting child sexual abuse. Providers must implement technologies that are least intrusive to privacy according to the state of the art in the industry, and that limit false-positive rates to the maximum extent possible."

The law also requires messaging app companies to ensure children can't download content that could put them at high risk for sexually suggestive solicitations.

Many governments, including the UK, US and across Europe have sought to erode user privacy by asking tech giants to place backdoors in end-to-end encrypted chats, a move that would essentially make them more secure. vulnerable to criminals.

"It is very disappointing to see EU regulations proposed on the internet fail to protect end-to-end encryption. If the EU mandates a scanning system like this one built for one purpose in the EU, it will be used to undermine human rights in various ways globally," Chief of WhatsApp said. , Will Cathcart.

"Legislators need to work with experts who understand internet security so they don't put everyone at risk, and focus on ways we can protect children while promoting privacy on the internet."

Incredibly disappointing to see a proposed EU regulation on the internet fail to protect end-to-end encryption. https://t.co/1W1HixQUVJ

— Will Cathcart (@wcathcart) May 11, 2022

Apple has previously tried to introduce an anti-child abuse feature that uses similar technology. The tool will detect when children are sent inappropriate photos, and when people have child sexual abuse material on their devices.

However, critics argue that the tool could be used to scan other types of material and undermine Apple's public commitment to privacy as a human right. In September last year, Apple said that it would delay those features indefinitely until they were fixed.