Europe acts against the threat of a social credit system with new AI rulebook

The European Parliament has voted in favour of document that it describes as the world’s first ever rules for artificial intelligence.

Scott Bicheno

May 12, 2023

2 Min Read
privacy

The European Parliament has voted in favour of document that it describes as the world’s first ever rules for artificial intelligence.

Running to well over 100 pages, the document itself is the usual legalese tome. Mercifully it is decoded and summarised in a press release, facilitating its further simplification here. The powers that be in the EU want to make sure ‘AI systems are overseen by people, are safe, transparent, traceable, non-discriminatory, and environmentally friendly.’ That’s a big ask.

Recent amendments to the rulebook seem to have focused on the non-discriminatory side of things, arguably the most important area as it concerns things like surveillance systems and pre-crime prevention. MEPs amended the document to explicitly ban the following, as listed in the release.

  • “Real-time” remote biometric identification systems in publicly accessible spaces;

  • “Post” remote biometric identification systems, with the only exception of law enforcement for the prosecution of serious crimes and only after judicial authorization;

  • Biometric categorisation systems using sensitive characteristics (e.g. gender, race, ethnicity, citizenship status, religion, political orientation);

  • Predictive policing systems (based on profiling, location or past criminal behaviour);

  • Emotion recognition systems in law enforcement, border management, workplace, and educational institutions; and

  • Indiscriminate scraping of biometric data from social media or CCTV footage to create facial recognition databases (violating human rights and right to privacy).

You don’t have to be the most paranoid, tinfoil hat-wearing kook to see how a failure to prevent the above would inevitably lead to the insidious introduction of a dystopian social credit system in which everyone is monitored constantly, with evidence against them constantly gathered and AI used to anticipate the possibility of them transgressing whichever arbitrary rules it’s programmed to enforce.

“Given the profound transformative impact AI will have on our societies and economies, the AI Act is very likely the most important piece of legislation in this mandate,” said MEP Dragoş Tudorache. “It’s the first piece of legislation of this kind worldwide, which means that the EU can lead the way in making AI human-centric, trustworthy and safe.

“We have worked to support AI innovation in Europe and to give start-ups, SMEs and industry space to grow and innovate, while protecting fundamental rights, strengthening democratic oversight and ensuring a mature system of AI governance and enforcement.”

Europe is hoping to lead the way on the incredibly difficult but vital topic of AI ethics with its AI Act. The combination of turbo-charged AI, ubiquitous surveillance, and the fact that we all carry a powerful tracking device with us at all times creates the potential for an unprecedented concentration of power over the population. The sooner the world agrees on robust guard-rails to benignly contain these technologies the better.

 

Get the latest news straight to your inbox. Register for the Telecoms.com newsletter here.

About the Author

Scott Bicheno

As the Editorial Director of Telecoms.com, Scott oversees all editorial activity on the site and also manages the Telecoms.com Intelligence arm, which focuses on analysis and bespoke content.
Scott has been covering the mobile phone and broader technology industries for over ten years. Prior to Telecoms.com Scott was the primary smartphone specialist at industry analyst Strategy Analytics’. Before that Scott was a technology journalist, covering the PC and telecoms sectors from a business perspective.
Follow him @scottbicheno

test new title

See more
Subscribe and receive the latest news from the industry.
Join 56,000+ members. Yes it's completely free.

You May Also Like