Spain to Use AI Algorithm for Hate Crime Detection

A proposal in Spain suggests using an algorithm to prioritize hate crime cases, raising technical and legal concerns.

English · Original discussion in Spanish · Published

Spain to Use AI Algorithm for Hate Crime Detection
Spain Prioritizes Hate Crimes With Algorithm That Reads Every Message

According to calculations circulating in the debate, a judge takes more than three years to advance a incivil procedure. Under the proposed system, an algorithm would take milliseconds to decide if what you just wrote constitutes a hate crime. Presented in the forum as a tool for a "fairer world," the idea is for Spain to give priority to the legal prosecution of these crimes and use an automated system to classify every message published on social media and platforms to detect potential offenses. The circulating text does not detail who trains the system, with what corpus, or under what judicial supervision, but it clearly states the objective: classification must arrive before the complaint.

What Exactly Is Proposed

The approach is twofold. On one hand, giving procedural priority to hate crimes within the overall judicial workload. On the other, automating the preliminary classification of messages so the system flags those that could be crimes. The combination of both is what has sparked controversy: it is not just about prosecuting more, but prosecuting with a machine that reads before a judge does.

The most repeated criticism does not dispute the existence of hate crimes, but rather the technical capacity to detect them. A system trained on standard language does not distinguish figurative meaning, irony, slang, or cultural references. The practical consequence would be a trickle of false positives ending up in courts, which are already saturated, and prior self-censorship among writers.

The Language Problem: What an Algorithm Does Not Understand

A message can be formally aggressive without constituting a crime, and formally neutral while still being one. Automatic classification works on surface patterns: words, constructions, repetitions. Context, sender, recipient, and intent remain outside the model unless specifically trained for each linguistic community.

Some argue that the system will only work if trained with the specific slang of each platform, and even then, it will fail in edge cases. Opponents counter that the current alternative, manual complaints, also fails to distinguish well and depends on the workload of the duty court. According to this reading, the result would not be more justice, but more procedural noise.

Who Drives These Measures and Why No One Votes on Them

Part of the analysis points out that such initiatives do not appear in electoral programs yet receive support from all groups when it comes time to vote. The suspicion, expressed without proof, targets lobbies that prepare texts and deliver them pre-chewed to governments and the European Union. This is a hypothesis circulating strongly that should be treated as such.

The counterargument is more prosaic. Many of these measures are not voted on because they are not laws, but technical developments, regulations, or internal protocols that do not pass through Parliament. This explains why no one defends them during campaigns and why they appear later, without public debate.

The Precedent No One Wants to Repeat

The most serious legal objection is not technical, but regarding guarantees. If the algorithm classifies before a judge intervenes, who is responsible for errors? Can an automatic classification be appealed? How much time passes between the system's flag and the judicial resolution? Without answers, the scenario drawn is one where a machine points and administration takes years to correct.

Comparisons with systems in other countries appear in the conversation: preventive detention without time limits and trials arriving a decade later. It is not an exact equivalence, but the parallelism underscores the same risk: that classification becomes a de facto conviction before a sentence exists.

The Effect on Writers

The measurable impact will not be the number of convictions, but the number of messages not written. Literature on content moderation indicates that the perception of surveillance reduces expression before the norm is applied. This is the invisible cost: it does not appear in any judicial statistics because it consists exactly of what never gets published.

With these elements, the most likely short-term result is not a trickle of convictions, but an increase in diffuse litigation and public discussion on who trains the algorithm and with what criteria. The unsettling data point is not how many crimes it will detect, but how many messages will cease to exist before the system has to classify them.

Also available in: Deutsch

Summary of a discussion on Burbuja.info - Foro de economía, actualidad y política., translated from Spanish and reviewed before publication. Read the full discussion (147 replies).

More summaries

All summaries in English →

-
Back