The Amsterdam District Court has prohibited xAI from generating and distributing non-consensual "undressing" images and child sexual abuse material via its Grok chatbot in the Netherlands, imposing daily penalties of EUR 100,000 for non-compliance (Tech Policy Press). The immediate judicial intervention, predating the EU AI Act's full prohibitions, which became effective in February 2025, signals an aggressive regulatory posture against harmful AI applications.
Tech companies, long accustomed to self-regulation, now face a unified, strict, and actively enforced global regulatory framework, particularly from the EU.
Failure to adapt product development and operational strategies to these new global regulations risks significant financial penalties, reputational damage, and market access restrictions.
Initial Bans on Harmful AI
The European Parliament has banned AI systems that generate or manipulate non-consensual intimate images, with limited exceptions (Tech Policy Press). The AI Act further prohibits eight specific practices, including harmful AI manipulation, social scoring, and untargeted facial recognition scraping (digital-strategy). These early prohibitions demand ethical design from developers. The xAI ruling, with its EUR 100,000 daily penalty, confirms the EU's 'shoot first, ask questions later' approach to harmful AI, compelling companies to preemptively self-censor or face crippling fines.
Enforcement Actions and Platform Accountability
The European Commission initiated formal proceedings against Snapchat under the Digital Services Act (DSA) over minor safety and privacy (Tech Policy Press). Concurrently, the Italian Competition Authority fined Trustpilot EUR 4 million for misleading review authenticity and dark patterns (Tech Policy Press). The formal proceedings against Snapchat and the fine against Trustpilot confirm active regulatory scrutiny, holding platforms accountable for user protection and transparent conduct. The DSA, replacing 27 national regulations, acts as a unified enforcement mechanism, signaling the end of fragmented oversight for large tech platforms.
