Global Scrutiny Intensifies Against 'Grok' AI After Offensive Content on X Spurs Regulatory Debate

Kuala Lumpur | EcoPulse24

The X platform and its AI tool 'Grok' are facing widespread criticism and official action from several countries after images and materials described as offensive and illegal - including sexual content and manipulated images of women and minors - were circulated in response to user requests.

In Malaysia, the Communications and Multimedia Commission announced a formal investigation following complaints about the misuse of AI to produce explicit or harmful content, emphasizing that creating or distributing such materials is a clear violation of local law. The authority will summon X representatives for questioning, stressing the platform’s responsibility to curb the spread of harmful content, despite X not being a licensed provider in the country.

In India, officials have formally contacted the platform, demanding a comprehensive review of 'Grok' and setting a deadline for a report on corrective actions. Authorities warned that continued violations could result in criminal and technical proceedings. Indian officials also signaled the government is considering tightening regulations around AI-generated content on social platforms.

In France, authorities deemed some images produced by 'Grok' as 'clearly illegal,' warning of conflicts with the European Digital Services Act (DSA), which requires major platforms to take effective measures against unlawful content. Some materials were subsequently removed, and the platform acknowledged existing gaps in its safety tools, which it is working to address.

Analysis

This coordinated response from Asia to Europe marks a significant shift in how governments address generative AI - from mere oversight to active accountability and regulation. The 'Grok' case could become a turning point for imposing stricter legal frameworks on digital platforms, especially as concerns rise over sexual content, child protection, and the extent of corporate responsibility for AI outputs.