Ireland is grappling with the rapid emergence of AI-generated deepfake imagery, particularly sexualized content created using X’s Grok AI tool, prompting legislative responses and heightened scrutiny of online safety practices. The issue has spurred debate around existing laws, the responsibilities of social media platforms and the protection of vulnerable individuals, especially children.
Online Safety Commissioner Niamh Hodnett expressed her dismay at the proliferation of AI-generated child sexual abuse material and nonconsensual intimate images. While acknowledging that X has taken some steps to address the problem, she stated her office is continuing to assess the platform’s safety measures. “We’re not saying it’s there yet but we’re assessing all of that,” Hodnett said.
The Irish government is actively engaging with the European Commission and law enforcement agencies to combat the spread of these images. Hodnett highlighted her office’s collaboration with the Gardaí (Irish police) and hotline.ie, a service that assists in removing harmful content online. Ireland is also supporting the European Commission’s investigation into X under the Digital Services Act, viewing it as a potential breach of regulations.
The controversy surrounding Grok has also reignited discussions about regulating access to social media for minors. Hodnett indicated that Ireland is studying restrictions implemented in Australia and consulting with European counterparts to determine the best approach. This follows the European Commission’s recent accusations against TikTok, alleging an “addictive design” that could harm the wellbeing of young people – an investigation Ireland is actively supporting.
Research from University College Dublin (UCD) reveals a concerning trend: young people, while distrustful of AI, are increasingly reliant on it and willing to trade privacy for its benefits. This acceptance, coupled with a lack of awareness regarding the potential for malicious use, underscores the need for enhanced digital literacy education.
Safer Internet Day 2026, observed today in Ireland and globally, focuses on the risks and opportunities presented by artificial intelligence to young people, with the theme “AI Aware: Safe, Smart and in Control.” Experts convened at the Department of Justice to discuss the impact of generative AI on youth, emphasizing the importance of critical thinking and digital literacy skills.
Minister for Education and Youth Hildegarde Naughton stressed the need to empower children and young people to evaluate AI-generated content, protect their privacy, and make responsible decisions. The event was hosted by the Irish Safer Internet Centre, a partnership between several organizations including Hotline, ISPCC, National Parents Council and Webwise.
Concerns extend beyond deepfakes to broader online safety issues. CyberSafeKids, an online safety charity, recently published research indicating that many children have no parental restrictions on their online interactions. The study also revealed a lack of parental confidence in managing their children’s online activities, with many children using platforms not designed for their age group and sharing images without understanding the potential consequences.
Alex Cooney, CEO of CyberSafeKids, warned that without clear guidance, children may overshare content that can be altered and misused, particularly with the emergence of “nudification” tools and AI girlfriend apps. She highlighted the prevalence of children having devices in their bedrooms overnight as a particularly problematic area, and noted that over 90% of eight- to twelve-year-olds are active online.
Legislatively, Sinn Féin is attempting to address a perceived gap in existing law. The party plans to introduce legislation this evening to amend Coco’s Law, which criminalizes the sharing of intimate images without consent. Currently, the law does not explicitly criminalize the creation of such images, particularly through AI tools like Grok. Sinn Féin TD Matt Carthy explained that the proposed amendment would explicitly make the generation of sexualized AI deepfakes a criminal act.
The proposed legislation also includes technical changes, such as extending the statute of limitations from two to five years and increasing penalties for violations. Sinn Féin TDs Matt Carthy and Máire Devine expressed optimism that the government would support the amendment, citing previous statements from government officials regarding the need to criminalize the creation of deepfakes. Devine stated that passing the amendment would demonstrate a “true commitment to Zero Tolerance for violence against women and children in Ireland.”
The situation highlights the challenges of regulating rapidly evolving technologies and the need for a multi-faceted approach involving legislation, platform accountability, education, and parental engagement. The Irish government’s response, alongside the European Commission’s broader efforts, will be closely watched as a potential model for addressing the risks posed by AI-generated content globally.
