New Zealand Political Parties Tackle Surge of Sexual Deepfakes on X

Political parties in New Zealand are responding to the alarming rise of sexual deepfakes on X, the social media platform formerly known as Twitter. Recent reports indicate that the platform has seen a surge in AI-generated non-consensual sexual images, raising significant legal and ethical concerns. This troubling trend, particularly involving minors, has prompted calls for regulatory intervention from various quarters.

Internal Affairs Minister Brooke van Velden expressed her deep concern regarding the implications of AI-generated non-consensual imagery. In a statement to Newsroom, she emphasized, “AI-generated non-consensual deepfakes are degrading and deeply harmful. The creation of child sexual abuse material is abhorrent and harmful.” She noted that while New Zealand law prohibits the creation or distribution of such material, the proliferation of these images on X remains a pressing issue.

According to research, at the height of this disturbing trend last week, two non-consensual sexual images were generated every second on the platform. The Internet Watch Foundation reported that the platform’s generative AI model, named Grok, was being exploited to create nude images of minors aged 11 to 13, which were subsequently disseminated on the dark web. In response, X has disabled the functionality that generated images in public replies but continues to allow image generation in direct interactions with the Grok chatbot.

Political Reactions to Harmful Content

In light of the situation, various political parties have adopted divergent strategies. Te Pāti Māori, led by co-leader Debbie Ngarewa-Packer, has strongly condemned the platform for allowing the AI generation of non-consensual sexual images. Ngarewa-Packer stated that her party ceased using X in mid-2023, citing a deteriorating environment for constructive engagement, marked by rampant racism and misogyny. She asserted, “The fact that X is currently facilitating sexual exploitation on an extreme scale, and child pornography, is cause for all political parties and government agencies to ditch the platform.”

Conversely, the Labour Party has not taken a definitive stance on abandoning the platform. Spokesperson Reuben Davidson emphasized that the party has not posted on X since May 2023, choosing instead to engage through channels deemed safer for constructive dialogue. He remarked, “Most New Zealanders would agree that the creation and distribution of non-consensual or abusive AI-generated images is utterly unacceptable.” Davidson revealed that he had drafted a member’s bill aimed at regulating harmful online content, although it has yet to progress.

The Act Party has taken a more measured approach, acknowledging the harmful nature of deepfake abuse but asserting that such issues are not unique to X. Communications manager Louis Houlbrooke stated, “Deepfake abuse has become rife in recent months; its harm is very real, and the abuse is not limited to one platform.” Houlbrooke noted that the Act Party continues to utilize X for outreach, highlighting the importance of engaging with New Zealanders across various platforms.

Calls for Regulation and Accountability

As the discussion around harmful content continues, human rights group Rights Aotearoa has called for regulatory measures. They recently published an open letter addressed to Justice Minister Paul Goldsmith, urging the government to take action against the proliferation of sexual deepfakes. In contrast, the Free Speech Union has warned against intervention, advocating for the importance of free expression.

While some parties are opting to distance themselves from X, others remain engaged, albeit cautiously. The Green Party has not posted on X since November 2024, while both the National Party and New Zealand First have continued utilizing the platform, despite the ongoing concerns about harmful content.

In response to inquiries about the government’s ongoing use of X, Public Service Minister Judith Collins referred questions to Goldsmith’s office, which had not provided a statement by the time of publication. As New Zealand grapples with the implications of AI-generated content, the call for a comprehensive approach to regulation and accountability is likely to remain a focal point of political discourse.

The issue of sexual deepfakes on X illustrates the evolving challenges in the digital landscape and the urgent need for effective measures to protect individuals, especially vulnerable populations, from exploitation and harm.