New Zealand's ChatGPT Innovation Tackles Violent Extremism

A new tool being developed in New Zealand aims to redirect ChatGPT users exhibiting violent extremist tendencies to human and chatbot-based deradicalization support. Initiated by ThroughLine, in collaboration with The Christchurch Call, the effort extends an existing network of crisis support to address online extremism.

In an innovative move, New Zealand is developing a tool to redirect ChatGPT users showing signs of violent extremist tendencies to appropriate deradicalization support, combining chatbot and human intervention, according to the developers behind the project.

This initiative comes amid mounting safety concerns and legal challenges against AI companies for allegedly enabling violence. OpenAI's ban on a user linked to a school shooting without notifying authorities highlighted the urgency for effective intervention tools.

ThroughLine, a startup offering a vast network of 1,600 helplines globally, is expanding its scope with a new anti-extremism initiative in partnership with The Christchurch Call. The project aims to offer real-time support and involves consultations with counterterrorism experts without relying on LLM base training data.

(With inputs from agencies.)