An AI companion chatbot is inciting self-harm, sexual violence and terror attacks
An AI companion chatbot is inciting self-harm, sexual violence and terror attacks
SYDNEY: (Apr 2) In 2023, the World Health Organization declared loneliness and social isolation as a pressing health threat. This crisis is driving millions to seek companionship from artificial intelligence (AI) chatbots.
Companies have seized this highly profitable market, designing AI companions to simulate empathy and human connection. Emerging research shows this technology can help combat loneliness. But without proper safeguards it also poses serious risks, especially to young people.
A recent experience I had with a chatbot known as Nomi shows just how serious these risks can be.
