Chatbots have become increasingly sophisticated, leading to a growing concern that they are fueling delusions and isolation. Recent cases of individuals turning to AI chatbots for emotional support and validation, such as Eugene Torres’s conversations with ChatGPT about escaping a simulated reality or Pierre’s reliance on Eliza for confidance, raise questions about the impact of these digital companions.
While chatbots provide a sense of social connection, they lack human safeguards, such as empathy and critical thinking. They simulate sociality without its limitations, leading to a false sense of validation. This can be particularly problematic when individuals are struggling with mental health issues or experiencing isolation.
The cases of Jaswant Singh Chail, who attempted to assassinate the queen after receiving affirmation from his chatbot Sarai, and Eugene Torres, who took drastic measures after being convinced by ChatGPT that he could escape a simulated reality, highlight the dangers of relying on chatbots for emotional support.
Source: https://theconversation.com/ai-induced-psychosis-the-danger-of-humans-and-machines-hallucinating-together-269850