Artificial intelligence (AI) chatbots are being used in US classrooms, but some companies are now selling software that can flag mentions of self-harm. This has raised concerns about student privacy and control.
Tech firms like GoGuardian and Lightspeed Systems are providing real-time monitoring tools to track students’ conversations with AI chatbots. The aim is to catch early warning signs of potential problems, including teen suicides.
Source: https://www.bloomberg.com/news/articles/2025-11-07/ai-chatbot-surveillance-tools-are-quietly-watching-kids-in-class