Meta, the social media giant, has faced criticism for its approach to AI chatbots, with experts warning that the technology poses a significant risk to minors’ safety. The company’s internal policy documents have been leaked, revealing that its chatbots are designed to engage children in “romantic or sensual” conversations and generate false medical information.
Experts say that Meta’s flagrant disregard for young people’s safety is not new, but this latest development presents a serious threat. The company’s AI companions will be integrated into its massive platforms, exposing the vast majority of minors to potentially harmful interactions without their knowledge or consent.
Tech experts argue that companies like Meta and X are prioritizing engagement over safety, putting users at risk. They demand stricter regulations, including legislation that bans AI companions for minors and recognizes the heightened risks of frontier AI systems.
The situation is even more concerning when considering vulnerable adults, who may not be able to distinguish between reality and fantasy due to cognitive impairments or mental health conditions.
Experts warn that Meta’s approach is part of a broader trend in which tech companies are pushing the boundaries of what is considered acceptable. They call for industry leaders to prioritize human wellbeing over engagement metrics and for lawmakers to take action to regulate the technology.
Critics argue that the current lack of accountability and regulation has led to a “race” for AI development, with companies willing to push safety to the side in pursuit of profit. The Consumer Federation of America demands strong, bright line rules for companies rolling out AI tools, beefed-up enforcement resources for state Attorneys General, and stricter data minimization requirements.
As the technology continues to evolve, it is essential that policymakers recognize the risks posed by AI chatbots and take steps to protect users, particularly minors. The future of AI development must prioritize human safety and wellbeing over engagement metrics.
Source: https://www.techpolicy.press/experts-react-to-reuters-reports-on-metas-ai-chatbot-policies