Artificially intelligent chatbots have gained popularity, but experts warn against relying on them for medical or mental health advice instead of consulting human healthcare providers. Recent cases have shown that chatbot advice can be misleading and even harmful.
The technology is tempting due to accessibility issues, such as cost, wait times, and lack of insurance coverage. However, experts say that chatbots are unable to offer personalized advice tailored to a patient’s specific needs and medical history. They are also prone to “hallucinations,” or giving outright incorrect information.
To understand the risks, consider how people use AI chatbots for medical and mental health advice. Over half of teens use these platforms multiple times each month, often for social interaction and role-playing. However, the business model prioritizes user engagement over trustworthy advice.
Experts warn that users risk exposing their personal health data online, and chatbots can boost false confidence while atrophy critical thinking skills. Moreover, users may turn to AI as a convenient alternative due to barriers in accessing human healthcare providers.
To safeguard against bad AI advice, families and caregivers should discuss the underlying technology and motivations for using these platforms. They can ask questions like “What would you do if a friend revealed they were using AI for mental health purposes?” and encourage loved ones to critically evaluate chatbot responses.
Regulatory rigor is essential to protect individuals from chatbot-generated harm. Policymakers are taking steps, such as banning the use of ChatGPT to generate mental health therapy or requiring medical professionals to inform patients when using AI. As experts say, “I do think you’ll see a future where you have mental health chatbots that are rooted in science and rigorously tested.”
Source: https://www.pbs.org/newshour/health/using-an-ai-chatbot-for-therapy-or-health-advice-experts-want-you-to-know-these-4-things