More and more AI-powered mental health applications—from mood trackers to chatbots that simulate conversations with therapists—have become alternatives for mental health professionals to meet demand. These tools help a more affordable and easier way to get mental health. But experts urge caution when it comes to children.
Many of these AI applications target adults and are not regulated. However, discussions are focusing on whether it can also be used to support children's mental health. Dr. Bryanna Moore, assistant professor of health humanities and bioethics at the University of Rochester Medical Center, wants to make sure these discussions include ethical considerations.
“No one is talking about how children are different – how their ideas work, how they embed into family units, how decisions are different”
Moore said in recent comments Children's Magazine. “Children are particularly vulnerable. Their social, emotional and cognitive development is different from the stages of adults.”
There is growing concern that AI therapy chatbots may hinder children's social development. Research shows that children often see bots as having thoughts and feelings, which may lead to their attachment to chatbots rather than creating healthy relationships with real people.
Unlike human therapists, AI does not consider children's wider social environment (their family life, friendship or family dynamics) to be crucial to their mental health. Human therapists observe these conditions to assess the safety of the child and involve family members in the treatment. Chatbots can’t do this, meaning they may miss important warning signs or moments that their children may need urgent help.
