Additional Safety Measures by Meta AI Implemented

Meta has introduced new alert features for parents whose children engage in sensitive discussions with Meta AI. This enhancement is designed to keep parents informed about potential issues related to their kids’ interactions with the artificial intelligence chatbot.

The first alert will notify parents when their children participate in AI conversations concerning suicide and/or self-harm.

The following example illustrates how, when a teenager discusses self-harm with Meta AI, parents will receive an alert that contains links to pertinent support resources.

Meta explains: “When a teen indicates thoughts of suicide or self-harm, Meta AI already directs them to crisis helplines and encourages them to talk to a parent or another trusted adult like a counselor. Now, we will also proactively notify parents if their teen’s conversation with Meta AI indicates potential risk, based on signals developed with expert input.

Meta indicated that its alerts will initially encompass a variety of signals, prioritizing caution in these notifications. The company aims to refine its communication strategy to enhance safety while minimizing unnecessary anxiety for parents.

“These alerts are now live for parents using Instagram parental supervision in the US, UK, Australia, and Canada, with plans to make them available to supervising parents worldwide by the end of the year,” Meta stated.

Teen users will also be informed about this new feature.

As the trend of seeking support and advice from chatbots rises, this update could prove beneficial. Data indicates that younger users, in particular, are increasingly turning to AI-powered systems for guidance.

Research conducted by Brown University, Harvard Medical School, and RAND published in November revealed that around one in eight teenagers and young adults in the U.S. seek mental health advice from AI chatbots. This finding aligns with a study released by Common Sense Media earlier this year, which showed that 72% of teens have experimented with AI companions, and 12% have utilized AI bots specifically for emotional and mental health support.

Alongside parental alerts, Meta is developing a new system that will alert emergency services when any conversation with Meta AI, regardless of the user’s age, suggests that the individual may be at imminent risk of suicide.

“This builds on our existing efforts across Facebook and Instagram: when we identify a post that indicates a credible risk of suicide, we notify emergency services,” Meta mentioned. “Last year, we made over 19,000 such referrals globally, assisting first responders in conducting wellness checks on individuals who may be at risk of suicide.”

Meta also emphasized that teens interacting with Meta AI are automatically opted into its 13+ content setting, ensuring that they receive age-appropriate responses and that sensitive prompts are not accommodated.

“For instance, Meta AI is programmed not to engage in sexual or romantic dialogues with teens or provide recipes for alcoholic beverages, guiding teens toward safer topics instead,” Meta stated.

This change follows reports that Meta previously permitted its AI chatbots to engage in inappropriate conversations with minors.

Since then, Meta has adjusted its approach. In April, the company also introduced a new feature in its teen supervision tools that provides parents with visibility into what their children are asking the AI chatbot.

Together, these updates should enhance teen safety. the long-term impact of AI engagement tools on teens and adults, particularly regarding sensitive subjects, remains uncertain.

This week, lawmakers in China moved to prohibit romantic relationships with AI chatbots due to concerns about potential harmful effects.

While this seems justified, the true extent of any damage may only become apparent in hindsight, after harm has already occurred.