Meta will warn parents if their teens discuss suicide

Post Reply New Topic

There is a global focus on the impact of both social media and AI on younger users. With Meta AI blending both of these elements, there are concerns about how the tools could be used.

In response to this, Meta has announced that it will send warnings to parents if it detects their teenagers discussing suicide or self-harm with Meta AI. Going beyond this, there are further plans to have first responders intervene if it is thought that an individual is at immediate risk.

The plan is to have these warnings available globally, but for now they are limited to parents using Instagram parental supervision in the US, UK, Australia and Canada, and will be available for supervising parents globally by the end of the year.

Announcing the plans, Meta says:

When a teen suggests they may be thinking about suicide or self-harm, Meta AI already directs them to crisis helplines and encourages them to reach out to a parent or another trusted adult like a counselor. Now, we’ll also proactively alert supervising parents if their teen’s Meta AI chat suggests they may be at risk, based on signals developed with experts. We’ll share expert resources to help parents approach these conversations with their teens.

We worked with parents and experts to understand which AI conversations warrant an alert — such as those where a teen makes a clear reference to hurting themselves, even if that reference is subtle. We then built a dedicated AI system to identify these conversations.

The social media giant acknowledges that it is dealing with sensitive and potentially disturbing information here. It adds:

We understand how distressing these alerts may be for a parent to receive. That’s why, as we continue to improve our detection, all chats flagged by our AI will be manually reviewed before an alert is sent. If a teen’s intent is ambiguous, we’ll err on the side of caution and alert the parent. While that means we may sometimes notify parents when there may not be real cause for concern, we feel this is the right starting point, and we’ll continue to monitor to help make sure we’re in the right place.