Technology

IIE DIGITAL: As artificial intelligence becomes a bigger part of daily life, AI chatbots are increasingly being used as digital companions where people share personal thoughts, emotions and struggles. But concerns are rising over situations where users, especially teenagers, may discuss self harm or suicidal feelings with these platforms.

In response, Meta is working on a new safety feature that could inform parents if their teenage children show signs of serious emotional distress while interacting with Meta AI on platforms like Instagram and other services.

The feature, which is currently under development, aims to detect conversations linked to potential self harm risks. Meta has clarified that the AI system will not independently decide whether a user is in danger. Instead, conversations flagged by the system will first undergo human review before any alert is sent to parents.

The company said the system will follow a precautionary approach. Even when a conversation does not directly mention suicide but contains warning signs or unclear intentions, it may still be treated as a possible risk situation.

The new safety tool will initially be tested in selected regions before being expanded to more countries. Meta is also working on a broader emergency response system that could involve local emergency services in cases where a user appears to be facing an immediate threat.

If an AI interaction suggests that someone, whether a teenager or an adult, may be at urgent risk, the system could help connect them with emergency support.

The move highlights the growing challenge for technology companies: balancing privacy with safety as AI becomes a place where people increasingly turn to express their deepest concerns and emotions.