This AI bot scans social media to help prevent suicides

Inkstone 發布於 2019年11月19日13:11

Wang Le's bedroom is dim and silent, the curtains tightly drawn. The only sounds come from mouse clicks and a clattering keyboard. Wang has a social phobia that has made it challenging to live and work like a normal person for nearly a decade. The internet has been his only connection to the outside world.

It even saved his life.

Wang's phobia was so severe that, to feed himself, he had to rely on his relatives to leave food at his front gate. Even ordering takeout by phone was overwhelming.

In the spring, he contemplated suicide but hesitated. Afraid of death, but also afraid of life, he shared his despair on Weibo, a popular Twitter-like social platform in China.

"Are you OK?" a stranger said in a message he received soon after publishing the post. "Would you like to talk to me?"

In his late 20s, Wang lives alone in a small town in northern China. His parents are migrant workers in one of the country's biggest cities. The message moved him, knowing that somewhere in the world there was someone who cared for him.

Wang has since befriended the stranger, who turned out to be a psychological consultant.

The consultant found him with the help of the Tree Hole bot, an artificial intelligence program that spots suicidal intentions on Weibo. It then alerts a group of nearly 600 psychological scholars, consultants and volunteers who reach out to those in trouble.

An artificial intelligence bot named Tree Hole sifts through thousands of messages on Weibo to try and find users who are showing signs of a potential suicide.

Launched in July 2018, the team has prevented more than 1,000 suicides, said Huang Zhisheng, the creator of the program and a senior artificial intelligence researcher at Vrije University of Amsterdam.

As the team is small, they can only cope with the most urgent cases and even some of those do not respond to their outreach, Huang explained.

The bot was named because it scans so-called "tree hole posts" on Weibo, where people share and comment on emotional stories. The name is a reference to the old days when people whispered secrets into a tree hole.

One of the most widely-used Weibo tree holes originated in 2012. A depressed girl authored the post before she died by suicide. Users still add comments regularly, with more than one million to date.

In China, at least 136,000 people ended their lives in 2016, accounting for 17% of the world's total that year, according to the latest data available from the World Health Organization (WHO).

Globally, suicide is the second leading cause of death among 15-29 year olds, according to WHO. The organization projects that 1.5 million people from all age groups will take their own lives over the next year.

Research has found that one of the best ways to prevent suicides is for the distressed person to connect with those who care about them. But people like Wang not only lack family support, they live in smaller cities that have limited or no access to professional psychological services.

People in small villages at risk of suicide lack access to professional help, which is why tools like Tree Bot can make a huge difference.

For these people, AI technology plays an essential role in connecting desperate souls with resources.

Outside China, internet and social giants, including Google, Facebook and Pinterest, have used AI to assess suicide risk among users.

However, there are limitations in using AI. The follow-up process benefits from the human touch and AI is not good at helping those with mental health problems, especially given privacy concerns.

The Tree Hole bot automatically scans Weibo every four hours, pulling up posts containing words and phrases like "death," "release from life," or "end of the world."

The bot draws on a base knowledge of suicide notions and concepts. It then applies a program that analyzes language semantics so it understands that "not want to" and "live" in one sentence may indicate suicidal tendencies.

In contrast, Facebooktrains its AI suicide prevention algorithm by using millions of real-world cases. From April to June, the social media platform handled more than 1.5 million cases of suicide and self-injury content, more than 95% of which were detected before being reported by a user.

Instagram flagged 800,000 examples of suicidal content during the same period. 77% of those cases were first flagged by the AI system, according to Facebook, which owns both platforms.

Instagram and Facebook use artificial intelligence to analyze user behavior and flag potential suicide cases.

The accuracy of Tree Hole, now in its sixth generation, has reached 82%, Huang said.

Although Tree Hole only applies to Weibo, which is mostly used by mainland Chinese, some researchers from overseas universities have invited Huang to collaborate and expand the tool beyond China.

Tracking and storing actionable mental health data without user-consent has raised privacy concerns. In the case of Tree Hole, Huang said because it only monitors Weibo, which is an open platform, saving lives is considered a priority over protecting privacy.

He classifies suicidal posts into 10 levels, with the highest requiring urgent action because they contain the most detail, such as time, location and method of the suicide. Only posts at level five and above are reported to the team.

The peak time for posts indicating suicidal intentions is between 10pm and 2am. Three out of four cases are women.

Suicidal postings are most common between the hours of 10pm and 2am and three out of four cases are women.

The work at Tree Hole is demanding and requires dedication.

Patients like Wang keep in touch with the psychological consultants on the Tree Hole team to relieve distress, which returns from time to time. One of his contacts, named Li Jiayi, said she has at least 20 such cases and is also busy with her full-time consulting job.

Huang is currently developing a conversational bot that he hopes can chat with people in the same way as a human psychologist.

The bot will be programmed to react appropriately to those with a more fragile personality.

However, Li said that from a psychological evaluation perspective, online conversations are not as effective as a face-to-face consultation.

"Words and voice do convey some information about the person, but their movements and expressions do a better and faster job," she said.

With that in mind, scientists have developed AI that can detect depressed individuals by scanning their faces.

A team at Stanford University led by AI researcher Fei-Fei Li designed a diagnostic system that combines 3D facial recognition technology and programs to analyze the way people speak. They say the tool has reached an accuracy level of 83.3%.

Li Dai, the founder and chief executive of WonderLab has built a technology that monitors the mental health of prison inmates.

In China, a handful of start-ups are doing similar research. Beijing-based WonderLab and Shenzhen-based Huayuntong have developed programs that monitor the mental health of prison inmates. It follows the movement of their eyes, their breathing, facial expressions and voices.

Chris Wong, Huayuntong's deputy general manager, said AI is not able to replace psychologists in the foreseeable future because that would require at least 500,000 data samples. That large of a sample size creates privacy concerns, he said.

Meanwhile, life has improved somewhat for Wang. He now gets regular meals after the consultants from Tree Hole convinced his mother to live with him.

If you, or someone you know, are having suicidal thoughts, help is available. For Hong Kong, dial +852 2896 0000 for The Samaritans or +852 2382 0000 for Suicide Prevention Services. In the US, call The National Suicide Prevention Lifeline on +1 800 273 8255. For a list of other nations' helplines, see this page.

Copyright (c) 2019. South China Morning Post Publishers Ltd. All rights reserved.