Preliminary evaluation of the engagement and effectiveness of a mental health chatbot

Daley, Kate, Hungerbuehler, Ines, Cavanagh, Kate, Garcia Claro, Heloisa Garcia, Swinton, Paul Alan and Kapps, Michael (2020) Preliminary evaluation of the engagement and effectiveness of a mental health chatbot. Frontiers in Digital Health, 2. a576361 1-7. ISSN 2673-253X

[img] PDF - Accepted Version
Available under License Creative Commons Attribution.

Download (431kB)
[img] PDF - Published Version
Available under License Creative Commons Attribution.

Download (340kB)

Abstract

Background: Mental health difficulties are highly prevalent, yet access to support is limited by barriers of stigma, cost, and availability. These issues are even more prevalent in low- and middle-income countries, and digital technology is one potential way to overcome these barriers. Digital mental health interventions are effective but often struggle with low engagement rates, particularly in the absence of human support. Chatbots could offer a scalable solution, simulating human support at a lower cost.

Objective: To complete a preliminary evaluation of engagement and effectiveness of Vitalk, a mental health chatbot, at reducing anxiety, depression and stress.

Methods: Real world data was analyzed from 3,629 Vitalk users who had completed the first phase of a Vitalk program (“less anxiety,” “less stress” or “better mood”). Programs were delivered through written conversation with a chatbot. Engagement was calculated from the number of responses sent to the chatbot divided by days in the program.

Results: Users sent an average of 8.17 responses per day. For all three programs, target outcome scores reduced between baseline and follow up with large effect sizes for anxiety (Cohen's d = −0.85), depression (Cohen's d = −0.91) and stress (Cohen's d = −0.81). Increased engagement resulted in improved post-intervention values for anxiety and depression.

Conclusion: This study highlights a chatbot's potential to reduce mental health symptoms in the general population within Brazil. While findings show promise, further research is required.

Item Type: Article
Schools and Departments: School of Psychology > Psychology
SWORD Depositor: Mx Elements Account
Depositing User: Mx Elements Account
Date Deposited: 19 Nov 2020 10:42
Last Modified: 11 Jan 2021 15:00
URI: http://sro.sussex.ac.uk/id/eprint/95158

View download statistics for this item

📧 Request an update