University of Sussex
Browse
Nahar_2020_Health Services and Delivery Research.pdf (26.15 MB)

Digital methods to enhance the usefulness of patient experience data in services for long-term conditions: the DEPEND mixed-methods study

Download (26.15 MB)
journal contribution
posted on 2023-06-10, 06:07 authored by Caroline Sanders, Papreen NaharPapreen Nahar, Nicola Small, Damian Hodgson, Bie Nio Ong, Azad Dehghan, Charlotte A Sharp, William G Dixon, Shôn Lewis, Evangelos Kontopantelis, Gavin Daker-White, Peter Bower, Linda Davies, Humayun Kayesh, Rebecca Spencer, Aneela McAvoy, Ruth Boaden, Karina Lovell, John Ainsworth, Magdalena Nowakowska, Andrew Shepherd, Patrick Cahoon, Richard Hopkins, Dawn Allen, Annmarie Lewis, Goran Nenadic
Abstract Background Collecting NHS patient experience data is critical to ensure the delivery of high-quality services. Data are obtained from multiple sources, including service-specific surveys and widely used generic surveys. There are concerns about the timeliness of feedback, that some groups of patients and carers do not give feedback and that free-text feedback may be useful but is difficult to analyse. Objective To understand how to improve the collection and usefulness of patient experience data in services for people with long-term conditions using digital data capture and improved analysis of comments. Design The DEPEND study is a mixed-methods study with four parts: qualitative research to explore the perspectives of patients, carers and staff; use of computer science text-analytics methods to analyse comments; co-design of new tools to improve data collection and usefulness; and implementation and process evaluation to assess use of the tools and any impacts. Setting Services for people with severe mental illness and musculoskeletal conditions at four sites as exemplars to reflect both mental health and physical long-terms conditions: an acute trust (site A), a mental health trust (site B) and two general practices (sites C1 and C2). Participants A total of 100 staff members with diverse roles in patient experience management, clinical practice and information technology; 59 patients and 21 carers participated in the qualitative research components. Interventions The tools comprised a digital survey completed using a tablet device (kiosk) or a pen and paper/online version; guidance and information for patients, carers and staff; text-mining programs; reporting templates; and a process for eliciting and recording verbal feedback in community mental health services. Results We found a lack of understanding and experience of the process of giving feedback. People wanted more meaningful and informal feedback to suit local contexts. Text mining enabled systematic analysis, although challenges remained, and qualitative analysis provided additional insights. All sites managed to collect feedback digitally; however, there was a perceived need for additional resources, and engagement varied. Observation indicated that patients were apprehensive about using kiosks but often would participate with support. The process for collecting and recording verbal feedback in mental health services made sense to participants, but was not successfully adopted, with staff workload and technical problems often highlighted as barriers. Staff thought that new methods were insightful, but observation did not reveal changes in services during the testing period. Conclusions The use of digital methods can produce some improvements in the collection and usefulness of feedback. Context and flexibility are important, and digital methods need to be complemented with alternative methods. Text mining can provide useful analysis for reporting on large data sets within large organisations, but qualitative analysis may be more useful for small data sets and in small organisations. Limitations New practices need time and support to be adopted and this study had limited resources and a limited testing time. Future work Further research is needed to improve text-analysis methods for routine use in services and to evaluate the impact of methods (digital and non-digital) on service improvement in varied contexts and among diverse patients and carers.

History

Publication status

  • Published

File Version

  • Published version

Journal

Health and Social Care Delivery Research

ISSN

2050-4349

Publisher

National Institute for Health Research

Issue

28

Volume

8

Page range

1-128

Department affiliated with

  • Global Health and Infection Publications

Full text available

  • Yes

Peer reviewed?

  • Yes

Legacy Posted Date

2023-02-01

First Open Access (FOA) Date

2023-02-01

First Compliant Deposit (FCD) Date

2023-01-31