Preston et al_data for evaluating innovation_AAM.pdf (289.77 kB)
Considerations in the use of local and national data for evaluating innovation in children’s social care
journal contribution
posted on 2023-06-09, 23:43 authored by Oli Preston, Rebecca Godar, Michelle LefevreMichelle Lefevre, Janet BoddyJanet Boddy, Carlene FirminPurpose This paper aims to explore the possibilities in using such national, statutory data sets for evaluating change and the challenges of understanding service patterns and outcomes in complex cases when only a limited view can be gained using existing data. The discussion also explores how methodologies can adapt to an evaluation in these circumstances. Design/methodology/approach This paper examines the use of data routinely collected by local authorities (LAs) as part of the evaluation of innovation. Issues entailed are discussed and illustrated through two case studies of evaluations conducted by the research team within the context of children’s social care in England. Findings The quantitative analysis of LA data can play an important role in evaluating innovation but researchers will need to address challenges related to: selection of a suitable methodology; identifying appropriate comparator data; accessing data and assessing its quality; and sustaining and increasing the value of analytic work beyond the end of the research. Examples are provided of how the two case studies experienced and addressed these challenges. Research limitations/implications • Quasi-experimental methods can be beneficial tools for understanding the impact of innovation in children’s services, but researchers should also consider the complexity of children’s social care and the use of mixed and appropriate methods. • Those funding innovative practice should consider the additional burden on those working with data and the related data infrastructure if wishing to document and analyse innovation in a robust way. • Data, which may be assumed to be uniform may in fact not be when considered at a multi-area or national level, and further study of the data recording practice of social care professionals is required. Originality/value The paper discusses some common issues experienced in quasi-experimental approaches to the quantitative evaluation of children’s services, which have, until recently, been rarely used in the sector. There are important considerations, which are of relevance to researchers, service leads in children’s social care, data and performance leads and funders of innovation.
History
Publication status
- Published
File Version
- Accepted version
Journal
Journal of Children's ServicesISSN
1746-6660Publisher
EmeraldPublisher URL
External DOI
Issue
3Volume
16Page range
233-248Department affiliated with
- Social Work and Social Care Publications
Full text available
- Yes
Peer reviewed?
- Yes
Legacy Posted Date
2021-04-27First Open Access (FOA) Date
2021-06-22First Compliant Deposit (FCD) Date
2021-04-26Usage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC