ALMPs for young people in high-income countries: an implementation and process review
Research report detailing the methodology and insights from an IPE of employment services
Youth Futures Foundation commissioned the Centre for Evidence and Implementation and the Institute for Employment Studies to conduct a review of implementation and process evidence for active labour market programmes (ALMPs) that include employment services.
The aim was to:
The current review sits alongside a separate component network meta-analysis.
The insights may help to refine understanding of the contextual factors that affect the likelihood of the impact outcomes of the components observed in the CNMA.
The review findings inform information included in the Youth Employment Toolkit.
Search and screening methods
To build on the findings from the concurrent CNMA, the current focused on interventions included in the CNMA and reviewed both impact evaluation studies that included implementation evidence, as well as stand-alone implementation and process evaluations (IPEs).
The search strategy included pearling papers of employment services programmes in the CNMA for IPE references as well as using Google Scholar and Youth Futures Foundations’ Evidence and Gap Map (EGM; Apuyno et al., 2024) to search for any independent IPEs of the employment services programmes included in the CNMA. Screening for the current review included two stages: title and abstract screening and a full-text review.
Selection criteria
Papers for the current review included the IPEs of employment services components of ALMPs identified from included studies in the CNMA review, as this category of programme components was extensively referenced in the papers included in the CNMA and had not been covered in the first iteration of the toolkit. For the IPE review, papers were considered for inclusion if they met the following criteria:
Included employment services components (job search preparation, job search assistance, employment counselling, employment coaching or financial assistance) of ALMPs identified from included studies in the CNMA review
Addressed, even partially, at least two of the five research questions of the current review or provided considerable depth for one of the research questions.
Data extraction
In addition to relevant study and component details transposed across from the CNMA data extraction sheet, the Consolidated Framework for Implementation Research (CFIR; Damschroder et al., 2022) and Proctor et al. (2011) frameworks were used to extract evidence on implementation barriers and facilitators. These included the implementation process, individuals involved, delivery context, wider context, acceptability, adoption/uptake, appropriateness, feasibility, fidelity, implementation cost, reach/penetration and sustainability.
Data was extracted from a total of 20 papers.
These papers covered ALMPs in the UK, USA and Australia.
They included following nine interventions:
Here we present an overview of key findings. For detailed analysis and discussion view the full report.
Programme outcomes were shaped by external partnerships, with employer and community relationships being key drivers of holistic support offers.
Programmes tended to face staff recruitment and retention challenges.
Overall, implementation and process findings were reported across employment services as a whole, with limited evidence aligning to job search preparation, job search assistance, employment counselling, employment coaching and financial assistance in isolation.
Whilst the utilisation of intensive, personalised support across programmes tended to improve participant job readiness and ability to maintain sustained employment (especially for under-served young people), it also inherently created difficulties in disentangling individual employment services components.
Often, programme designs included personalised support within a holistic approach to help individuals enter the labour market, which presents difficulties for pinpointing specific programme components.