Study protocol v0.1 ยท 26 October 2026

Study protocol and methodological rationale

The Graduate Success Benchmark is a mixed-methods instrument-development study, to be followed by multi-cohort observational research. Its initial scope is therapeutic and practitioner-training programmes in the United Kingdom. The protocol is in draft for pilot development.

Primary aims

  • Develop and evaluate an understandable, feasible and content-valid self-report index of institutional practices that support graduates moving into professional practice.
  • Describe incoming students' expectations about self-employment, time to intended income, anticipated client numbers and perceived development needs.
  • Describe graduates' career activities, engagement with business learning, income progress and satisfaction, including those who never establish a practice.
  • Explore whether reported institutional approaches are associated with graduate experiences and outcomes, without making unwarranted causal claims.

Pre-specified exploratory propositions

  • Incoming students' anticipated time to intended practice income will differ from that reported by graduates with comparable intentions.
  • The perceived relevance of business topics, and readiness to apply them, will vary across pre-training, training, transition and post-qualification stages.
  • Clear and accessible post-qualification support pathways will be associated with greater engagement with, and application of, business learning than passive signposting alone.
  • Higher index scores may be associated with more favourable aggregate graduate outcomes.
  • Findings will differ by modality, course length, prior business experience and intended work pattern.

These are observational hypotheses. No causal efficacy claims will be made from the benchmarking cohort alone.

Design

  • Stage A, instrument development: literature mapping, cognitive interviews with providers and learners, revision and a small operational pilot.
  • Stage B, descriptive benchmarking: voluntary cross-sectional provider assessments with ongoing student and graduate surveys.
  • Stage C, longitudinal extension: repeat surveys, optional consented response linkage and adjusted comparisons across programmes and cohorts.

Evidence base

The benchmark is grounded in established research on how training is applied in practice, how small and solo businesses use external support, and how graduate outcomes are measured in the United Kingdom. Where evidence comes from adjacent fields rather than from practitioner graduates directly, this is stated, and the relevance of each source is weighed accordingly.

The transition from qualification to practice

Qualification demonstrates attainment of professional competence; it does not in itself establish that a graduate can attract an appropriate client base, manage practice finances or reach an intended income. The UK Longitudinal Small Business Survey 2025 reported that 22% of businesses with no employees sought external business information or advice in the preceding twelve months, compared with 28% of small and medium-sized employer businesses [1]. These are all-sector figures, but they show the policy relevance of business support for solo practitioners.

A re-assessment of experimental evaluations of small-business training found average improvements in profits and sales of approximately 5 to 10%, alongside substantial variation in effect and delivery [2]. This indicates that business learning can make a measurable difference, while cautioning against assuming a fixed effect for any particular population.

Timing, support and the application of learning

The training-transfer literature distinguishes acquiring knowledge from using it at work. Baldwin and Ford identify trainee characteristics, training design and opportunities for support in the work environment as conditions for transfer [3]. Subsequent reviews link perceived utility, motivation, practice opportunities and follow-up to the application of learning [4, 5], and a meta-analysis found positive relationships between social support, motivation to transfer and training transfer [6].

These findings justify measuring not only what business content a programme teaches, but whether and when graduates are supported to apply it. They do not establish that one point of delivery is universally superior; the most effective timing may differ by course, background and career intention, and is treated as an empirical question for the study.

Expectations and post-qualification outcomes

Entrepreneurship research shows that founders frequently hold optimistic expectations of their chances of success [7]. Surveying students' expectations at entry, and comparing them with outcomes reported by graduates, can therefore illuminate a potentially consequential information gap before students commit substantial time and money.

The Higher Education Statistics Agency's Graduate Outcomes programme provides an established UK precedent for surveying graduates' activities, including self-employment and business ownership, around fifteen months after completion, using a cognitively tested questionnaire [8, 9]. The benchmark adopts this approach while focusing specifically on practitioner pathways, business preparation, income goals and the early establishment of practice.

Professional standards, measurement and data protection

The instrument preserves ethics, safety and compliance as essential foundations, consistent with the Professional Standards Authority's Standards for Accredited Registers [10]. Survey design and reporting follow the CHERRIES checklist for web surveys [11] and the STROBE guidance for observational research [17]. Content validity is assessed against recognised criteria of relevance, comprehensiveness and comprehensibility [14, 15]. Ethical conduct follows the UKRI and ESRC Framework for Research Ethics [12], and data handling follows the Information Commissioner's Office guidance on research processing and effective anonymisation [13, 16].

Governance

GROW sponsors and coordinates the study and also provides business education. To manage this conflict of interest, the instrument is supplier-neutral, identical evidence standards apply to internal and external provision, study communications are non-commercial and participation never constitutes consent to marketing.

References

  1. [1] Department for Business and Trade. Longitudinal Small Business Survey 2025: businesses with no employees. 2026. https://www.gov.uk/government/statistics/small-business-survey-2025-businesses-with-no-employees/longitudinal-small-business-survey-2025-businesses-with-no-employees
  2. [2] McKenzie D. Small business training to improve management practices in developing countries: re-assessing the evidence for "training doesn't work". Oxford Review of Economic Policy. 2021;37(2):276-301. https://doi.org/10.1093/oxrep/grab002
  3. [3] Baldwin TT, Ford JK. Transfer of training: a review and directions for future research. Personnel Psychology. 1988;41:63-105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x
  4. [4] Grossman R, Salas E. The transfer of training: what really matters. International Journal of Training and Development. 2011;15(2):103-120. https://doi.org/10.1111/j.1468-2419.2011.00373.x
  5. [5] Gegenfurtner A. Motivation and transfer in professional training: a meta-analysis of the moderating effects of knowledge type, instruction, and assessment conditions. Educational Research Review. 2011;6(3):153-168. https://doi.org/10.1016/j.edurev.2011.04.001
  6. [6] Reinhold S, Gegenfurtner A, Lewalter D. Social support and motivation to transfer as predictors of training transfer: meta-analytic structural equation modelling. International Journal of Training and Development. 2018;22(1):1-14. https://doi.org/10.1111/ijtd.12115
  7. [7] Cooper AC, Woo CY, Dunkelberg WC. Entrepreneurs' perceived chances for success. Journal of Business Venturing. 1988;3(2):97-108. https://doi.org/10.1016/0883-9026(88)90020-1
  8. [8] Higher Education Statistics Agency. Graduate Outcomes: survey questions and methodology. https://www.hesa.ac.uk/data-and-analysis/graduates/methodology/survey-questions
  9. [9] Higher Education Statistics Agency. Definitions: Graduate Outcomes. https://www.hesa.ac.uk/support/definitions/graduates
  10. [10] Professional Standards Authority. Standards for Accredited Registers. https://www.professionalstandards.org.uk/publications/standards-accredited-registers
  11. [11] Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). Journal of Medical Internet Research. 2004;6(3):e34. https://doi.org/10.2196/jmir.6.3.e34
  12. [12] UK Research and Innovation / ESRC. Framework for Research Ethics: core principles. 2025. https://www.ukri.org/councils/esrc/guidance-for-applicants/research-ethics-guidance/framework-for-research-ethics/our-core-principles/
  13. [13] Information Commissioner's Office. How do we ensure anonymisation is effective? https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/data-sharing/anonymisation/how-do-we-ensure-anonymisation-is-effective/
  14. [14] Content validity: relevance, comprehensiveness and comprehensibility. Journal of Clinical Epidemiology. 2025. https://doi.org/10.1016/j.jclinepi.2025.111879
  15. [15] Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Research in Nursing & Health. 2006;29(5):489-497. https://doi.org/10.1002/nur.20147
  16. [16] Information Commissioner's Office. The research provisions: principles and grounds for processing. https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/the-research-provisions/principles-and-grounds-for-processing/
  17. [17] von Elm E, et al. The STROBE statement: guidelines for reporting observational studies. Epidemiology. 2007;18(6):800-804. https://pubmed.ncbi.nlm.nih.gov/18049194/