Practitioner Success Survey: study protocol and methodological rationale

The Practitioner Success Survey

The Practitioner Success Survey is one of two studies within the Graduate Success Benchmark, a research initiative by GROW. The other is the Graduate Support Survey.

An evidence-informed study examining graduates' experiences of business preparation and support alongside their professional circumstances.

The Practitioner Success Survey examines the experiences of people who completed UK-based health and wellness practitioner qualifications within the preceding ten years. It includes graduates who are currently practising, previously practised or never entered professional practice.

The study is based on a central proposition: understanding graduate preparation requires attention both to the support institutions provide and to graduates' experiences of that support and their subsequent careers.

Professional qualification demonstrates attainment of specified educational and clinical requirements. Establishing a career may also involve commercial, organisational and interpersonal capabilities. Research into entrepreneurship education and small-business training suggests that these capabilities can be developed through education, although outcomes vary between programmes, populations and settings [1, 2].

The survey therefore examines what preparation graduates recall, what support they were offered or accessed, and how their professional careers have developed. It recognises that graduates have different ambitions: employment, self-employment, part-time practice and portfolio careers may each represent successful fulfilment of individual goals.

Why five stages?

The survey examines graduates' reported experiences across the same five stages used in the Graduate Support Survey:

1. Realistic expectations before enrolment.
2. Essential business foundations during training.
3. Transition into professional practice.
4. Business development support after qualification.
5. Graduate outcome monitoring and improvement.

These stages provide a shared framework for examining institutional provision and graduate experience. They are informed by research in entrepreneurship education, training transfer and small-business support.

The stages are an evidence-informed organising framework, not five independently established predictors of graduate success. Much of the supporting evidence comes from related fields rather than research specifically involving UK health and wellness practitioners.

The two surveys examine different perspectives. The Graduate Support Survey describes provision reported by participating institutions. The Practitioner Success Survey describes graduates' recollections and professional circumstances. The practitioner survey does not apply the institutional survey's 100-point scoring model. Its measures are analysed separately.

Stage 1. Realistic expectations before enrolment

Principle: Prospective students should have information that helps them understand the professional and commercial realities of their intended career.

Research among business founders has documented optimistic expectations of entrepreneurial success [7]. This research concerned people who had already entered business, rather than prospective practitioner-training students. It provides an indirect rationale for examining the information available before enrolment, but does not establish how practitioner students form their expectations or whether particular information changes their subsequent outcomes.

Graduates may enter training with different intentions. Some intend to establish independent practices; others seek employment, combine practitioner work with another occupation or pursue qualifications for different reasons. Initial career intentions are therefore relevant when interpreting both preparation and subsequent professional participation.

What the survey examines: Whether graduates recall receiving information before enrolment about practice costs, the time required to establish a practice and finding clients. Initial career intentions are recorded separately to help interpret their subsequent experiences.

Stage 2. Essential business foundations during training

Principle: Students should receive preparation relevant to the professional and practical responsibilities they may encounter after qualification.

Entrepreneurship education research provides a rationale for examining business preparation during training. However, the existence of teaching does not establish its effectiveness. Nabi and colleagues' systematic review of 159 articles found that much of the literature focused on short-term and subjective outcomes and often provided insufficient detail about the teaching approaches assessed [1].

Training-transfer research also distinguishes acquiring knowledge from being able to use it. Baldwin and Ford identified learner characteristics, training design and the working environment as important influences on transfer [3]. These findings support examining graduates' reported preparation while recognising that subsequent outcomes may depend on many additional circumstances.

What the survey examines: Graduates' reported coverage of business finances, client acquisition and responsible practice management during their course. These responses describe recalled preparation; they do not independently establish the quality of teaching or the competence acquired.

Stage 3. Transition into professional practice

Principle: The transition from qualification to professional practice is a distinct opportunity to support the application of learning.

Completing a qualification and beginning professional work involve different demands. Training-transfer research identifies perceived usefulness, motivation, opportunities for application and support as relevant influences on whether learning is used in practice [3, 4].

These findings provide a rationale for examining practical guidance around qualification. They do not establish that a particular transition-support model improves outcomes for practitioner graduates.

Distinguishing support offered from support used is also relevant. Graduates may not take up available guidance, and their decisions may reflect their intentions, circumstances or perceived needs.

What the survey examines: The practical guidance graduates report being offered at qualification and whether they used it. These experiences are considered alongside subsequent practice status and career goal attainment.

Stage 4. Business development when it becomes relevant

Principle: Graduates' business-support needs may develop as they encounter the practical demands of professional work.

Research on training transfer highlights perceived usefulness, opportunities to apply learning and continuing support [4]. This provides a rationale for examining the timing and sources of business support after qualification.

There is also evidence that business education can improve small-business outcomes. McKenzie's reassessment of experimental research in developing countries found average improvements in profits and sales of approximately 5-10%, alongside variation between interventions and settings [2]. These findings do not establish the effectiveness of particular forms of support for UK health and wellness practitioners, or demonstrate that post-qualification education is universally more effective than teaching during a qualification.

Interpretation also requires attention to why graduates seek support. Practitioners experiencing difficulties may be particularly likely to access further assistance. An association between support use and poorer outcomes would therefore not, by itself, show that the support was ineffective or harmful.

What the survey examines: The sources and timing of business support accessed after qualification. These experiences are examined alongside professional circumstances, with explicit recognition of confounding and possible reverse causation.

Stage 5. Graduate outcome monitoring and improvement

Principle: Understanding graduates' experiences after qualification can help inform discussions about educational preparation and continuing support.

National graduate surveys provide an established precedent for examining both career activities and graduates' subjective perspectives [8]. Such follow-up recognises that occupational status alone cannot describe every aspect of a graduate's experience.

The practitioner survey contributes the graduate perspective on institutional follow-up. Its measure is narrower than the corresponding stage in the Graduate Support Survey: being contacted about career progress does not establish what information an institution collected or whether that information informed improvements.

What the survey examines: Whether graduates report that their training provider contacted them about their career progress. The survey does not independently assess how institutions used any information collected.

What does practitioner success mean?

The study recognises that professional participation and personal career goals are related but distinct.

Currently practising does not necessarily mean that a graduate has achieved their ambitions. Equally, leaving practice or never entering it does not necessarily indicate educational or business failure. These circumstances may reflect personal preferences, employment opportunities or other life events.

The study therefore uses two separate primary outcomes:

• Professional practice status: currently practising, previously practised or never practised.
• Career goal attainment: a self-reported rating from 0 to 10 of how well the respondent's career since qualification has met their goals.

No composite graduate success score is created.

For current practitioners, the survey also records approximate weekly hours and banded personal income from practitioner work over the preceding 12 months. This income measure does not represent business turnover, profitability or household income.

Working arrangements distinguish self-employment, employment, combined employment and self-employment, voluntary or unpaid work, and other arrangements. Current and former practitioners report their relevant working arrangement. Former practitioners and graduates who never entered practice report their main reason for leaving or not entering.

These distinctions help avoid treating employed practitioners and independent practice owners as equivalent business populations.

Study design and analysis

The Practitioner Success Survey is a voluntary, observational, cross-sectional study using a single online questionnaire. It collects retrospective information about preparation and support alongside respondents' professional circumstances at the time of participation.

The study examines associations and cannot establish cause and effect. Interpretation must consider the timing of experiences, recall error, selection bias, confounding and possible reverse causation [5].

Eligibility and recruitment

Eligible participants are people who completed a UK-based health and wellness practitioner qualification within the preceding ten years, including current practitioners, former practitioners and graduates who never practised.

Qualification year is recorded as a calendar year. The ten-year window is therefore implemented through an eligible graduation-year range rather than exact qualification dates.

Recruitment takes place through professional bodies, training providers and alumni communications, and graduate-to-graduate sharing.

This is voluntary-response, non-probability sampling with a peer-referral component. Peer sharing is intended to improve access to graduates who have left practice or professional-body membership. However, recruitment through professional and personal networks may introduce selection bias. Participants cannot be assumed to represent all UK practitioner graduates [6].

Descriptive and exploratory analysis

Initial analysis will describe responses using numbers and percentages for categorical measures and appropriate summaries of numerical ratings. Where numbers permit, findings will be described by profession, graduation year, working arrangement and practice status.

Exploratory analyses may examine associations between:

• Business education during training and career outcomes.
• Practical transition support and career outcomes.
• Post-qualification business support and professional circumstances.
• Reported support and career goal attainment.

Where sufficient data exist, regression models appropriate to the outcomes may be used. Professional discipline, graduation year, original career intentions and previous business experience will be considered as potential confounders.

Employment status will be used to stratify relevant analyses, especially income comparisons. It will not automatically be treated as a baseline confounder in every model, because working arrangements may themselves be related to educational support and career development.

Effect estimates and confidence intervals will be reported where appropriate. Multiple exploratory comparisons will be identified as exploratory, and statistical significance will not be presented as proof of educational effectiveness.

Training-provider comparisons

Respondents identify the institution from which they obtained their main practitioner qualification. Provider names will be standardised where possible.

Provider-level descriptions may be produced where adequate numbers exist. Self-selected responses will not be presented as representative institutional success rates, and no public league tables will rank providers by their graduates' reported success.

Where relevant, descriptive comparisons with the Graduate Support Survey may be possible. These will acknowledge that institutional provision may have changed since respondents qualified.

Missing and conditional responses

"I can't remember", "I don't know", "prefer not to say" and "not applicable" will remain distinguishable. None will be interpreted as evidence that support was absent.

Each reported measure will include the number of usable responses. Conditional questions will not generate false zero values for respondents who were not asked them.

Study measures and methodological limitations

The questionnaire records training background, initial career intentions, previous business experience, professional participation, working arrangements and experiences of preparation and support. It combines these with the separate measures of career goal attainment, activity, income and reasons for leaving or not entering practice described above.

The study has several limitations.

First, participation is voluntary. Respondents may differ systematically from graduates who do not participate, limiting generalisability.

Second, current practitioners may be easier to reach than those who have left practice or never entered it. Including these groups in the eligibility criteria does not eliminate survivorship bias.

Third, respondents may not accurately remember educational experiences from several years earlier. Their experiences, working arrangements and income are self-reported and are not independently verified.

Fourth, career outcomes may reflect many circumstances that the short questionnaire does not measure. Associations between support and outcomes may arise from these other differences, or because practitioners seek support in response to difficulties.

Fifth, the questionnaire does not measure the duration, detailed content or objective quality of individual business-support programmes. It cannot establish which particular educational approaches are most effective.

Finally, institutional support may have changed since respondents qualified. Comparisons between graduates' recollections and institutions' current provision must account for this historical difference.

Reporting will be informed by the STROBE statement for observational studies and CHERRIES guidance for online surveys [9, 10].

Research aims

The study's primary aim is to investigate associations between graduates' reported business preparation and support and their professional participation and self-assessed career goal attainment.

Its secondary aims are to:

1. Describe career outcomes among participating graduates.
2. Examine differences between employed, self-employed and mixed-working practitioners.
3. Describe business preparation and support across the five stages.
4. Investigate exploratory associations between reported support and career outcomes.
5. Examine variation by profession, graduation year and previous business experience.
6. Identify stages at which respondents believe additional support would have been most useful.

The study will provide descriptive evidence about participating graduates' circumstances and experiences. It may identify patterns that inform discussions about preparation and support. It will not establish the causal effects of educational interventions, definitive institutional rankings or a universally optimal approach to business education.

Sponsorship

The study is sponsored and coordinated by GROW, which also provides commercial business education and support to practitioners and training institutions. This commercial interest is acknowledged as a potential source of bias.

The questionnaire uses supplier-neutral wording. Participation is voluntary and does not constitute consent to commercial marketing.

References

1. Nabi G, Liñán F, Fayolle A, Krueger N, Walmsley A. The impact of entrepreneurship education in higher education: a systematic review and research agenda. Academy of Management Learning & Education. 2017;16(2):277-299. https://doi.org/10.5465/amle.2015.0026

2. McKenzie D. Small business training to improve management practices in developing countries: re-assessing the evidence for "training doesn't work". Oxford Review of Economic Policy. 2021;37(2):276-301. https://doi.org/10.1093/oxrep/grab002

3. Baldwin TT, Ford JK. Transfer of training: a review and directions for future research. Personnel Psychology. 1988;41(1):63-105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x

4. Grossman R, Salas E. The transfer of training: what really matters. International Journal of Training and Development. 2011;15(2):103-120. https://doi.org/10.1111/j.1468-2419.2011.00373.x

5. Savitz DA, Wellenius GA. Can cross-sectional studies contribute to causal inference? It depends. American Journal of Epidemiology. 2023;192(4):514-516. https://doi.org/10.1093/aje/kwac037

6. Baker R, Brick JM, Bates NA, et al. Summary report of the AAPOR Task Force on Non-probability Sampling. Journal of Survey Statistics and Methodology. 2013;1(2):90-143. https://doi.org/10.1093/jssam/smt008

7. Cooper AC, Woo CY, Dunkelberg WC. Entrepreneurs' perceived chances for success. Journal of Business Venturing. 1988;3(2):97-108. https://doi.org/10.1016/0883-9026(88)90020-1

8. Higher Education Statistics Agency. Graduate Outcomes: Survey Questions and Methodology. https://www.hesa.ac.uk/data-and-analysis/graduates/methodology/survey-questions

9. von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Epidemiology. 2007;18(6):800-804. https://doi.org/10.1097/EDE.0b013e3181577654

10. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). Journal of Medical Internet Research. 2004;6(3):e34. https://doi.org/10.2196/jmir.6.3.e34