Practitioner Success Survey: Study Protocol and Methodological Rationale

The Practitioner Success Survey is one of two studies within the Graduate Success Benchmark, a research initiative coordinated by GROW. The other is the Graduate Support Survey.

8.1 Study design

The Practitioner Success Survey is a cross-sectional observational study collecting retrospective information about business preparation and support alongside respondents' professional circumstances at the time of participation.

It involves a single online questionnaire.

The research covers graduates who are currently practising, previously practised or never entered professional practice.

The study is designed to examine associations, not establish causation.

Cross-sectional designs may provide useful information about relationships between previous experiences and current outcomes, but interpretations must consider the timing of exposures, recall error, selection bias, confounding and possible reverse causation [5].

8.2 Background and rationale

Professional qualification demonstrates attainment of specified educational and clinical requirements, but establishing a career may involve additional commercial, organisational and interpersonal capabilities.

Nabi and colleagues' systematic review of 159 entrepreneurship-education articles found that much of the research focused on short-term and subjective outcomes and often provided insufficient detail about the teaching approaches assessed [1].

McKenzie's reassessment of experimental research on small-business training in developing countries found average improvements in business profits and sales of approximately 5-10%, alongside variation between interventions and settings [2].

These findings suggest that business education can be beneficial, but do not establish its effectiveness for UK health and wellness graduates.

Training-transfer research provides a rationale for considering practical application, relevance and access to continuing support.

Baldwin and Ford identified learner characteristics, training design and the working environment as important influences on training transfer [3]. Grossman and Salas subsequently highlighted factors including motivation, perceived usefulness, opportunities for application and support [4].

The present study examines whether graduates' reported experiences of preparation and support are associated with their subsequent professional circumstances.

8.3 Research aims

Primary aim

Investigate associations between graduates' reported business preparation and support and their professional participation and self-assessed career goal attainment.

Secondary aims

• Describe career outcomes among participating graduates.
• Examine differences between employed, self-employed and mixed-working practitioners.
• Describe business preparation and support across five stages.
• Investigate exploratory associations between reported support and career outcomes.
• Examine variation by profession, graduation year and previous business experience.
• Identify stages at which respondents believe additional support would have been most useful.

8.4 Population

The study covers adults who completed a UK-based health and wellness practitioner qualification within the preceding ten years.

Current practitioners, former practitioners and graduates who never began practising are eligible.

Graduation year is recorded as a calendar year, so the ten-year window is implemented using the eligible graduation-year range rather than exact qualification dates.

The study does not assume that all graduates intended to enter independent practice.

8.5 Recruitment and sampling

Recruitment will take place through:

1. Professional bodies.
2. Training providers and alumni communications.
3. Graduate-to-graduate sharing.

This is voluntary-response, non-probability sampling with a peer-referral component.

Peer sharing is intended to improve access to graduates who have left practice or professional-body membership.

Nevertheless, recruitment through professional and personal networks may introduce selection bias.

Guidance from the AAPOR Task Force on Non-probability Sampling highlights the importance of understanding the assumptions and limitations of inference from non-probability samples [6].

The study will therefore avoid claiming that its respondents are representative of all UK practitioner graduates.

8.6 Study measures

Training background

Professional discipline, training provider, qualification year, initial career intentions and previous business experience.

Professional participation

Whether the respondent is currently practising, previously practised or never practised.

Working arrangements

For current and former practitioners, employment status distinguishes:

• Self-employed practice.
• Employed practice.
• Combined employment and self-employment.
• Voluntary or unpaid work.
• Other arrangements.

Professional activity

Current practitioners report approximate weekly hours.

Income

Current practitioners report banded personal income from practitioner work over the preceding 12 months.

This is not a measure of turnover, business profitability or household income.

Career goal attainment

All respondents rate how well their career since qualification has met their goals on a scale from 0 to 10. National graduate surveys provide a precedent for examining both graduates' career activities and their subjective perspectives [8]; this precedent does not establish the effectiveness of particular forms of business education.

Reasons for leaving or not entering practice

Former and never-practising respondents report their main reason.

8.7 Five-stage framework

The Practitioner Success Survey is conceptually aligned with the Graduate Support Survey.

Stage	Graduate-reported measure
Before enrolment	Information about practice costs, establishment timescales and finding clients
During training	Coverage of business finances, client acquisition and responsible practice management
At qualification	Practical guidance offered and used
After qualification	Sources and timing of business support accessed
Graduate follow-up	Whether the training provider contacted graduates about career progress

Research on business founders found that many held optimistic expectations of their chances of success [7]. That research concerned founders rather than prospective practitioner-training students, but it supports examining whether realistic information is provided before enrolment.

The stages are an evidence-informed organising framework, not five independently established predictors of success.

The practitioner survey does not apply the institutional survey's 100-point scoring model.

Instead, responses will be analysed as separate measures.

8.8 Primary outcomes

Outcome 1: Professional practice status

Three categories:

• Currently practising.
• Previously practised.
• Never practised.

This describes professional participation, not necessarily business success or failure.

Outcome 2: Career goal attainment

A self-reported 0-10 rating.

This permits respondents with different career ambitions to report their own assessment of progress.

The outcomes are kept separate.

No composite graduate success score will be created.

8.9 Secondary measures

For current practitioners:

• Employment or self-employment status.
• Approximate hours worked.
• Banded annual personal income from practitioner work.

For former practitioners:

• Previous working arrangement.
• Principal reason for leaving.

For never-practising graduates:

• Principal reason for not entering practice.

Employment status is essential when interpreting business support and financial outcomes.

Employed practitioners and independent practice owners must not automatically be treated as equivalent business populations.

8.10 Statistical analysis

The initial analysis will be descriptive.

Report numbers and percentages for categorical measures and appropriate summaries of numerical ratings.

Describe responses by profession, graduation year, working arrangement and practice status, where numbers permit.

Exploratory association analysis may investigate relationships between:

• Business education during training and career outcomes.
• Practical transition support and career outcomes.
• Post-qualification business support and professional circumstances.
• Reported support and career goal attainment.

Where sufficient data exist, analyses may use regression models appropriate to the outcomes, considering professional discipline, graduation year, original career intentions and previous business experience as potential confounders.

Employment status should be used to stratify relevant analyses, especially income comparisons. It must not be treated automatically as a baseline confounder in every model, because working arrangements may themselves be related to educational support and career development.

Report effect estimates and confidence intervals where appropriate.

Do not present statistical significance as proof of educational effectiveness.

Where multiple exploratory comparisons are undertaken, identify them as exploratory.

The study cannot determine whether better outcomes resulted from the reported support, from other differences between respondents or from practitioners seeking support because they were already experiencing difficulties.

8.11 Training-provider comparisons

Respondents identify the institution from which they obtained their main practitioner qualification.

Training-provider names will be standardised where possible.

Provider-level analysis may be descriptive where adequate numbers exist.

However, self-selected responses must not be presented as representative institutional success rates.

Do not produce public league tables ranking training providers by their graduates' reported success.

Where relevant, descriptive comparisons with the Graduate Support Survey may be possible.

Such comparisons must acknowledge that institutional provision may have changed since individual respondents graduated.

8.12 Missing data

"I can't remember", "I don't know", "prefer not to say" and "not applicable" must remain distinguishable.

Do not interpret these as evidence that support was absent.

For each reported measure, include the number of usable responses.

Conditional questions should not generate false zero values for respondents who were never asked them.

8.13 Limitations

Explain the following limitations clearly:

Selection bias: Participation is voluntary.

Survivorship bias: Current practitioners may be easier to reach than those who have left practice.

Recall bias: Respondents may not accurately remember educational experiences several years earlier.

Self-report: Experiences, working arrangements and income are not independently verified.

Confounding: Career outcomes may reflect many circumstances that the short questionnaire does not measure.

Reverse causation: Business difficulties may lead practitioners to seek further support.

Limited detail: The questionnaire does not measure the duration, detailed content or objective quality of individual business-support programmes.

Historical differences: Support may have changed since respondents qualified.

Limited generalisability: Findings cannot automatically be generalised to all UK practitioner graduates.

8.14 Research governance

The study is sponsored and coordinated by GROW.

GROW also provides commercial business education and support to practitioners and training institutions. This potential conflict of interest will be disclosed.

The questionnaire will use supplier-neutral wording.

Participation is voluntary and does not constitute consent to commercial marketing.

Research reporting will be informed by the STROBE statement for observational studies [9] and CHERRIES guidance for online surveys [10].

8.15 Expected contribution

The study will provide descriptive evidence about participating graduates' professional circumstances and experiences of business preparation and support.

It may identify patterns and associations that help inform discussions about how training providers can prepare and support graduates.

It will not identify the causal effects of specific educational interventions, establish definitive institutional rankings or determine a universally optimal approach to business education.

References

Publish the following references at the end of the methodology page, using numbered hyperlinks.

1. Nabi G, Liñán F, Fayolle A, Krueger N, Walmsley A. The impact of entrepreneurship education in higher education: a systematic review and research agenda. Academy of Management Learning & Education. 2017;16(2):277-299. https://doi.org/10.5465/amle.2015.0026

2. McKenzie D. Small business training to improve management practices in developing countries: re-assessing the evidence for "training doesn't work". Oxford Review of Economic Policy. 2021;37(2):276-301. https://doi.org/10.1093/oxrep/grab002

3. Baldwin TT, Ford JK. Transfer of training: a review and directions for future research. Personnel Psychology. 1988;41(1):63-105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x

4. Grossman R, Salas E. The transfer of training: what really matters. International Journal of Training and Development. 2011;15(2):103-120. https://doi.org/10.1111/j.1468-2419.2011.00373.x

5. Savitz DA, Wellenius GA. Can cross-sectional studies contribute to causal inference? It depends. American Journal of Epidemiology. 2023;192(4):514-516. https://doi.org/10.1093/aje/kwac037

6. Baker R, Brick JM, Bates NA, et al. Summary report of the AAPOR Task Force on Non-probability Sampling. Journal of Survey Statistics and Methodology. 2013;1(2):90-143. https://doi.org/10.1093/jssam/smt008

7. Cooper AC, Woo CY, Dunkelberg WC. Entrepreneurs' perceived chances for success. Journal of Business Venturing. 1988;3(2):97-108. https://doi.org/10.1016/0883-9026(88)90020-1

8. Higher Education Statistics Agency. Graduate Outcomes: Survey Questions and Methodology. https://www.hesa.ac.uk/data-and-analysis/graduates/methodology/survey-questions

9. von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Epidemiology. 2007;18(6):800-804. https://doi.org/10.1097/EDE.0b013e3181577654

10. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). Journal of Medical Internet Research. 2004;6(3):e34. https://doi.org/10.2196/jmir.6.3.e34