Joda Training All articles
Training Evaluation

What Actually Changed? A UK Employer's Guide to Training Impact Without the Theatre

Joda Training
What Actually Changed? A UK Employer's Guide to Training Impact Without the Theatre

Photo: Sebastiaan ter Burg from Utrecht, The Netherlands, CC BY 2.0, via Wikimedia Commons

Training evaluation has a credibility problem. In many UK organisations, the process begins with a feedback form and ends with a report that nobody uses. The form records whether participants liked the trainer, the room and the pace. Those things matter to the delivery, but they do not answer the question that budget holders are entitled to ask: what changed at work?

At Joda Training, we argue that evaluation should be designed to support a decision, not to decorate a completion report. The decision might be to continue, expand, adjust or stop. A one-page framework is usually enough to make that decision honestly. It will not produce laboratory-grade proof, and it does not need to. It needs to show whether the training is plausible, observable and worth the money.

The problem with spreadsheet theatre

Theatre takes several forms. One is the post-course happy sheet with a five-point scale and a comments box. Another is the return-on-investment calculation that assigns a monetary value to every hour saved without explaining the assumptions. A third is the dashboard that tracks attendance, completion and satisfaction but never asks whether behaviour changed.

None of these is worthless in isolation. Attendance tells you whether the training reached the intended audience. Satisfaction can flag delivery problems. A cost calculation can support a business case. The problem is when these measures are presented as impact. They are inputs and reactions. Impact sits closer to the work: fewer errors, faster onboarding, better compliance, fewer escalations or improved customer outcomes.

Begin with the decision, not the form

Before the training is booked, write down what decision the evaluation will inform. For example: should we roll this out to all four regions, repeat it next quarter, change the format or stop? The decision determines the evidence. If the decision is about rollout, you need evidence that the change is consistent enough to justify repetition. If the decision is about format, you need evidence that compares delivery methods, not just overall satisfaction.

This discipline also protects against over-measuring. A short course for a small team does not need a twelve-page evaluation strategy. A high-cost programme with regulatory consequences does. Scale the evidence to the risk and the spend.

A one-page evaluation framework

The framework can fit on one side of A4 and should be completed before delivery. It has six sections.

  1. Purpose and decision. State the business problem and the decision the evaluation will support. Name the owner and the date by which the decision will be made.
  2. Baseline. Record three measures that already exist. Include at least one business measure and one behavioural measure. Note the source and the date.
  3. Expected change. Describe what should be different, for whom and by when. Be specific enough to observe. Better customer service is not observable. Complaint acknowledgements within one working day is.
  4. Evidence plan. Set out how you will collect before-and-after data, what managers will observe and which business KPI will be reviewed. Keep the number of measures small.
  5. Cost and value. Record the direct cost, the staff time and any opportunity cost. Estimate value conservatively and show the assumptions.
  6. Decision and next step. At the review meeting, record the decision, the reasoning and who will act on it.

Use metrics that already exist

The most sustainable evaluation uses data the organisation already collects. Examples include error rates, rework hours, complaint volumes, resolution times, audit scores, absence, turnover in the first ninety days, sales conversion, case backlog or the number of escalations. The exact measures depend on the sector and the role. The principle is to avoid inventing a new reporting burden when a relevant number is already available.

Before-and-after comparison does not require a spreadsheet empire. Take a baseline for a defined period, deliver the training, then review the same measure for a comparable period. Note any obvious confounders: a seasonal peak, a new system, a change in team composition or a policy update. You do not need to eliminate every confounder. You need to be honest about them.

Manager observations need structure

Manager observation is often dismissed as subjective, but it is one of the most useful sources of evidence when it is structured. Ask managers to observe three specific behaviours before the training and again six to eight weeks afterwards. Provide an example of what good looks like. Record what was seen, not a general impression. Where possible, have a second observer for a sample of cases.

This approach is particularly useful for interpersonal and process skills that do not show up immediately in a business KPI. A manager can see whether a handover is clearer, whether an escalation includes the right information or whether a customer conversation follows the agreed steps. The evidence is not perfect, but it is closer to the work than a satisfaction score.

Have the money conversation without overclaiming

Cost is usually easier to calculate than value. Include the direct fee, the preparation time, the time away from the role and any backfill. For value, start with a conservative estimate based on one or two operational improvements. If rework falls by a modest amount, calculate the hours saved at the relevant pay rate. If escalations fall, calculate the handling time avoided. Show the assumptions so that a finance colleague can challenge them.

The purpose is not to produce a precise return-on-investment figure. It is to show whether the training is likely to be worth repeating. A programme that costs more than the problem it addresses should be redesigned or stopped. A programme that produces a modest but credible improvement may still be a good investment.

Keep the report short and the decision clear

The final output should be a short note, not a presentation. Summarise the baseline, the observed change, the business measure, the cost and the recommendation. Include the limitations. A one-page note that leads to a clear decision is more valuable than a polished deck that avoids one. That is the opposite of spreadsheet theatre. It is evaluation as management.

All Articles

Related Articles

Fifteen Minutes, Every Week: A Manager's Plan for Learning That Survives the Day Job

Fifteen Minutes, Every Week: A Manager's Plan for Learning That Survives the Day Job