Measure sales roleplay training in layers: whether reps practice, whether their scores rise on the skills you train, and whether those same skills show up on live calls. Itero (iteroapp.ai) scores practice and live calls on the same scorecards, so you can compare them directly.
Last updated: November 3, 2026. Itero is not affiliated with iTero, the intraoral dental scanner made by Align Technology.
Define success before the program starts. This article gives you the metrics for each layer of roleplay training, from practice activity to business results, and shows how to set a baseline you can trust.
Why doesn't completion prove roleplay training worked?
Completion shows that a rep showed up, not that the rep can do the job. A rep can finish every assigned scenario and still skip discovery on a live call.
Treat completion as a sign the program is running. To judge whether roleplay training is working, look at skill scores and live-call behavior.
Which roleplay training metrics belong in each layer?
Each layer answers a different question. Report them together, because a change in one layer explains the next. Track one or two metrics per layer, since a short list gets reviewed and a metric that wouldn't change a decision can go.
| Layer | Question it answers | Example metrics |
|---|---|---|
| Activity | Are reps practicing? | Sessions per rep, talk time, scenarios completed |
| Skill | Are they improving in practice? | Score by criterion, attempts to pass, certification pass rate |
| Transfer | Does it show up with customers? | The same criteria on live calls, compliance check pass rate |
| Business result | Did the business move? | Ramp time, conversion, win rate, retention |
Transfer is the layer that connects training to the business result, so keep it in the report. The single metric worth watching most closely is the score on a trained criterion on live calls, compared with the baseline. It shows that a skill practiced in training reached customers.
The layers also move in order. Practice scores change first, live-call behavior follows, and business results come last.
How do you set a baseline before training starts?
Score live calls on your scorecard before reps start practicing. Without a baseline, any later number has nothing to be compared with.
- Pick two or three skills. Choose the ones you expect training to change, such as discovery questions or a required disclosure.
- Score a batch of live calls. Use the same scorecard you will use in practice, and record the score for each criterion.
- Write the target down. State the change you expect and the number of scored calls per rep you will review it at.
- Keep a comparison group if you can. A similar team that starts later shows what would have happened anyway.
Setting the review point in advance as a number of scored calls per rep matters. It keeps the decision from depending on how the first few calls went.
How do you connect roleplay training to live-call results in Itero?
Itero uses one set of scorecards for both, so a criterion means the same thing in practice and on a live call. You can see whether a rep who practiced objection handling also handled objections better with customers.
Three parts of the product support that comparison:
- Home dashboard: reps' performance shows here, and widgets can filter by scorecard or call tag.
- Coaching Inbox: it shows which reps and skills need attention, so a manager can assign practice for the gap (AI Sales Coaching).
- The Itero mobile app: field reps can record in-person conversations with consent, and those are scored against the same rubric (Virtual Ride-Alongs).
Business results such as conversion live in your CRM or reporting tools, so compare them there. Itero reports practice and conversation scores. Fields Itero extracts from calls can reach any CRM by webhook through Call Data Capture.
What mistakes make training metrics misleading?
A few habits cause most measurement problems, and all of them can be avoided up front.
- Tracking only the overall score: an average hides which skill moved, so report by criterion.
- Rewarding practice volume: reps learn to rack up sessions, so pair activity with skill scores.
- Changing the scorecard mid-program: scores before and after the change can't be compared.
- Crediting training for everything: a new product or territory can move results, which is why a comparison group helps.
Start with the baseline
The first step in measuring roleplay training comes before anyone practices: score a batch of live calls on the scorecard you plan to use. For the wider buying decision, read how to validate an AI roleplay purchase and the AI sales roleplay platforms roundup. Request a demo to see how Itero compares practice and live-call scores.
