University planning & assessment

Evaluate an AI practice platform

Use a real course task to examine feedback, integration, access and evidence before procurement.

Teachrity Simulation Course Builder Walk through

Inspect the course-authoring workflow while evaluating how scenarios and rubrics would fit your programme.

Watch on YouTube
In this guide
Before you start

Bring a brief and someone to review it.

When choosing AI role play software for a university, check eight things: curriculum-level scenarios, scoring you can inspect, faculty oversight, LMS launch, data policy, language coverage, proctoring and adoption support. Run your own scenario with real students before committing.

Your practice kit
  • An institution-owned task and rubric
  • Faculty and technical reviewers
  • Your procurement and data requirements
The method

5 moves to practise

  1. Curriculum fit

    Are scenarios built for your programme with subject experts, or generic conversations with a new label? Ask to see criteria for your subject.

  2. Scoring and oversight

    Can faculty see the rubric, review recordings, override scores and handle disputes? Marks without evidence will not survive an appeal.

  3. Integration and access

    Does it launch through LTI 1.3 in your LMS, and can a student start from a link? Extra logins kill adoption.

  4. Data and security

    Is student data used to train models or sold? Ask for a clear answer and put it in the agreement.

  5. Adoption

    Student use, not licence spend, is the usual worry. Ask what handholding is included and how usage is shown to faculty.

See the method in context

A procurement committee discusses a trial

Illustrative script
Dean

How will we know this works?

Faculty

We pick one scenario and sixty students, and review attempts against our own rubric.

Dean

What decides yes or no?

Faculty

Student use, faculty review of a sample and the evidence we can show.

Quick scorecard

AreaAsk the vendor
CurriculumShow criteria for our subject
EvidenceCan we see a recording and rubric for one student?
LMSIs it LTI 1.3 and have you tested our LMS?
DataIs student data used for training or shared?
LanguagesWhich languages and accents are supported?
AdoptionWhat support do we get in the first month?
Put the guide to work

Try it. Review it. Change one thing.

Your practice task

Ask each provider to demonstrate the same task and explain what evidence reviewers can inspect.

What to look for

Record what was demonstrated, what remains unverified and who owns each follow-up. Agree decision criteria before comparing offers.

Before the next attemptJust for you: nothing here is saved.

Common questions

Should we run a pilot?

Test one real scenario with a small group of students and compare feedback with faculty.

Is price the main factor?

Adoption and evidence matter more than per-session price.

Does Teachrity meet this checklist?

See how Teachrity works and ask us to demonstrate any item.

Evidence and context

Research and further reading

Use these primary resources to explore the method and its context. References describe their publishers’ work; they do not imply endorsement or certification of Teachrity.

Choose your next step

Keep the next task focused.

Read nextRethink higher-education assessment in the age of AIContinue