AI band scoring for institutes: where to trust it, where not to
How AI Writing and Speaking evaluation really performs against examiners, where it fails, and how to use it in an institute without misleading students.
Automatic band scoring is the feature that decides whether a practice platform is worth paying for, because marking is what actually limits an institute's capacity. It is also the feature most likely to be oversold, so it deserves a sceptical read before you buy.
This is an attempt at an honest account, written by a vendor who sells it. Treat the scepticism as the useful part.
What AI scoring is genuinely good at
- Consistency. It applies the same standard to the first essay of the day and the two-hundredth, which no tired human does.
- Immediacy. A student who gets feedback while they still remember writing the essay learns from it; one who gets it five days later is reading a report about a stranger.
- Lexical and grammatical range. Counting the evidence for those two criteria is a mechanical job and machines do mechanical jobs well.
- Volume. It does not care whether your batch is six or six hundred.
Where it is weaker, and you should assume it is
- Task Response on an unusual argument. A genuinely original essay that answers the question sideways can be marked down for not looking like the pattern.
- Coherence in a long essay, where the judgement is about whether the argument develops rather than whether connectives are present.
- Anything culturally specific — an example the model has not seen often can read as irrelevant when it is not.
- Speaking pronunciation on strong regional accents, where intelligibility and accent get conflated.
The accuracy question, answered properly
Published comparisons of AI IELTS scoring against official results tend to land in a similar place: most scripts within half a band, the large majority within one, and a tail of outliers. That is genuinely useful for practice and it is not good enough to be the last word on a student's band.
Two examiners disagree too — that is why real IELTS has moderation. The right mental model is not "is the AI right?" but "is it as close as a second examiner, and does it explain itself?"
The question that separates a tool from a toy
The most important thing to test in a demo is not the number. It is what comes with it.
A band score alone changes nothing — a student who scores 6.0 four times learns only that they are a 6.0. What changes a band is being shown the specific sentence that cost the mark and what to write instead. When you evaluate a platform, submit a deliberately flawed essay and read the feedback: if it tells you the essay "needs more complex sentences", it is a toy. If it quotes the sentence, names the criterion and offers a rewrite, it is a tool.
Do the same for Speaking. Ask whether the feedback points at a moment in the recording or just produces four numbers.
How to use it in an institute without misleading anyone
- Tell students it is an estimate, in those words, from the first class. An institute that implies an AI score is an official band will be found out on results day.
- Use it for every script, and have a trainer review a sample. The machine does the first pass; your trainer's judgement is what students are paying for.
- Let trainers override it and record when they do. Systematic disagreement in one direction is information about the tool, and about your teaching.
- Watch the trend, not the reading. One score is noise; four scores over a month is a trajectory, and the trajectory is what tells a student they are improving.
- Never let it replace speaking to a student about their writing. It replaces the counting, not the conversation.
What IELTSVega does
Instant band scores on Writing and Speaking against all four official criteria, on every submission, with the criteria named on the report so a trainer can see where the score came from rather than being handed a number.
For a partner that means a batch's mock is marked as soon as it is submitted, and the roster in your panel shows each student's attempts, mocks and average band over time — so the trajectory is visible without anyone building a spreadsheet.
We would rather you tested it than took our word for it. There is no joining fee and no minimum, so run a batch through it and have your most experienced trainer argue with the scores.
IELTSVega