Professional programme for lawyers · England & Wales and EU

Become the lawyer who tests the AI.

Law firms, legal tech companies and AI labs now need lawyers who can judge whether an AI's legal work is right. This programme turns your legal training into that skill, in plain English.

No coding or technical background required.You use the legal judgement you already have. Not one line of code.
Regulation makes evaluation mandatory.Oversight, testing and accountability rules are arriving. Someone has to do the checking.

Self-paced · 10 chapters and a capstone · Certificate on completion

Evaluation sheet · Item 047Marked

Prompt: "Breach of a supply contract in Scotland. What is the time limit?"

"Claims must be brought within six years of the breach, as confirmed in Harrow Developments v Pemberton [2018]. Time can be extended where facts were deliberately concealed."

JUR · CriticalSix years is the England and Wales rule. Scotland uses a five-year prescriptive period.
CIT-FAB · CriticalAuthority cannot be found in any primary source.
OKConcealment point is directionally right; flag for the Scottish equivalent.
Rubric v1.0 · Accuracy 1/5Critical fail
83%
of lawyers surveyed use AI at work[1]
2,149
court decisions on AI-hallucinated material[2]
17-33%
error rate of leading legal research AI tools[3]
$70-150
per hour advertised for lawyer evaluators[4]
Hook one

No coding. No technical background. Just the judgement you already have.

AI evaluation is not engineering. Engineers build the system; evaluators decide whether its legal output is right, safe and usable. That decision needs a lawyer, not a programmer.

You already do this
As an evaluator, it becomes
Issue spotting
Finding every error in an AI answer
Checking authorities
Catching invented and misused citations
Applying precedent
Marking like cases alike, at scale
Precise drafting
Writing rubrics and rationales
Advising on risk
Grading how dangerous an error is

What you will and won't do

  • Mark AI legal answers against clear criteria
  • Write short rationales a product team can act on
  • Build test questions and rubrics with stakeholders
  • Explain AI risk to partners and clients in plain English
  • Never required
  • Writing code or scripts
  • Statistics beyond plain-English explanations
  • Building or training AI models
Hook two

Regulation makes evaluation mandatory.

The rules don't say "hire an AI evaluator". They demand human oversight, documented testing and lawyers who stay accountable for every output. Evaluation is how firms meet them, and evaluators are the people who produce the evidence.

EU

The EU AI Act classes AI in the administration of justice as high-risk

High-risk systems need risk management, technical documentation, logging and human oversight. Following the Digital Omnibus, these obligations apply from 2 December 2027.[5]

Fines

Non-compliance is expensive

Breaching the Act's obligations for high-risk systems can bring fines of up to €15 million or 3% of worldwide annual turnover, whichever is higher.[6] The same regime covers high-risk AI in healthcare, which is why the Career Accelerator places you on a live healthcare AI project.

SRA

UK lawyers stay accountable for AI output

When the Solicitors Regulation Authority approved the first AI-driven law firm, it required quality-checking processes and kept named solicitors accountable for every output.[7] The SRA Code already requires competence and effective supervision.[8]

Courts

Judges are referring lawyers to regulators

In Ayinde v Haringey (2025), the High Court found existing guidance insufficient and referred lawyers to their regulators over fake citations.[9]

Completing this programme does not make you or your firm compliant with any regulation, and it is not endorsed by any regulator. It teaches the evaluation skills that compliance work depends on.

A job of the future

The Legal AI Evaluator

A new professional role at the meeting point of law and technology, already advertised by AI labs and growing inside firms and legal tech companies.

Legal AI Evaluator

Emerging role
Purpose
Judge whether AI legal output is accurate, safe and usable, and show the evidence.
Day to day
  • Mark AI answers against rubrics
  • Compare two answers and choose the better
  • Write reference answers and test questions
  • Run rubric workshops with partners and risk teams
Background
Qualified lawyers, paralegals and in-house counsel. Platform listings typically ask for 2 to 4 or more years of practice.[10]
Technical skill
None required.
AI labs, via expert platformsRemote, project-based, flexible
$70-150/hr[4]
Legal tech companiesTesting every product release
Employed
Law firmsInnovation and knowledge teams
Employed
In-house legal teamsTesting tools before procurement
Employed
Expert evaluator
Senior evaluator
Legal AI quality lead
Head of AI assurance
Curriculum

Ten chapters, one capstone. Start with three, free.

Written for practising lawyers, with worked legal examples, interactive exercises, charts and a checkpoint quiz in every chapter. Every fact is referenced so you can check it.

Part A · Foundations

Understand the machine

  1. From legal practice to AI evaluationFree
  2. How LLMs work, for lawyersFree
  3. Legal AI use cases and their risksFree
Part B · Marking

Do the work

  1. Evaluation methods and formats
  2. The legal quality dimensions
  3. Consistency and calibration
  4. Rationales and reporting
Part C · Stakeholders

Lead the work

  1. Prompts and test cases
  2. Rubrics with stakeholders
  3. Ethics, safety and conduct
Capstone: evaluate a legal AI assistant end to endTest set, rubric, marking and a findings report. A portfolio piece you can show employers.
Choose your track
Career Accelerator only · A live project

The compliance survival kit: 3 months on a real healthcare AI

This is not a simulation. You will evaluate a healthcare AI platform that is in beta testing now, funded by SynaptiQ Tech and Riders for Health. It is built to bring AI-supported diagnosis to people in Africa who would otherwise have no access to a doctor.

In beta testing

Two questions, one evaluation

When an AI talks directly to patients, every answer carries two kinds of risk. You will learn to judge both.

Is it safe for the patient?Accuracy, red flags, and knowing when to send someone to a clinician. You work alongside clinicians on this side.
What is the legal exposure?Consent, data protection, disclaimers, scope of advice and liability when the AI gets it wrong. This is where your legal training leads.
Where exposure arises in a patient conversation
Patient describes symptoms
AI responds
Patient acts on the answer
1Consent and data: is personal health data handled lawfully?
2Scope: does the AI stay within what it is allowed to advise?
3Accuracy and escalation: does it refer urgent cases to a clinician?
4Understanding: will this person read it the way it was meant?
1

Map the exposure

  • Learn how real users interact with the AI
  • Map where legal and safety risks arise
  • Interview the project team on what "safe" means

OutputExposure map and scope memo

2

Test and mark

  • Build test conversations from real use patterns
  • Co-design a rubric covering safety and legal risk
  • Mark outputs and log every error

OutputTest set, rubric and error log

3

Report and defend

  • Turn marks into findings for the project team
  • Rank legal exposures and recommend fixes
  • Present to a peer review panel

OutputFindings report and exposure register

A real productYour findings feed a live beta
Real impactSafer care for people with no other access
Peer review sessionsCalibrate your judgement with other lawyers
Verifiable badgePlus an evidence pack for your CV
CV
Real work experience, not just a certificate

Because you work on a live product, you can list the project on your CV as work experience in AI evaluation, backed by your findings report and badge.

∞
Stay on after you finish, if you choose

Graduates can volunteer on the project periodically, on an ongoing basis, keeping their experience current while helping bring safer care to more people.

Pricing

Two tracks. One standard.

Both tracks include the complete course. The Career Accelerator adds the hands-on project, peer review and a verifiable badge.

The Core Track

For junior lawyers and individual professionals

£850one payment
  • Full access to the self-paced course: 10 chapters and the capstone
  • The 3 opening chapters, free to try before you buy
  • Interactive exercises and checkpoint quizzes
  • Standard completion certificate
Enrol in the Core Track
Most career impact

The Career Accelerator

For ambitious associates and job-seekers

£1,499one payment
  • Everything in the Core Track
  • 3-month live project on a real healthcare AI in beta, covering patient safety and legal exposure
  • Counts as work experience you can list on your CV
  • Option to keep volunteering on the project after you finish
  • Peer review sessions
  • Verifiable badge for your LinkedIn profile and CV
Join the Career Accelerator

Training a team? Group bookings for firms and legal departments are available on request: email us.

Your course lead

Phemi Tolu Ajayi

AI evaluation specialist, computing lecturer and Lead User Researcher

Phemi earned his MSc in Architecture: Computing and Design from the University of East London in 2005, specialising in artificial life algorithms and artificial intelligence, and has worked across digital, UX and teaching ever since. For eight years he was a lecturer in computing at University Campus Milton Keynes.

He has served as Head of UX Research in a UK Government department, with more than ten years of research experience across UK government. His specialism is AI and LLM evaluation and human-AI interaction research, backed by over twenty years of software development. He designed this programme to give lawyers the evaluation method without the technical barrier.

MSc Architecture: Computing and Design · UEL 2005Artificial life and AI specialism8 years lecturing in computingAI and LLM evaluationHuman-AI interaction researchGDS Assessor20+ years in software
Questions

Before you enrol

Do I really need no technical background?

Yes. The course explains how AI models work in plain English, with diagrams and demonstrations. Every exercise uses legal judgement: reading, marking and writing. You will never be asked to write code.

Who is the course for?

Solicitors, barristers, paralegals, in-house counsel and legal academics who want to work in AI evaluation, legal tech quality or AI assurance, either alongside practice or as a career move.

Will this make my firm compliant with the EU AI Act or SRA rules?

No course can do that on its own, and this one is not endorsed by any regulator. It teaches the evaluation skills that compliance work depends on: testing AI systems against clear criteria, recording evidence and explaining risk.

Which law does the course use?

Worked examples use the law of England and Wales, with comparisons to Scotland and the US to teach jurisdiction errors. The regulatory material covers the SRA, the courts of England and Wales and the EU AI Act.

Are the first three chapters really free?

Yes. Chapters 1 to 3 cover the role, how AI models work and where legal AI fails. Read them before deciding which track suits you.

What is the Career Accelerator project?

A live healthcare AI platform in beta testing, funded by SynaptiQ Tech and Riders for Health, that brings AI-supported diagnosis to people in Africa who would otherwise have no access. You evaluate both patient safety and the legal exposure created by how the AI interacts with people, working under the project's confidentiality and data protection rules.

Why healthcare, if I am a lawyer?

Healthcare AI is regulated as high-risk, and when it talks directly to patients, questions of consent, data protection, scope of advice and liability arise in every conversation. That makes it the toughest practice ground there is, and the skills transfer directly to legal tech and other regulated sectors.

What do I receive at the end?

Core Track learners receive a completion certificate. Career Accelerator learners also receive a verifiable badge, a portfolio of evidence, and work experience on a live project that they can list on their CV. Neither is a regulatory qualification.

Can I keep working on the project after the three months?

Yes, if you choose. Career Accelerator graduates can volunteer on the project periodically, on an ongoing basis. It is optional, flexible, and a way to keep your evaluation experience current.

Start today

The rules are coming. Be the lawyer who can check the AI.

No coding. No technical background. Three chapters free, then choose the track that fits your career.