QualityAIQ Academy · Beta
From Manual Tester to AI Quality Engineer
More of the software you test now has AI inside it. This course teaches a manual tester the concepts and hands-on skills that AI QA and QE roles ask for: narrated lessons, real practice apps with planted bugs, and a capstone you can talk about in interviews.
More and more of the software you test now has AI inside it.
- weeks, self-paced
- 15
- weeks, self-paced
- narrated lessons
- 106
- narrated lessons
- weeks with no code
- 5
- weeks with no code
- capstone project
- 1
- capstone project
- one price, certificate included
- $99
- one price, certificate included
What you’ll learn
The technical skills AI testing jobs ask for
Four groups of skills, built in order. Each one is taught in pictures, practised on an AI app, and checked before you move on.
1. How AI works and fails
Weeks 1–3What happens between the question and the answer, the oracle problem, and the new kinds of bug.
- Tokens & temperature
- Context windows
- Embeddings
- Model types
- Test oracles
- Quality characteristics
- Hallucination
- Bias
- Prompt injection
2. Designing and judging tests
Weeks 4–7Plan AI testing by risk, explore with charters, grade like a calibrated rater, test the data, and test with AI.
- Risk-based strategy
- Exploratory charters
- Metamorphic testing
- Golden datasets
- Rubrics & guidelines
- Rater calibration
- Data quality
- Prompting for testing
3. Measuring quality
Weeks 8–10Automate the grading in Python and SQL, put error bars on every score, and check the grader.
- Python for evals
- SQL over traces
- Code checks
- Confidence intervals
- Sample size
- A/B tests
- Confusion matrix
- LLM-as-a-judge
4. RAG, agents, security & production
Weeks 11–15Test AI that looks things up and takes actions, red-team it safely, and keep quality from slipping after release.
- Retrieval metrics
- Agent end-state checks
- pass^k
- OWASP agentic top 10
- OWASP LLM top 10
- Guardrail testing
- Red teaming
- Latency & cost
- Monitoring & drift
- EU AI Act & NIST
- Launch reports
How every lesson works
Watch it, use it, break it, prove it
- ▶01
See it
One idea per lesson, animated and narrated, with captions.
- ⌨02
Try it
Use a real AI app in your browser. Nothing to install.
- ✕03
Break it
Find a planted failure yourself and report it.
- ✓04
Check it
A few quick questions, each marked as you answer.
Syllabus
15 weeks, one path
Each week has a set of lessons and one hands-on task. The full curriculum opens once you enroll.
- 1Week 1No code
How AI systems work
What happens between the question and the answer, and why the same input gives different outputs.
- 2Week 2No code
The test oracle problem
When you can’t know the one right answer: pass bars, oracles and what “quality” means for AI.
- 3Week 3No code
How AI fails
Your exploratory-testing instincts, pointed at a new kind of bug.
- 4Week 4No code
Test design for AI features
Risk-based strategy, exploratory charters, metamorphic and back-to-back testing.
- 5Week 5No code
Human evaluation as a craft
Golden datasets, rubrics, labelling guidelines and calibrated raters.
- 6Week 6
Data quality and ML basics
How models are made, and how to test the data they learn from.
- 7Week 7
Testing with AI
Use AI to do your testing work faster, and check its work.
- 8Week 8Python & SQL start
Python and SQL for evaluators
The small amount of code and SQL AI testing needs, with AI as your pair.
- 9Week 9
Automated evals and statistics
Let the machine grade what it can, and know when a difference is real.
- 10Week 10
AI as a judge
Using one AI to grade another, and knowing when not to trust it.
- 11Week 11
RAG and search quality
AI that looks things up: retrieval, citations and poisoned documents.
- 12Week 12
Testing agents
AI that takes actions: end states, trajectories, permissions and attacks.
- 13Week 13
Security and safety testing
Web security basics, the OWASP LLM top 10 as a test plan, leaks, guardrails and a red-team engagement.
- 14Week 14
Production and governance
Latency, cost, monitoring, rollouts, regulation and release reports.
- ★Week 15Capstone
Capstone and career
Prove what you can do end to end, and walk into interviews ready.
Practice
Real AI apps, with real bugs to find
Every app has planted failures for you to hunt down: made-up facts, biased decisions, leaked instructions and more.
- PePebble & PineAn online shop’s help desk
- LaLarkspur BankA banking assistant
- TaTalentSiftAn AI that screens job applications
- ReReviewlySummarises customer reviews
- CaCaseCraftWrites test cases for you
- BrBrightline EnergyAn energy supplier’s help bot, for exploratory testing
- JuJuniper AirAn airline assistant, for the capstone
Who it’s for
- ✓You test software by hand today, with little or no coding.
- ✓You can see AI changing what QA and QE jobs ask for.
- ✓You want to understand AI testing properly, not just ask a chatbot to write test cases.
QualityAIQ Academy
Skills Record
Your name
From Manual Tester to AI Quality Engineer
Rated area by area, with your work samples and a link for your CV and LinkedIn.
One price, full course
$99
- ✓15 weeks, self-paced, in English
- ✓106 narrated lessons with hands-on practice
- ✓Practice AI apps and in-browser Python
- ✓Capstone project and launch report
- ✓Skills Record: a rated, shareable record of your work
In beta testing while the course is finished, so enrollment isn't open yet. Create an account to be ready when it opens.
Sign in or create an accountQuestions
Before you start
Do I need to know how to code?+
No. Weeks 1 to 5 need no code at all, and week 6 only asks you to change a few numbers. Python and SQL start in week 8, a little at a time, with AI helping you write it, and it all runs in your browser.
Do I need to install anything?+
No. Lessons, practice apps and Python all run in the browser.
How long does it take?+
Fifteen weeks at your own pace. Each week has two to ten lessons and one hands-on task; most lessons take 20 to 30 minutes.
What do I get at the end?+
A Skills Record instead of a pass badge: a public page with your own link that rates each skill area, shows numbers such as how many of your bug reports were real, and can include your capstone report in your own words. You can add it to your LinkedIn profile in one click.
Is it open now?+
The Academy is in beta testing while the course is finished, so enrollment isn’t open yet. Create an account to be ready when it opens.