Log in

QualityAIQ Academy · Beta

From Manual Tester to AI Quality Engineer

More of the software you test now has AI inside it. This course teaches a manual tester the concepts and hands-on skills that AI QA and QE roles ask for: narrated lessons, real practice apps with planted bugs, and a capstone you can talk about in interviews.

More and more of the software you test now has AI inside it.

weeks, self-paced
15
weeks, self-paced
narrated lessons
106
narrated lessons
weeks with no code
5
weeks with no code
capstone project
1
capstone project
one price, certificate included
$99
one price, certificate included

What you’ll learn

The technical skills AI testing jobs ask for

Four groups of skills, built in order. Each one is taught in pictures, practised on an AI app, and checked before you move on.

1. How AI works and fails

Weeks 1–3

What happens between the question and the answer, the oracle problem, and the new kinds of bug.

  • Tokens & temperature
  • Context windows
  • Embeddings
  • Model types
  • Test oracles
  • Quality characteristics
  • Hallucination
  • Bias
  • Prompt injection

2. Designing and judging tests

Weeks 4–7

Plan AI testing by risk, explore with charters, grade like a calibrated rater, test the data, and test with AI.

  • Risk-based strategy
  • Exploratory charters
  • Metamorphic testing
  • Golden datasets
  • Rubrics & guidelines
  • Rater calibration
  • Data quality
  • Prompting for testing

3. Measuring quality

Weeks 8–10

Automate the grading in Python and SQL, put error bars on every score, and check the grader.

  • Python for evals
  • SQL over traces
  • Code checks
  • Confidence intervals
  • Sample size
  • A/B tests
  • Confusion matrix
  • LLM-as-a-judge

4. RAG, agents, security & production

Weeks 11–15

Test AI that looks things up and takes actions, red-team it safely, and keep quality from slipping after release.

  • Retrieval metrics
  • Agent end-state checks
  • pass^k
  • OWASP agentic top 10
  • OWASP LLM top 10
  • Guardrail testing
  • Red teaming
  • Latency & cost
  • Monitoring & drift
  • EU AI Act & NIST
  • Launch reports

How every lesson works

Watch it, use it, break it, prove it

  1. ▶01

    See it

    One idea per lesson, animated and narrated, with captions.

  2. ⌨02

    Try it

    Use a real AI app in your browser. Nothing to install.

  3. ✕03

    Break it

    Find a planted failure yourself and report it.

  4. ✓04

    Check it

    A few quick questions, each marked as you answer.

Syllabus

15 weeks, one path

Each week has a set of lessons and one hands-on task. The full curriculum opens once you enroll.

  1. 1
    Week 1No code

    How AI systems work

    What happens between the question and the answer, and why the same input gives different outputs.

  2. 2
    Week 2No code

    The test oracle problem

    When you can’t know the one right answer: pass bars, oracles and what “quality” means for AI.

  3. 3
    Week 3No code

    How AI fails

    Your exploratory-testing instincts, pointed at a new kind of bug.

  4. 4
    Week 4No code

    Test design for AI features

    Risk-based strategy, exploratory charters, metamorphic and back-to-back testing.

  5. 5
    Week 5No code

    Human evaluation as a craft

    Golden datasets, rubrics, labelling guidelines and calibrated raters.

  6. 6
    Week 6

    Data quality and ML basics

    How models are made, and how to test the data they learn from.

  7. 7
    Week 7

    Testing with AI

    Use AI to do your testing work faster, and check its work.

  8. 8
    Week 8Python & SQL start

    Python and SQL for evaluators

    The small amount of code and SQL AI testing needs, with AI as your pair.

  9. 9
    Week 9

    Automated evals and statistics

    Let the machine grade what it can, and know when a difference is real.

  10. 10
    Week 10

    AI as a judge

    Using one AI to grade another, and knowing when not to trust it.

  11. 11
    Week 11

    RAG and search quality

    AI that looks things up: retrieval, citations and poisoned documents.

  12. 12
    Week 12

    Testing agents

    AI that takes actions: end states, trajectories, permissions and attacks.

  13. 13
    Week 13

    Security and safety testing

    Web security basics, the OWASP LLM top 10 as a test plan, leaks, guardrails and a red-team engagement.

  14. 14
    Week 14

    Production and governance

    Latency, cost, monitoring, rollouts, regulation and release reports.

  15. ★
    Week 15Capstone

    Capstone and career

    Prove what you can do end to end, and walk into interviews ready.

Practice

Real AI apps, with real bugs to find

Every app has planted failures for you to hunt down: made-up facts, biased decisions, leaked instructions and more.

  • PePebble & PineAn online shop’s help desk
  • LaLarkspur BankA banking assistant
  • TaTalentSiftAn AI that screens job applications
  • ReReviewlySummarises customer reviews
  • CaCaseCraftWrites test cases for you
  • BrBrightline EnergyAn energy supplier’s help bot, for exploratory testing
  • JuJuniper AirAn airline assistant, for the capstone

Who it’s for

  • ✓You test software by hand today, with little or no coding.
  • ✓You can see AI changing what QA and QE jobs ask for.
  • ✓You want to understand AI testing properly, not just ask a chatbot to write test cases.

QualityAIQ Academy

Skills Record

Your name

From Manual Tester to AI Quality Engineer

Rated area by area, with your work samples and a link for your CV and LinkedIn.

One price, full course

$99

  • ✓15 weeks, self-paced, in English
  • ✓106 narrated lessons with hands-on practice
  • ✓Practice AI apps and in-browser Python
  • ✓Capstone project and launch report
  • ✓Skills Record: a rated, shareable record of your work

In beta testing while the course is finished, so enrollment isn't open yet. Create an account to be ready when it opens.

Sign in or create an account

Questions

Before you start

Do I need to know how to code?+

No. Weeks 1 to 5 need no code at all, and week 6 only asks you to change a few numbers. Python and SQL start in week 8, a little at a time, with AI helping you write it, and it all runs in your browser.

Do I need to install anything?+

No. Lessons, practice apps and Python all run in the browser.

How long does it take?+

Fifteen weeks at your own pace. Each week has two to ten lessons and one hands-on task; most lessons take 20 to 30 minutes.

What do I get at the end?+

A Skills Record instead of a pass badge: a public page with your own link that rates each skill area, shows numbers such as how many of your bug reports were real, and can include your capstone report in your own words. You can add it to your LinkedIn profile in one click.

Is it open now?+

The Academy is in beta testing while the course is finished, so enrollment isn’t open yet. Create an account to be ready when it opens.