AI Engineering · 200-level

RAG Quality & Retrieval Evals

AIE-2032 creditselectivebadge: rag-iiprereqs: AIE-202
Start this course — free

Earn the rag-ii credential

What's inside

Sections & lessons

01

Retrieval quality metrics

  • Precision, recall, and rank-position scoringconcept45 min
02

Hybrid search + reranking

  • Combining keyword and vector signals, then reorderingconcept60 min
03

Hallucination & confident wrongness

  • Fluent tone is not evidence of truthconcept60 min
04

Spot-the-fabrication drill

  • Tapping the fabricated answer against the clockconcept90 min
05

Citation grounding & confidence thresholds

  • Refusing to answer below a confidence barconcept60 min
06

Quiz: RAG failure-mode diagnosis

  • Checkpoint on naming the retrieval failure that produced a bad answerconcept30 min
07

Lab + eval-gate: retrieval eval suite

  • Score a RAG system against a golden set (RAG II badge)concept120 min
AI Engineering

Next in this path

Where this specialization goes from here — in (level, code) order.

  • AIE-204

    Structured Outputs & Function Calling

    2 creditselectivebadge: structurer
    Start
  • AIE-205

    Automation & Workflows

    2 creditselectivebadge: automator
    Start
  • AIE-301

    Agent Foundations

    3 creditscorebadge: agent-i
    Start
  • AIE-302

    Multi-Agent Orchestration & HITL

    2 creditselectivebadge: agent-ii
    Start
  • AIE-303

    MCP & Tool Integration

    2 creditselectivebadge: integrator
    Start
  • AIE-304

    AI Security & Red-Teaming

    3 creditselectivebadge: red-teamer
    Start
  • AIE-401

    Evals & Quality Systems

    3 creditscorebadge: evaluator
    Start
  • AIE-402

    LLMOps: Cost, Latency, Observability

    3 creditselectivebadge: operator
    Start

This module ends in a gate you can fail.

That's what makes passing it mean something. Sit Chuun, get placed, and start earning.