Back to projects

AI / MLShipped2025

RAG Study Assistant

A Retrieval-Augmented Generation system answering student questions with context-aware, pedagogy-aligned responses.

3,000+
Students served
+40%
Relevance gain
-35%
Repetitive questions

Timeline

Jan 2025 to Jun 2025

Role

Full-stack and retrieval design

Team

Solo, with 2 faculty advisors

Status

Shipped

Stack

PythonTransformersSemantic SearchVector DBReact

Source

Section 01

Overview

Instructors answer the same questions over and over: assignment scope, deadline rules, concepts already covered in lecture. Built during my research assistantship at TRU, this system answers those questions automatically, and answers them the way an instructor would.

It is a Retrieval-Augmented Generation (RAG) pipeline grounded in course material. Every response cites the source it retrieved from, and the tone follows the pedagogy of the course rather than generic chatbot phrasing.

FIG. 01 · Student query view with cited sources
Screenshot coming soon

Section 02

The Problem

Generic LLM chatbots fail in a classroom for two reasons: they hallucinate answers that contradict the course material, and they hand students full solutions when the instructor wants guided hints.

The goal was a system that stays grounded in the actual course content and respects how instructors want students to learn.

  • Answers must come from course material, not model memory
  • Responses follow pedagogy: hints and scaffolding before solutions
  • Must scale to thousands of students without instructor babysitting

Section 03

Architecture

Course documents are chunked and embedded into a vector index. At query time, semantic search retrieves candidate passages, a transformer-based re-ranker orders them, and the generator composes a response constrained to the retrieved context.

A pedagogy layer sits on top: prompts are templated per course policy, so a first-year programming course gives hints while a research seminar gives direct references.

FIG. 02 · Pipeline: ingest, embed, retrieve, re-rank, generate
Screenshot coming soon
FIG. 03 · Pedagogy templates per course policy
Screenshot coming soon

Section 04

Evaluation

Retrieval quality was measured against a hand-labeled set of real student questions. Integrating semantic search with transformer-based retrieval improved response relevance by 40% over the keyword baseline.

Instructor feedback loops flagged weak answers, and those flags fed directly back into chunking and re-ranking improvements.

Section 05

Results

The system scaled to 3,000+ students, and repetitive instructor questions dropped by 35%. Office hours shifted from restating logistics to actual teaching.

  • 3,000+ students served across courses
  • 40% improvement in response relevance
  • 35% reduction in repetitive instructor questions