Introduction to AI Evals | San Francisco
Date: June 11th, 2025 4:00 p.m. - 6:00 p.m. PT
Location: USF Campus, 2130 Fulton Street, McLaren 200, San Francisco CA 94117 Room MC 251
Join our interactive AI Evaluations Workshop to learn practical skills in evaluating large language models (LLMs) and AI agents!
We’ll cover key concepts including using LLM APIs, understanding jailbreaks, why evaluations (evals) are essential yet challenging, and insights from Anthropics “Alignment Faking Paper”. The session features live coding exercises based on the ARENA materials (section 3.1), using Python and Jupyter notebooks.
Prior Python experience is required. Ideal for AI practitioners, researchers, or enthusiasts looking to deepen their understanding of AI safety and evaluations.
RSVP: