ADK-105Axalon Original
Evaluation & Optimization
Taught by Dan King, 4x Google Trainer of the Year
1 dayILTAdvancedLoading...
Evaluation1 DayOptimization
Public class policy: Classes run with a minimum of 6 participants. If minimum enrollment isn't reached, you'll be notified 7 days before with options to transfer or receive a full refund.
Overview
Quantify agent quality and optimize performance. Day 1: Evaluation frameworks—trajectory analysis, RAGAS, golden dataset creation. Day 2: Performance testing with Locust, model cascading, and cost optimization.
What You'll Learn
- Implement Evaluation-Driven Development (EDD)
- Build trajectory analysis pipelines
- Create golden datasets using structured templates
- Run load tests with Locust for conversational agents
- Implement model cascading for cost optimization
- Analyze and reduce agent operational costs
Who Should Attend
Completed ADK-104. Teams optimizing production agents.
Products Covered
ADKBigQueryVertex AI EvaluationCloud Monitoring
Course Modules
1
Day 1: Evaluation Frameworks
Topics
- Evaluation-Driven Development (EDD)
- Trajectory analysis
- RAGAS methodology
- Golden dataset creation
- Structured dataset templates
Learning Outcomes
- Implement EDD in agent development
- Build trajectory analysis pipelines
- Create golden datasets using templates
Activities
Theory (45min)Lab: Evaluating Agents with ADKLab: BigQuery Agent EvaluationLab: Analytics PluginWorkshop: Create golden dataset (1.5hr)
2
Day 2: Performance & Cost
Topics
- Load testing conversational agents
- Locust for agent testing
- Model cascading strategies
- Context caching
- Cost optimization analysis
Learning Outcomes
- Run load tests with Locust
- Implement model cascading
- Analyze and reduce agent costs
Activities
Theory (30min)Lab: Locust Load TestingLab: Model CascadingLab: Cost OptimizationWorkshop: Load test and optimize (2hr)
Get This Training
No public classes currently scheduled. Express interest below or request private training.
Course Details
- Course Code
- ADK-105
- Duration
- 1 day
- Format
- ILT
- Level
- Advanced
- Price
- Loading...
Questions About This Course?
Contact us for custom scheduling, group discounts, or curriculum customization.
Contact UsStarting fromLoading...