The four panels
- Prompt trace with retrieval sources
- Model routing decisions and fallbacks
- Cost per action, aggregated per agent
- Drift detection against baseline behavior
Alerting
Alert on latency spikes, cost anomalies, guardrail violations. Never alert on volume — that's noise.
Cost target
Under $0.20 per drafted email at scale. Under $2 per meeting booked. Numbers should trend down, not up.