Back to catalog / Agent workflows
Diagnose recurring defects in production agent answers
Find recurring defects in agent conversations stored in BigQuery and produce evidence-backed improvement leads.
Goal
Find recurring defects in agent conversations stored in BigQuery and produce evidence-backed improvement leads.
Steps
- Select the big_query, cloud_ops, or cloud_logging telemetry source and time range. [source-google-diagnose-recurring-agent-quality-defects]
- Evaluate conversations, cluster recurring defects, and retain trace examples and counts. [source-google-diagnose-recurring-agent-quality-defects]
- Confirm defects manually and open improvement work; do not let the diagnostic agent alter live policy. [source-google-diagnose-recurring-agent-quality-defects]
How to verify
Match defect-cluster sample IDs, versions, and counts to the BigQuery conversations; spot-check every cited conversation behind a recommendation.
Troubleshooting
If a cluster mixes different failures, inspect the grouping fields and time window; if a recommendation lacks trace evidence, return to raw sessions and label it a hypothesis.
Permissions
Prerequisites
- ADK telemetry/BigQuery dataset, read-only analytics access, and AQuA test environment; scope to one tenant.
Permissions
- Requires read access to approved BigQuery conversation/evaluation tables and model API calls; no permission to edit conversations or manage production agents is needed.
Limitations
Run the source on isolated test data, then check outputs and dependency versions before adapting it.
Pinned upstream source
- Repository
- google/adk-samples
- File path
- core/python/ambient-quality-agent/README.md
- Pinned commit
9252494a7aaafca8fe4d81a04f15392345a5779b- Source checked
- 2026-10-14 · Reviewed against the pinned upstream source
Repository metrics
These values describe the upstream repository, not popularity or likes for an individual skill or playbook.
- Stars
- Not collected
- Forks
- Not collected
- Observed at
- Not collected
No metrics snapshot is available yet.
License: Apache-2.0
Main topic
Turn ecommerce campaign materials into a reviewable weekly brief