Amazon and Datadog Put Journey-Level Observability on QA’s Radar
Amazon and Datadog are nudging QA toward journey-level scoring, where live user and agent flows help teams prioritize the tests that matter most.
What is this trend?
Journey-level observability is pushing QA to score real user and agent flows by tracing logs, metrics, and outcomes so teams can focus testing on the journeys most likely to fail.
- Amazon is tying traces, logs, metrics, and evaluators to live agent quality scoring.
- Datadog is inferring critical user journeys from real traffic and surfacing high-risk paths.
- QA focus is shifting from broad coverage to login, onboarding, checkout, and other revenue flows.
- Observability is becoming a decision aid for prioritizing tests, not just diagnosing incidents.
- The signal is early, but live journey data is now shaping where QA scrutiny lands.
What’s the latest?
Amazon’s “Amazon Unifies AI Agent Observability and Evaluation” is the clearest signal this week: it combines distributed tracing, automated quality scoring, curated datasets, and experiment workflows
How it developed
Go deeper
Curated long-form picks on this trend — podcasts, videos, and analysis, by seniority.
If you're an individual contributor
Perforce Delphix Synthetic Data for AI software testing
Analysis of AI-generated synthetic test data in core QA workflows, preserving integrity for release readiness scoring.
App Developer Magazine · News
Read →How Atlassian built a scalable synthetic data engine - Inside Atlassian
Case study on building a scalable synthetic data engine to score release readiness in core QA workflows.
Atlassian · News
Read →Introducing run-assert-eval: Find the risk, fix it, prove it
Promotion news item on run-assert-eval: release readiness scoring with synthetic tests for AI agent QA workflows.
Microsoft · News
Read →If you lead the organization
Perforce Delphix Launches AI-Native Synthetic Data Solution
Promotion news on AI-native synthetic test data for release readiness scoring and core QA workflows.
AiThority · News
Read →Capital One’s agentic AI strategy hinges on data, platform-first mindset
Explainer interview with Rashmi Shetty on Capital One’s platform-first, governed data approach to agentic AI.
CIO Dive · News
Read →Managing regulatory data across 150+ systems
Promotion featuring Sanyam Kaushik on managing regulatory data across 150+ systems with QA-ready synthetic comparisons.
QA Financial · News
Read →