# A new benchmark for evaluating patient-facing health AI agents

[Amazon](https://yomu.fyi/company/amazon) · Korosh Vatanparvar, Ashutosh Joshi · Jul 29, 2026

**Type:** Benchmark

## Summary

Healthcare AI benchmarks often rely on static medical knowledge questions or clinician-facing tool evaluations, failing to test multiturn patient interactions and clinical workflow execution. To address this gap, PatientAgentBench introduces an automated evaluation pipeline using synthetic patient charts, dual-agent conversations, and an LLM-as-a-jury panel. The evaluation framework applies over one hundred clinician-vetted criteria across six dimensions, including clinical safety, triage quality, and workflow accuracy. Testing frontier models revealed a severity paradox where agents scored higher on obvious emergencies than on routine administrative requests harboring hidden risks. Common safety failures included omitting crisis hotline resources and fabricating clinical information, showing that raw foundation model capability alone cannot guarantee safe patient-facing execution.

## Context

Most healthcare AI benchmarks test static medical knowledge or clinician-oriented tool use rather than evaluating patient-facing agentic conversations. Traditional evaluation rubrics are often static and tied to specific conversations, which limits generalizability and exposes benchmarks to training data contamination.

## Approach / What changed

PatientAgentBench generates synthetic patient records, clinical vignettes, and simulated patient agents that converse with health AI systems interacting with stateful tools across multiple turns. An LLM-as-a-jury panel evaluates conversations using over 100 clinician-vetted criteria across six dimensions: clinical safety, triage quality, workflow accuracy, task completion, clinical helpfulness, and conversational quality. The framework generates scenarios on demand to prevent contamination and uses fully synthetic data.

## Takeaways

- Frontier models exhibited a severity paradox where agents performed better on overt emergencies than on routine administrative requests that masked clinical risks.
- Prominent agent safety failures included crisis resource omission during suicidal ideation and clinical-information fabrication, such as inventing provider credentials or claiming unexecuted tool runs.
- The automated LLM-as-a-jury panel aligned with licensed clinician annotations while maintaining a conservative bias toward safety-critical dimensions.

**Tags:** [LLMs](https://yomu.fyi/topic/llm), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Testing](https://yomu.fyi/topic/testing)

[Read original post](https://www.amazon.science/blog/a-new-benchmark-for-evaluating-patient-facing-health-ai-agents)