Research1 min read
PatientAgentBench generates a synthetic patient health record, a realistic clinical vignette, and a patient agent that converses with the AI system under evaluation, to capture what a patient-facing agent actually has to do.
By OpenSmartRoute editorial · attributed excerpt
From Amazon Science
PatientAgentBench generates a synthetic patient health record, a realistic clinical vignette, and a patient agent that converses with the AI system under evaluation, to capture what a patient-facing agent actually has to do.
Read the original at Amazon Science: A new benchmark for evaluating patient-facing health AI agents
Source: https://www.amazon.science/blog/a-new-benchmark-for-evaluating-patient-facing-health-ai-agents
Keep reading
Research9 min read
Jennifer Neville discusses how standard benchmarks miss real-world AI failures in a new Microsoft Research Podcast episode.
Research9 min read
Google released a new model that turns search trends and weather data into location fingerprints. These inputs improve disease forecasting without needing custom training.
Research9 min read
Google released a report on privacy and security challenges for autonomous agents using the theory of Contextual Integrity.
