The authors built CPEMH, a system that uses multiple AI agents working together to automatically design, test, and choose prompts for mental-health screening tasks. Instead of manually tweaking prompts and hoping they work reliably, the framework orchestrates three specialized agents—one to coordinate, one to run inference, and one to evaluate—ensuring that prompt-driven behavior is stable and auditable. They tested it on depression screening from interview transcripts and found that modular orchestration helps keep foundation-model behavior predictable in sensitive clinical settings.
Main takeaways:
- Uses an "agentic" architecture where separate agents design prompts, run them, and measure their performance, all coordinated automatically.
- Focuses on behavioral assurance: making sure the model's responses are stable and traceable across different contexts, not just accurate once.
- Case study on depression screening shows the framework can stabilize model behavior in conversational clinical domains.
- Emphasizes simplicity over complexity—stability matters more than fancy architecture—and tracks F1, bias, and robustness as acceptance criteria.
- Provides an engineering methodology for controlling prompt-driven variability in foundation models applied to real-world sensitive tasks.