CVEvolve is an autonomous LLM agent system with a zero-code interface that discovers custom data-processing algorithms for scientific imaging tasks (x-ray microscopy registration, Bragg peak detection, diffraction image segmentation). It combines multi-round search with tools for code execution, evaluation, history management, holdout testing, and optional data/visual inspection. The search alternates between discovery (exploring new approaches) and improvement (refining existing ones), using lineage-aware stochastic sampling to balance exploration and exploitation. Across imaging tasks, CVEvolve discovers algorithms that beat baselines, and holdout tracking helps identify candidates that generalize better than later over-optimized ones.
Main takeaways:
- CVEvolve is a zero-code LLM agent harness for autonomous scientific algorithm discovery, targeting domain scientists without coding or image-processing expertise.
- It alternates between discovery (explore new approaches) and improvement (refine existing) actions, with lineage-aware stochastic candidate sampling.
- Tools include code execution, evaluation implementation, history management, holdout testing, and optional data/visual inspection.
- Demonstrated on three scientific imaging tasks: x-ray microscopy registration, Bragg peak detection, and diffraction image segmentation.
- Holdout test tracking helps identify algorithms that generalize better, avoiding over-optimization on the development set.