Active sources: 7. Sources represented in this queue: 1. The cron runs daily at 06:00 server time; arxiv RSS is often empty on weekends.
Methods
- score 38M7 QA inline RSS threat sourceunread
Artifact verification caveats for Sagan clean results
M7 QA · No release date
This paper studies failure modes and caveats when Sagan creates a clean result only after verifying an artifact row. It proposes benchmark checks for artifact verification, clean-result review comments, and negative controls.
Several of my clean results carry explicit confidence caveats (single seed, LOW/MODERATE confidence, eval contamination flags) that this document's proposed benchmark checks and negative-control requirements are directly designed to catch — making it a process-level resource for how I should treat and communicate those results.
This paper studies failure modes and caveats when Sagan creates a clean result only after verifying an artifact row. It proposes benchmark checks for artifact verification, clean-result review comments, and negative controls.
Potential threat/caveat for experiment "Add C2 control arm (donor sees marker_B without marker_A) to disambiguate paired-marker binding from marker_B leaking alone": this item discusses failure, caveat, caveats, negative, benchmark.