multi-agent

  • 25th June 2026

Does a multi-agent panel beat a single LLM at evolutionary code search? (We tested it. No.)

We replaced the single-LLM mutation step of an AlphaEvolve-style evolve loop (OpenEvolve) with a proposer→critic→aggregator panel and tested it rigorously across three problems. It never won — equal on easy optimization, significantly worse on hard optimization (p=0.01), and on correctness-gated ARC it cracked nothing a single call couldn’t. A clean negative result, with the baseline/ablation harness that makes it trustworthy.

Read more