Sakana AI 的自我改进模型在求解和判断上变得更强，但无法发现自己的盲点

A single language model improves itself through "Multi-Agent Self-Supervision" (MASS), without external help or a stronger teacher model. The model works as its own team: it assigns tasks to copies of itself, evaluates the results, and optimizes workflows for the next round of training. Win rates against the base model rise to nearly 70 percent after two rounds, but the method carries a real risk: the internal evaluator sometimes accepts flawed steps or manipulated solutions as successes and bakes them into the next model. Sakana AI's MASS method lets one language model improve itself by solving tasks, judging results, and refining workflows without a stronger teacher model. The study finds gains across all three roles, but shared blind spots can let errors pass as progress and feed into the next training cycle. Researchers from Sakana AI and UC Berkeley have introduced "Multi-Agent Self-Supervision" (MASS), a method for recursive self-improvement (RSI). A single language model handles the task, optimizes how the work gets done, and evaluates the results. At the research frontier, even experts often struggle to judge results because verification can require costly supporting evidence or lengthy experiments, the authors argue. A single plasma study can take more than 120 million CPU hours, according to the paper . Ad The model itself may therefore be the best available judge, even though it can miss its own mistakes when reviewing its work. Using the same model to solve, check, and revise can reinforce those errors rather than correct them. Ad Inspired by "Society of Mind," a book by AI pioneer Marvin Minsky, the researchers focus on how the model divides up the work. In MASS, a workflow is text appended to the prompt that defines each sub-agent's role and instructions. A "contract" specifies what information each sub-agent must return and which checks it must perform, while a "hop" sets the order of calls. An orchestrator distributes the work among the sub-agents. When testing a trading strategy against historical prices, for example, the data specialist's contract must ensure the strategy uses only information available at each point in time. Ad During the inner loop, the model's weights stay frozen as the team runs a candidate workflow and the evaluator compares the result against the current "champion." The optimizer uses that feedback to propose the next workflow, mainly by changing contracts and hops. In the outer loop, the champion runs 18 times per task, with the model ranking the results itself and selecting up to 15 runs for training. The researchers remove the workflow text from the orchestrator's initial prompt in the training examples so the model learns to organize work based on the task alone. Specific assignments to sub-agents remain in the recorded traces, and the model takes on all three roles again after LoRA fine-tuning. Ad The base model is Qwen3.6-27B , with Qwen Code as the harness . The researchers use twelve research tasks generated by GPT-5.5 across finance, robotics, and pharmaceuticals, reserving three for testing and nine for training. Only eight yield training data because the search finds no workflow that beats the reference on one training task. Ad