How Sakana AI’s new evolutionary algorithm builds powerful AI models without expensive retraining

Sakana AI introduces M2N2 (Model Merging of Natural Niches), an evolutionary algorithm that combines multiple specialized AI models into powerful multi-skilled systems without expensive retraining. The technique uses flexible parameter mixing, diversity-based competition, and complementary model pairing to create models that outperform traditional merging methods. M2N2 has been successfully tested on image classifiers, large language models, and text-to-image generators, demonstrating its ability to create hybrid capabilities and even emergent bilingual abilities.