Poolside AI's co-CEO details the training of Laguna S, an 118B mixture-of-experts model outperforming a 1T open-weights competitor. The company relies on a specialized model factory architecture, enabling its lean research team to outpace massive open-source efforts. This development highlights shifting efficiencies in frontier model training, showing that specialized architectures can rival raw scale.
Opening Kapyn…