MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

MTIA 300 is Meta's first training chip with built-in NICs and communication offloading. It offloads networking tasks to dedicated chiplets, beating general-purpose GPUs for recommendation model training. Meta co-designed the HCCL communication library alongside the hardware.

Opening Kapyn…