Explainers: Groq

Groq AI and its LPU: what the inference chip does

Groq built the LPU, an inference chip that keeps model weights in on-chip SRAM, and runs it as the GroqCloud service.