Groq Raises $350M to Accelerate Pivot from LPU Hardware Sales to AI Inference Neocloud
Groq, the AI hardware startup known for its high-speed Language Processing Unit (LPU) silicon, has closed a $350 million funding round. The fresh capital will fund the expansion of GroqCloud, marking a strategic shift from selling physical server racks toward operating an on-demand inference neocloud.
Get Tech Pulse Daily in Your Inbox
Join 45,000+ engineers, founders, and tech leaders receiving high-signal daily breakdowns directly from major publishers.
Zero spam. Unsubscribe anytime in one click.
Groq's deterministic architecture delivers inference speeds exceeding 500 tokens per second for popular open-weight models like Llama 3, giving developer teams near-instantaneous API response times for conversational AI applications.
With the new funds, Groq plans to deploy tens of thousands of custom LPU cards across data centers in North America and Europe to compete directly with Nvidia cloud partners.