Groq, a startup creating chips to run generative AI fashions quicker than typical {hardware}, has an eye fixed towards the enterprise — and public sector.
In the present day, Groq introduced that it’s forming a brand new division — Groq Programs — targeted on drastically increasing its buyer and developer ecosystem. Inside Groq Programs’ purview is serving organizations, together with authorities companies, that want to add Groq’s chips to present information facilities or construct new information facilities utilizing Groq processors.
In forming the brand new unit, Groq has acquired Definitive Intelligence, a Palo Alto–primarily based agency providing a variety of business-oriented AI options, together with chatbots, information analytics instruments and documentation builders. Definitive Intelligence CEO Sunny Madra is now main GroqCloud, Groq’s cloud platform that gives Groq {hardware} documentation, code samples and self-serve API entry to the corporate’s cloud-hosted accelerators.
“At Groq, we’re dedicated to creating an AI economic system that’s accessible and reasonably priced for anybody with an excellent concept,” Groq co-founder and CEO Jonathan Ross stated in a press launch. “We’re excited to welcome Sunny and his workforce from Definitive Intelligence to assist us obtain this mission … The Definitive workforce has experience in AI options and go-to-market methods, in addition to a confirmed dedication to sharing data with the neighborhood.”
Madra co-founded Definitive Intelligence in 2022 with Gavin Sherry, ex-director of engineering at EMC. Previous to launching Definitive Intelligence, Madra and Sherry co-launched Autonomic, a cloud-based platform for connecting mobility techniques that Ford acquired in 2018.
Definitive Intelligence gives a number of business-oriented GenAI merchandise, together with OpenAssistants (a group of open supply libraries for creating AI chatbots) and Advisor (a visualization generator that connects to each enterprise and public databases). Considered one of Definitive’s premier instruments is Pioneer, an “autonomous information science agent” designed to deal with varied information analytics duties, together with predictive modeling.
Previous to the acquisition, Definitive Intelligence had raised $25.5 million in enterprise capital.
“The world is simply now realizing how necessary high-speed inference is to generative AI,” Madra stated in an emailed assertion. “At Groq, we’re giving builders the velocity, low latency, and effectivity they should ship on the generative AI promise. I’ve been a giant fan of Groq since I first met Jonathan in 2016 and I’m thrilled to affix him and the Groq workforce of their quest to carry the quickest inference engine to the world.”
Groq, which emerged from stealth in 2016, is creating what it calls an LPU (language processing unit) inference engine. The corporate claims that its LPU can run present giant language fashions related in structure to OpenAI’s ChatGPT and GPT-4 at 10x the velocity.
Ross’ declare to fame helps to invent the tensor processing unit (TPU), Google’s customized AI accelerator chip used to coach and run fashions.
Definitive Intelligence is Groq’s second acquisition after Maxeler Applied sciences, a high-performance compute and AI infrastructure options agency, in 2022. It won’t be its final. The marketplace for customized AI chips is a extremely aggressive one, and — to the extent the Definitive buy telegraphs Groq’s plans — Groq is clearly intent on establishing a foothold earlier than its rivals have an opportunity.
