Machine Learning | Accelerated Computation | Artificial IntelligenceAn evaluation of the main items of laptop {hardware} used to run AI, together with a brand new heavy hitter.“Coordination Deconstructed” By Daniel Warfield utilizing MidJourney. All photos by the writer except in any other case specified. All generated photos made with MidJourney.This article discusses Groq, a brand new strategy to laptop {hardware} that’s revolutionizing the approach AI is utilized to actual world issues.Before we speak about Groq, we’ll break down what AI basically is, and discover some of the key elements of laptop {hardware} used to run AI fashions. Namely; CPUs, GPUs, and TPUs. We’ll discover these vital items of {hardware} by beginning in 1975 with the Z80 CPU, then we’ll construct up our understanding to fashionable methods by exploring some of the vital evolutions in laptop {hardware}.Armed with an understanding of some of the basic ideas and tradeoffs in laptop {hardware}, we’ll use that understanding to discover what Groq is, the way it’s revolutionizing the approach AI computation is finished, and why that issues.Naturally there’s so much to cowl between early CPUs and a leading edge billion greenback AI startup. Thus, this can be a fairly lengthy article. Buckle up, it’ll be price it.Real time recording of me speaking with Mixtral 8x7b, an open supply giant language mannequin, hosted on Groq {hardware}. As you possibly can see, Groq is succesful of remarkably quick responses, even with very giant language fashions. You can chat with Groq right here.Who is this handy for? Anyone all in favour of synthetic intelligence, and the realities of what it takes to run AI fashions.How superior is that this submit? This submit comprises leading edge concepts from a leading edge AI startup, and explains them assuming no prior data. It’s related to readers of all ranges.Pre-requisites: None, however there’s a curated listing of assets at the finish of the article for associated studying.Disclaimer 1: this text isn’t about Elon Musk’s chat mannequin “Grok”. Groq and Grok are fully unrelated, in addition to the indisputable fact that their names are primarily based on the similar e book.Disclaimer 2: During the time of writing I’m not affiliated with Groq in any approach. All opinions are my very own and are unsponsored. Also, thanks to the…
https://towardsdatascience.com/groq-intuitively-and-exhaustively-explained-01e3fcd727ab
Groq, and the Hardware of AI — Intuitively and Exhaustively Explained | by Daniel Warfield | Apr, 2024
