Groq Chat
An LPU inference engine
Start new thread
Chris Messina

Groq® - Hyperfast LLM running on custom built GPUs

by
Raycast
•
An LPU Inference Engine, with LPU standing for Language Processing Unit™, is a new type of end-to-end processing unit system that provides the fastest inference at ~500 tokens/second.

Add a comment

Replies

Best
Avi Basnet
This seems extremely interesting- I’m curious what you’ve seen to be the biggest use case for this LLM?
Johan Steneros
It is fast, that is for sure. Where can I get more information about the chips and hardware? Is there a GPU cloud service?
Johan Steneros
@amrutha_killada1 oh, thank you. Will dig in.
Peter Schout
Congratulations! speed/accuracy is incredible, no wonder NVDA took a dip 😯
Cuong Vu
Groq is a promising product, and I believe your detailed insights could attract even more supporters, helping people better understand its value.
Ian Nance
Man, that IS fast...Already loving it : )
Borja Soler
Videotok
this will be incredible for the future of LLMs and all the products benefiting from them. super excited with all the new things that will come
Kien Nguyen
Congrat on the launch? Do you have any plan when to support custom training?
Ivan Somov
Avatars by Studio Neiro AI
Good luck! I am really excited about this hardware stuff for LLMs!
Abhilash Chowdhary
Crustdata
Going to give this a try, team Groq®. Looks interesting.
Sourabh
Don't know why its ranked so low as of now, the speed is awesome. It does what it says.
12
Next
Last