What they label "AI" is basically a bunch of specialized cores with very limited functionality but able to operate at higher speeds than a real processor. Intel has included it, a number of ARM processors include it, and now AMD has jumped in. Many of them only operate on 8-bit numbers but are able to perform trillions of operations per second. (I think the Ryzen AIs can do 40-50 TOPS.)
This can be used for something like a very limited LLM, but is more often used for things like visual recognition.
o0shad0o 1 points 21 hours ago
What they label "AI" is basically a bunch of specialized cores with very limited functionality but able to operate at higher speeds than a real processor. Intel has included it, a number of ARM processors include it, and now AMD has jumped in. Many of them only operate on 8-bit numbers but are able to perform trillions of operations per second. (I think the Ryzen AIs can do 40-50 TOPS.)
This can be used for something like a very limited LLM, but is more often used for things like visual recognition.