The architecture also includes several other optimizations designed to speed up AI workloads. AMD’s consumer graphics cards, in turn, are geared towards running video games rather than LLMs.

The picture, which we'll reproduce below, seems to have been taken during an AMD presentation, and it clearly shows a diagram of the Navi 31 GPU, which is the biggest RDNA 3 graphics processor.

Navi 31 is expected to be a beast, with up to 15360 Stream Processors, GPU clocks of up to 2.5GHz, and 256-512MB of Infinity Cache (up from 128MB on the Radeon RX 6800, RX 6800 XT and RX 6900 XT).