AMD admits its Instinct MI300X AI accelerator still can’t quite beat Nvidia’s H100 Hopper [TechSpot]

On Wednesday, AMD released benchmarks comparing the performance of its MI300X with Nvidia’s H100 GPU to showcase its Gen AI inference capabilities. For the LLama2-70B model, a system with eight Instinct MI300X processors reached a throughput of 21,028 tokens per second in server mode and 23,514 tokens per second in…Read Entire Article