Vidraft claims its VKAE system can speed up inference of large language models by as much as 23 times on existing GPUs-no server upgrades or additional hardware needed. The company demonstrated this performance on Nvidia’s B200 accelerator. Unlike typical announcements, Vidraft says anyone can replicate these results using a ready-to-run container that includes the model […]
