OpenAI has reportedly more than halved the cost of running some ChatGPT requests, and it did so without buying a single new chip. According to The Information, a software optimization has reduced the number of Nvidia GPUs needed for parts of ChatGPT traffic to just a few hundred at certain times, a surprisingly small figure […]
