According to a report by The Information, OpenAI has cut inference costs for its AI models by more than half. The company applied the optimizations to ChatGPT, where the number of Nvidia GPUs needed dropped to just a few hundred at times.
The article OpenAI reportedly cut response costs for guest ChatGPT users by more than half appeared first on The Decoder.