According to a report by The Information, OpenAI has cut inference costs for its AI models by more than half. The company applied the optimizations to ChatGPT, where the number of Nvidia GPUs needed dropped to just a fe…
Compute supply, energy and data-center capacity decide how cheaply AI can run. Infrastructure shifts show up in inference costs weeks later.
Companies and models mentioned in this story — open their pages and live prices
Summaries are aggregated for information only — follow the source link for the full story. Demo entries are illustrative.