ChatGPT Costs a Whopping $700,000/Day to Operate, Says Research
A recent investigation by SemiAnalysis has revealed that maintaining OpenAI's chatbot, ChatGPT, costs as much as $694,444 per day. The system is said to be powered by 3,617 HGX A100 servers with 28,936 GPUs which results in an estimated cost of 0.36 cents per query. However, Dylan Patel, Chief Analyst at SemiAnalysis, believes that the cost to run the programme could be even higher for the recently released GPT-4 version.
The power-guzzling specialized chips are one of the primary reasons for the high costs of maintaining ChatGPT. Microsoft, one of the largest stockholders in OpenAI, is reportedly working on an AI processor called Athena, which may replace NVIDIA GPUs and significantly lower operating expenses.
Despite ChatGPT being able to generate working code from scratch, researchers have raised concerns over its security. Computer scientists Raphael Khoury, Anderson Avila, Jacob Brunelle, and Baba Mamadou Camara have warned about the potential risks of using code produced by the chatbot.
Stay updated with the latest AI-related articles by subscribing to our platform and joining our Telegram and WhatsApp community. Analytics Drift is dedicated to keeping you informed about the latest advancements in Artificial Intelligence, Data Science, Machine Learning, and Deep Learning. As part of our mission to build the largest data science community, we strive to provide engaging content to our readers. Contact us at [email protected] for more information.
