279
In a first, Google has released data on how much energy an AI prompt uses
(www.technologyreview.com)
This is a most excellent place for technology news and articles.
There are zero downsides when mentally associating an energy hog with "1 second of use time of the device that is routinely used for minutes at a time."
https://xkcd.com/1035/
With regard to sugar: when I started counting calories I discovered that the actual amounts of calories in certain foods were not what I intuitively assumed. Some foods turned out to be much less unhealthy than I thought. For example, I can eat almost three pints of ice cream a day and not gain weight (as long as I don't eat anything else). So sometimes instead of eating a normal dinner, I want to eat a whole pint of ice cream and I can do so guilt-free.
Likewise, I use both AI and a microwave, my energy use from AI in a day is apparently less than the energy I use to reheat a cup of tea, so the conclusion that I can use AI however much I want to without significantly affecting my environmental impact is the correct one.
On a "respond to an individual query" level, yeah it's not that much. But prior to response the data center had to be constructed, the entire web had to be scraped, the models trained, the servers continually ran regardless of load. There's also way too many "hidden" queries across the web in general from companies trying to summarize every email or product.
All of that adds to the energy costs. This equivocation is meant to make people feel less bad about the energy impact of using AI, when so much of the cost is in building AI.
Furthermore, that's the median value--the one that falls right in the middle of the quantity of queries. There's a limit to how much less energy a query to the left of the median can use; there's a significantly higher runway to the right of the median for excess energy use. This also only accounted for text queries; images and video generation efforts are gonna use a lot more.
Your points are valid, but I think that building AI has benefits beyond simply enabling people to use that AI. It advances the state of the art and makes even more powerful AI possible. Still, it would be good to know about the amortized cost per query of building the AI in addition to the cost of running it.