284
In a first, Google has released data on how much energy an AI prompt uses
(www.technologyreview.com)
This is a most excellent place for technology news and articles.
A flight to Europe's worth of energy is a pretty asinine way to measure this. Is it not?
It's also not that small the number, being ~600 Megawatts of energy.
However, training cost is considerably less than prompting cost. Making your argument incredibly biased.
Similarly, the numbers released by Google seem artificially low, perhaps their TPUs are massively more efficient given they are ASICs. But they did not seem to disclose what model they are using for this measurement, It could be their smallest, least capable and most energy efficient model which would be disingenuous.
A Megawatt is a unit of power not energy. It means nothing without including the duration, like Megawatt-hours