Reducing AI Power Usage
This interview gives me some hope that AI will not be the climate disaster that folk think it could be, if we extrapolated the current power and usage trends.
There’s a growing understanding, by folks like Fractile, that two things are at play;
- Datacenter hardware refreshes happen every 3 (sometimes 4) years.
- GPUs are power hungry beasts.
So there’s definitely opportunities for companies to make AI calculation focused hardware, without the GPU components, that perform at much lower power consumption levels.
Now all we need is for developers to lean-in to supporting hardware that’s far less power hungry, even if there’s no performance gain, so the total running costs, and environmental impact, for running AI models stops ominously increasing.