Discussion about this post

User's avatar
Winfried Theis's avatar

I believe we might see a bit of an overshoot just now, mainly because hyperscalers seized the opportunity of the big hype faster and with more political support. In the long run my question was from the start, where will the majority of AI use land? The answer was to me from the very beginning: in devices at the edge. And therefore inference has to move from a data centre onto a local and in most cases mobile device. This is for safety, security and convenience the right place. To enable this companies like Apple, Samsung, Xiaomi, and the likes will be looking to reach efficiencies that do not diminish battery life, and it seems like Apple is already well under way with the architecture of their Mac Pros and the shared memory setup.

As you rightly say, the use of AI will increase and also the number of data centres will increase and thereby the electricity consumed by them. But only the AI training labs will be the places of the gigantic power consumption and therefore pose real issues and threats to local grids.

No posts

Ready for more?