696
AI boom could falter without wider adoption, Microsoft chief Satya Nadella warns
(www.irishtimes.com)
This is a most excellent place for technology news and articles.
Nadella maybe knows a lot more than any of us about LLMs/GenAI tech, but one doesn't need to know anything about LLMs (or even technology) to know that an oligarch like Nadella cannot be trusted (in any context).
I'm kind of more-sympathetic to Microsoft than to some of the other companies involved.
Microsoft is trying to leverage the Windows platform that they control to do local LLM use. I'm not at all sure that there's actually enough memory out there to do that, or that it's cost-effective to put a ton of memory and compute capacity in everyone's home rather than time-sharing hardware in datacenters. Nor am I sold that laptops
which many "Copilot PCs" are
are a fantastic place to be doing a lot of heavyweight parallel compute.
But...from a privacy standpoint, I kind of would like local LLMs to be at least available, even if they aren't as affordable as cloud-based stuff. And at least Microsoft is at least supporting that route. A lot of companies are going to be oriented towards just doing AI stuff in the cloud.
Is that true? I haven’t heard MS say anything about enabling local LLMs. Genuinely curious and would like to know more.
Isn't that the whole shtick of the AI PCs no one wanted? Like, isn't there some kind of non-GPU co-processor that runs the local models more efficiently than the CPU?
I don't really want local LLMs but I won't begrudge those who do. Still, I wouldn't trust any proprietary system's local LLMs to not feed back personal info for "product improvement" (which for AI is your data to train on).
NPU neural processing unit