I would pay extra to be able to run open LLM’s locally on Linux. I wouldn’t pay for Microsoft’s Copilot stuff that’s shoehorned into every interface imaginable while also causing privacy and security issues. The context matters.
That’s why NPU’s are actually a good thing. The ability to run LLM local instead of sending everything to Microsoft/Open AI for data mining will be great.
I hate to be that guy, but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it, in the form of “diagnostic data” or “usage telemetry” or whatever weasel-worded bullshit in the terms of service?’
They’ll just send the results for “quality assurance” instead of doing the math themselves and save a bundle on server hosting.
All your unattended date will be taken (and some of the attended one). This doesn’t mean you should stop to attend your data.
Even of you’re somehow forced to use Windows instead open alternative, it doesn’t mean you can’t dual boot or use other privacy conscious devices when dealing with your sensitive data.
Closed/proprietary OS and hardware driver can’t be considered safe by design)
I would pay extra to be able to run open LLM’s locally on Linux. I wouldn’t pay for Microsoft’s Copilot stuff that’s shoehorned into every interface imaginable while also causing privacy and security issues. The context matters.
That’s why NPU’s are actually a good thing. The ability to run LLM local instead of sending everything to Microsoft/Open AI for data mining will be great.
I hate to be that guy, but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it, in the form of “diagnostic data” or “usage telemetry” or whatever weasel-worded bullshit in the terms of service?’
They’ll just send the results for “quality assurance” instead of doing the math themselves and save a bundle on server hosting.
Yes, obviously, especially if you are running all open source software.
All your unattended date will be taken (and some of the attended one). This doesn’t mean you should stop to attend your data. Even of you’re somehow forced to use Windows instead open alternative, it doesn’t mean you can’t dual boot or use other privacy conscious devices when dealing with your sensitive data.
Closed/proprietary OS and hardware driver can’t be considered safe by design)
I replied to the person above “locally on Linux”.
Even in Windows, local queries give the possibility of control. Set your firewall and it cannot leak.