593
UK government trial of Microsoft's M365 Copilot finds no clear productivity boost
(www.theregister.com)
this post was submitted on 05 Sep 2025
593 points (99.3% liked)
Technology
74831 readers
2946 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
From reading the study, it seems like the workers didn't even use it. Less than 2 queries per day? A third of participants used it once per week?
This is a study of resistance to change or of malicious compliance. Or maybe it's a study of how people react when you're obviously trying to take their jobs.
I don't think it's people being resistant to change I think it's people understanding the technology isn't useful. The tagline explains it best.
It's a gimmick, not a fully fleshed out productivity tool, of course no one uses it. That's like complaining that no one uses MS paint for the production of a high quality graphics.
Absolutely, and it's a massive and undeserved cash cow for AI companies (e.g. Sam "Sister-Lovin'" Altman).
AI is never an investment for businesses or individual users. It's a bloated and unfulfillable promise that just makes users dumb, dependant, and destroys the very environment we need to survive.
It also produces bad products (it's easy to tell which devs use it from reviewing poor quality code).
Not to mention the centralisation of power with the rich who are the problem in this world.
The figures are the averages for the full trial period.
So it’s possible they were making more queries at the start of the trial, but then mostly stopped when if they found using Copilot was more a hindrance than a help.
I have a Copilot license at work. We also have an in house „ChatGPT clone“ - basically a private deployment of that model so that (hopefully) no input data gets used to train the models.
There are some usecases that are neat. E.g. we’re a multilingual team, so having it transcribe, translate (and summarize) a meeting so that it’s easier to finalize and check a protocol. Coming back from a vacation and just ask it summarize everything you missed for a specific area of your work (to get on track before just checking everything chronologically) can be nice, too.
Also we finetuned a model to assist us in writing and explaining code from a domain specific language with many strange quirks that we use for a tool and that has poor support from off the shelf LLMs.
But all of these cases have one thing in common: They do not replace the actual work and are things that will be checked anyways (even the code one, as we know there are still many flaws, but it’s usually great at explaining the code now - not so at writing it). It’s just a convenient method to check your own work - and LLM hallucinations will usually be caught anyway.
I think the issue is that there's usually competing targets here. From the top they wanted to see use of copilot. But direct reports likely expected the same performance.
So are you going to a) do it the way you've done it for 10 years and know will deliver on time or b) ask hal9000 for help potentially actually slowing you down, at least initially.
I think there's gains to be made for some jobs in some cases with ai. But most people probably just got on with their work.