Thanks for smoking out more people to block.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
This article is a perfect example of how legitimate research gets turned into sensationalist nonsense, and the post on Lemmy is making it worse.
The study involved 1,222 participants across three experiments. Researchers had people use AI to help with math and reading comprehension, then tested them when that assistance was removed. They found that participants were more likely to struggle with accuracy and persistence when they had to work independently.
That's an interesting finding. It's worth discussing.
But this whole fixation on "just 10 minutes" is ridiculous. Ten minutes of AI use under specific experimental conditions does not mean that ten minutes of ChatGPT permanently damages your brain or destroys your ability to think for yourself. The study did not demonstrate that.
There's a pretty significant difference between showing that people can become reliant on assistance and struggle when that assistance is suddenly taken away, and claiming that AI use fundamentally erodes your cognitive abilities. One is an experimental finding. The other is an exaggeration of what that finding actually means.
And this is where I have a problem with the article and the way it's being presented on Lemmy. The actual research is interesting enough without having to dress it up in sensationalist headlines. If the point is that people need to struggle with difficult problems to develop their skills, then make that argument. It's a perfectly reasonable one.
But "using AI for 10 minutes erodes your ability to persist at hard things" is a hell of a lot more dramatic than what the research actually establishes.
There's a difference between reporting scientific findings and manufacturing a narrative around them. We should be capable of discussing the potential downsides of AI without resorting to clickbait and misrepresenting what the research actually says.
"Students who cheat on their homework don't learn as much" is a better headline.
"Using a compiler for ten minutes erodes your ability to write raw machine code"
This is... Unfortunately completely true. ☹️
Thank you! This makes me think maybe our brains reward themselves for finding easier ways to do something and LLMs become just that sometimes. But at the same time atrophying our existing skill. We need brain gyms like we do physical gyms.
Forgive me, but i’m not understanding why you find the headline to sensationalize or over state the actual findings of the study. The abstract of the paper directly says:
we provide causal evidence for two key consequences of AI assistance: reduced persistence and impairment of unassisted performance.
I’m struggling to discern a meaningful difference between “erodes your ability to persist at hard things” and “reduced persistence of unassisted performance”. Forgive me for not understanding but I would appreciate your explanation. The paper's very own conclusion actually uses the term erosion:
Here, we show that AI interaction can result in significant impairments in independent performance and persistence – capacities that are foundational to life-long learning. If brief exposure produces measurable erosion, the cumulative effects of daily AI use over months or years may be profound and difficult to reverse
I found a definition of erosion: "the gradual loss of something as a result of an ongoing process". Trust can erode and be rebuilt; soil can erode and be restored.
I agree that 10 mins of foundation model assistance likely doesn’t “permanently damage your brain or destroy your ability to think for yourself”. However, in my reading of the Berkeley news piece, I find no claim of this specific kind. Does the text of the press release explicitly claim the duration of effect is long-term or lasting? Does it explicitly claim the the erosion is permanent? Again, I find myself confused what you are arguing against.
It depends on what you're doing. I deal with lots of data entry and when there are corrections to be made, I had to scour through troves of information which could also cause data entry error when i am going through with it. In other words, it's "secretary work". AI had been helpful on that front to minimise the tedious work that does not add value or improve productivity.
AI is only good at secretary work. But for tasks that require critical thinking and analysis and creativity, don't rely on AI.
Man getting people to listen to me when I essentially talk about the same thing you brought up is impossible. It is great for these kinds of things but I just get shouted down by all of the "AI bad no matter what" people.
For something that uses immeasurable amounts of stolen data to be trained on and function, without credit or compensation, and breaks so many laws I can't list them, I think it's pretty unethical to use. Or something that burns immeasurable amounts of potable water and electricity to function at all, I think its pretty unethical. For something that artificially generates scarcity for chips we desperately need, I think it's unethical. For something that authoritarian governments are lapping up as a form of propaganda, disinformation, misinformation, surveillance, I think its pretty damn unethical. All so people can write an email 10 seconds faster, in a tone that's not yours, to be sent to a AI to answer that email. For the people who say "I think it can be used for good" or "it's just a tool!" What kind of tool sacrifices so much of which we take for granted? Are these things not important to you? Look at that list again! Fuck, look around, your silly chatbot is not changing the world in the way you want. Maybe you get some minor benefit from your chatbot, but the world shifts further to a dystopian shithole for your marginal gains.
Say you're in the desert and miraculously you found a glass of water, but it is filled with shit particles. Ya, it's a glass of water, but it's filled with shit. And you're out here thinking to yourself "hmm, there's water here, and I can drink it. So what if it's filled with shit? I can use it." #fuckai
I've come to realisation that since many Lemmy users are IT workers, they feel resentful in training AI to replace them. Many had been laid off after all since the (irrational exuberant) coming of AI. That's why I don't begrudge many Lemmings hating AI as something that could never do anything good. I'm lucky enough that my work isn't going to be replaced by AI. But for how long?
I don't use LLMs (especially now during nosloptober), but I'm also trying to apply this to web searching. Like instead of doing a search for "how many minutes in a month" I'll realise I have all the tools and information to figure it out and just do that.
Or checking with a local manual before searching online
I remember the times before search engines. I used to have to wait for the weekends and walk 40 minutes to the library to look stuff up if I had questions. I remember how I even though encyclopedia britannica being available online was revolutionary and I spent hours reading just because I finally had access from home. It felt like it wouldn't always be there, so I tried to read as much as possible so I would just know stuff. I'm kinda nostalgic for it and where I live now, the library is only a few blocks away. You've inspired me to try to recreate that a bit.
Also, correlation does not equal causation. So the title is attributing AI to eroding your ability to persist, when in reality there was no prior test to ensure the individual could do the task at all. Which is almost like what they're proving is that AI gives people the ability to do things they otherwise would not be able to do with out it.
Giving someone a tool to start and then taking the tool away mid task isn't a good way to study the impact of the tool.
when in reality there was no prior test to ensure the individual could do the task at all
Why would such a test be needed? I presume the researchers did the reasonable thing and assigned the participants to the two groups randomly.
I was going to argue against this, but i don't feel like doing the research myself.
LLMs are a competency chipper and credibility solvent.
My observation from having to deal with entities which have engaged with LLMs, is any competency or credibility they may have had, is eroded proportionally to their level of exposure. It's analogous to experiencing a traumatic brain injury.
Losing cognitive ability is bad enough, but it's devastating when they never possessed it to begin with.
You're offloading your thought to an LLM there is no way you don't come out a bit dumber.
I've been using LLMs with a project that I simply don't have enough time for. I've built the core of it during most of last year. And in the past 6 months or so I've been using LLMs to help me out with some of the more tedious stuff. Half the time it doesn't quite get it right, and some of that time it's just flat out wrong. It's usually when I get the LLM to try to hunt down some bug or something. After a couple tries, I give up on the LLM and figure out the problem myself.
I genuinely don't believe this "offloading your thoughts to an LLM" idea is universal. For someone still in school and learning? Probably 100% true. But for someone established in a skill, I don't think it's true, at least not entirely.
It is so sad that people always look for shorter means to a problem solution, I understand it is coded in our DNA to exhaust the least but over the long term it looks increasingly worrying.
Surely if I offload work tasks onto someone else then I would achieve the same effect? I don't think this is AI exclusive.
dont need a new study, 1 study already said people using AI during HS or COllege makes them inability perform at thier grade education level.
Yeah, but reproducible results is a hallmark of a scientific peer review
Can you shorten your sentence please, oh wait, I'll copy it to AI.
For the first experiment with 354 participants, one group was tasked with solving 15 basic fraction problems without help, while another had ChatGPT open on the side to use for assistance and to even ask for the answer. The group with AI access started off more accurate than the group without it. Then, after 12 problems, researchers took away the AI tool. Almost immediately, the people in that group stopped solving questions accurately.
A similar thing happened when they ran the experiment on a second, larger group of 667 participants. Whereas the AI users got answers wrong or gave up entirely when the AI assistance was withdrawn, the group without AI stuck with the task and were more successful at the end.
Researchers then ran a third experiment with 201 participants and an SAT reading comprehension prompt. The results echoed those from the fraction problems: When the AI tool was removed, persistence and accuracy dropped.
I wonder if this kind of test would show the same results if you compared people using calculators for math problems vs. those without. From the basic operations to doing trig and calculus, if you provide an easier way they're going to take it, and unfortunately not going to pick up on how the answer is obtained, which an LLM will usually tell in the process. Doing something yourself always teaches you better than watching it, or just being told the answer.
If the tests are implying or showing that people who already were proficient in doing these tests and would have done well without started declining after exposure to an LLM's help, and that persisted... that's a different problem and one that should be looked into. Losing skills you had because of help? That shouldn't happen.
A lot of pro AI people like to compare LLMs to calculators but it’s not comparable at all unless the math you’re doing is simple arithmetic. If you’re doing calculus, the skill you’re working on isn’t arithmetic, so the calculator isn’t much of a factor. Lots of people forget how to do long division after using calculators on the other hand.
Losing skills you had because of help? That shouldn't happen.
That’s exactly what should happen. Cognitive thinking skills are use it or lose it. If you use an LLM to replace your brain, your brain will get worse.
Doing something yourself always teaches you better than watching it, or just being told the answer.
A neat result from pedagogical studies is that being given the worked solutions to new problems to study from is much more effective for learning the material than simply practicing.
Students who were assigned practice problems performed worse on later tests than those given the same problems and all of the worked-out solutions for them. The explanation from the research was - when learning a new topic, immediate practice isn't beneficial because the student doesn't yet know what to practice. If they are lost when trying the problem, they can easily end up practicing the wrong skills by not knowing where to start. Those with the solutions have some of the cognitive burden removed, and are better able to internalize the task and generalize it to later problems.
I completely agree with you on LLMs and I think they'll be a disaster for education. But I've always found it interesting that being given the answer can be useful for learning in certain circumstances.
Jokes on you. I never persisted at doing hard things because I had no idea what I was doing. Now I get into all sorts of shenanigans because I do what ai tells me to do.
This study actually measured the impact of knowing that your job could be much easier on performance.
I don't agree with this study and I am not a fan of AI. Replace the AI tool that they used with a calculator. You'd get the same results. Here you are legally cheating on some task because you were told to do it - breezing right along thinking of something cool you are gonna do later and then ... WHAM ! Cheaty tool gets yoinked. Now fuck - I have to think ? I'd probably think fuck it, I'll give it a half asssed shot because fuck them for making it not fun.
Anecdotally, I have software I wrote entirely by hand, started by hand and ended with ai, and AI from the start. Anything I had ai touch in the last 6 months has caused this for me. I barely have the attention span to read what the agent is planning to do. I can only conceptually review at a high level and direct it that way. It gets worse every week.
I think part of it is me not spending enough time setting things up so it writes code like I would, so I am reading a strangers code really. But even then, I find myself reading it for no more than 10 seconds and being like "ugh just ask the AI".
I have caught myself a few times about to ask the AI to change something that I could easily do myself still.
I know that if I stopped using it for a week and sat down with the code I had generated, I would understand it, but the thought of doing so has somehow become exhausting. It's a real issue.
Using a lighter for 10 minutes erodes your ability to persist at starting a fire with two sticks to :)
Truth is in the middle somewhere. I can still fix/make the things I made 2 years ago, but i'm going to use AI tools to do things that it's passable at while the tokens cost me $20 a month.
My homelab went from bare minimum with not enough time to ansible jobs to deploy any product I want to play with in a week.
We all knew this was going to be the case. You look at the people around you feeding their entire lives to it, surrendering their will to it completely, you knew it was going to fry their brains extra fast.