Saturday Morning Breakfast Cereal 2011 09 08 : programmer

[–] squaresinger@lemmy.world 21 points 1 day ago (2 children)

Do I read this right? That comic is from 2011?

[–] PiraHxCx@lemmy.dbzer0.com 11 points 19 hours ago

yes

[–] bitcrafter@programming.dev 6 points 19 hours ago (1 children)

Whence the skepticism?

[–] squaresinger@lemmy.world 8 points 18 hours ago (1 children)

No skepticism, only surprise at how that was so long before the AI epidemic.

[–] BananaIsABerry@lemmy.zip 9 points 17 hours ago (1 children)

Machine learning and "self evolving" code has been around for a long time. It's just... Mainstream now, I guess.

[–] Hasherm0n@lemmy.world 3 points 10 hours ago

Back when I was in college I took a computer engineering class around 2010 I think with a professor who had done CPU design at one of the big chip manufacturers. He had a story about how no human knows how they work anymore because they'll do the designs, then feed them through some optimization algorithm thing before the fabrication. Then when they would evaluate the chip they'd find that it was behaving in completely unexpected ways due to the optimization finding crazy efficient but unintuitive (to a human) ways of performing different operations.

I wish I could remember the details of what he talked about better, but that was a long time ago.

[–] Xerxos@lemmy.ml 47 points 1 day ago (2 children)

I have a similar theory about star trek. In one scene there was a blurry picture and to sharpen it Ricker said: "Computer implement recursive Algorithm". That is equivalent to "Computer do something". So now my theory is that there is an intelligent ship with a genius AI that carries around humans that have regressed to toddler intelligence because the AI does everything for them.

The ship is basically human daycare with lots of blinking buttons and moving pictures to keep the humans occupied while the ship does the actual (and probably boring) science.

Starfleet Academy is basically teaching them technobabble and looking great in a uniform while the AIs do the real work.

[–] CrabAndBroom@lemmy.ml 3 points 7 hours ago

The Culture novels by Iain M. Banks basically have this premise. There are super intelligent AIs called Minds that are pretty much gods who run everything, and their civilisation (the Culture) is a utopia for anyone who lives in it. Minds control the ships, which sometimes have crews but they're described as "somewhere between passengers, pets and parasites" in terms of how useful they actually are lol

[–] pinball_wizard@lemmy.zip 10 points 1 day ago* (last edited 18 hours ago)

For more views of Star Trek through this lens, you may want to check out John Scalzi's book "Red Shirts". It has some of the same ideas in play, and they play out hilariously.

[–] Barrington@feddit.org 38 points 2 days ago

I live this, it reads very much like an Issac Asimov story.

[–] notthebees@reddthat.com 7 points 1 day ago (1 children)

Wait, that's what smbc stands for?????

[–] bitcrafter@programming.dev 7 points 19 hours ago (1 children)

What did you think it stood for?

[–] lessthanluigi@lemmy.sdf.org 6 points 16 hours ago (2 children)

Super Mario Bros Central

[–] entropicdrift@lemmy.sdf.org 4 points 15 hours ago

Username checks out

[–] bitcrafter@programming.dev 3 points 16 hours ago

Actually, you make a pretty good point there.

[–] ranzispa@mander.xyz 7 points 1 day ago (1 children)

That's normal evolution, go ask a biologist about junk DNA.

[–] fibojoly@sh.itjust.works 1 points 4 hours ago

For real, I thought he was going there. Like : the AI keeps trying to fight off the coders messing with its perfect code so it keeps generating junk code to protect the actual code.

[–] dumnezero@piefed.social 2 points 1 day ago

Still SciFi

[+] Scubus@sh.itjust.works -8 points 2 days ago (4 children)

Ok i doubt anyone is going to be willing to have this discussion, but here i am. My assessment is as follows: it would seem to me that to be of value, "ai" doesnt need to be perfect, it just needs to be better than the average programmer. If it can produce the same quality code twice as fast, or if it can produce code thats twice as good in the same amount of time. If I want it to code me a video game, i would personally judge it by how well it does against what i would expect from human programmers. Currently there is no comparison, im no coding expert but even i find myself correcting ai for even the simplest of code, but thats only temporary. Ten years ago this tech didnt even exist, ten years from now(assuming it doesnt crash our economy in more ways than one) i would imagine the software will at least be comparable to an entry level programmer.

I guess what Im getting at is that people rail against ai for faults that a human would make worse. Like self driving cars, having seen human drivers i am definitely wanting that tech to work out. Obviously its ideal for it to be perfect and coordinate with other smart cars to reduce traffic loads and inprove safety for everyone. But as long as its safer than a human driver, i would prefer it. As long as it codes better than your average overworked unpaid programmer, it becomes a useful tool.

That being said, I do see tons of legitimate reasons to dislike AI, especially in its current form. A lot, id say most, of those issues dont actually lie with AI at all, or even with llms. Most of the issues ive heard with AI development are actually thinly veiled complaints about capitalism, which is objectively failing even without AI. The others are mostly complaints about the current state of the tech, which i find to be less valid. Its like complaining that your original ipod didnt have lidar built in like they do now. Nixing the capitalism issue about how this tech will be used, and how its currently being funded, and its environmental impacts, and the fact that this level of research is unsustainable and will collapse the economy, give the tech time and it will mature. That almost feels like sarcasm given those very real issues, but again, those are all capitlism issues. If we were serious about saving our planet, a guardian AI that automatically drone strikes sorices of intense pollution would go a long way. If youre worried about robots takin yer jerbs, try not being capitalism-pilled and realise that humans got by for eons without jobs or class structures. Post scarcity is almost mandatory under proper AI, and capitlism exists to ensure that post scarcity cant happen.

[–] bitcrafter@programming.dev 2 points 19 hours ago

Ok i doubt anyone is going to be willing to have this discussion, but here i am.

You're right; here I was enjoying a silly comic--written in 2011--about computers turning programming into human daycare, and someone had to turn it into yet another excuse to start talking about AI, as if we didn't have enough of that!

[–] NaibofTabr@infosec.pub 49 points 2 days ago* (last edited 2 days ago) (2 children)

AI coding tools can do common, simple functions reasonably well, because there are lots of examples of those to steal from real programmers on the Internet. There is a large corpus of data to train with.

AI coding tools can't do sophisticated, specific-case solutions very well, because there aren't many examples of those for any given use case to steal from real programmers on the Internet. There is a small corpus of data to train with.

AI coding tools can't solve new problems at all, because there are no examples of those to steal from real programmers on the Internet. There is no corpus of data to train with.

AI coding tools have already ingested all of the code available on the Internet to train with. There is no more new data to feed in. AI coding tools will not get substantially better than they are now. All of the theft that could be committed has been committed, which is why the AI development companies are attempting to feed generated training material into their models. Every review of this shows that it makes the output from generative models worse rather than better.

Programming is not about writing code. That is what a manager thinks.
Programming is about solving problems. Generative AI doesn't think, so it cannot solve problems. All it can do is regurgitate material that it has previously ingested which is hopefully close-ish to the problem you're trying to solve at the moment - material which was written by a real thinking human that solved that problem (or a similar one) at some point in the past.

If you patronize a generative AI system like Claude Code, you are paying into, participating in, and complicit in, the largest example of labor theft in history.

[–] undeffeined@lemmy.ml 29 points 2 days ago

Programming is not about writing code... Programing is about solving problems

Very well put. Good managers know that but those are very rare... And the whole top management in the world is completely bought into this snake oil, makes me feel insane.

[–] Scubus@sh.itjust.works -2 points 1 day ago (2 children)

Im not entirely convinced this is accurate. I do see your point and i had not considered that there is no more training data to use, but at the end of the day our current ai is just pattern recognition. Hence, would you not be able to use a hybrid system where you set up billions of use cases(translate point a to point b, apply a force such that object a rolls a specified distance, set up a neural network using backpropogation with 3 hidden layers, etc) and then have two adversarial ais. One of which attempts to "solve" that use case by randomly trying stuff, and the other basically just says "youre not doing good enough and heres why". Once your first is doing a good job with that very specific use case, index it. Now when people ask for that specifc use case or a larger problem that includes that use case, you dont even need AI. You just plug in the already solved solution. Now your code base becomes basically just AI filling out wvery possibly question on stack overflow.

Obviously this isnt actual coding with AI, at the end of the day youre still doing all the heavy lifting. Its effectively no different from how most coders code today, just steal code from stack overflow XD the only difference would be that stack overflow is basically filled with every conceivable question, and if youre isnt answered, you can just request that they set up a new set of ad ais to solve the new problem.

Secondarily, you are the first person to give me a solid reason as to why the current pardigm is unworkable. Despite my mediocre recall i have spent most of my life studying AI well before all this llm stuff, so i like to think i was at least well educated on the topic at one point. I appreciate your response. I am somewhat curious about what architecture changes need to be made to allow for actual problem solving. The entire point of a nerual network is to replicate the way we think, so why do current AIs only seem to be good at pattern recognition and not even the most basic of problem solving? Perhaps the architecture is fine, but we simply need to train up generational ais that specifically focus on problem solving instead of pattern recog?

[–] Corbin@programming.dev 2 points 8 hours ago

Secondarily, you are the first person to give me a solid reason as to why the current paradigm is unworkable. Despite my mediocre recall I have spent most of my life studying AI well before all this LLM stuff, so I like to think I was at least well educated on the topic at one point.

Unfortunately it seems that your education was missing the foundations of deep learning. PAC learning is the current meta-framework, it's been around for about four decades, and at its core is the idea that even the best learners are not guaranteed to learn the solution to a hard problem.

I am somewhat curious about what architecture changes need to be made to allow for actual problem solving.

First, convince us that humans are actual problem solvers. The question is begged; we want computers to be intelligent but we didn't check whether humans were intelligent before deciding that we would learn intelligence from human-generated data.

[–] pinball_wizard@lemmy.zip 7 points 1 day ago (1 children)

Perhaps the architecture is fine, but we simply need to train up generational ais that specifically focus on problem solving instead of pattern recog?

I mean, the architecture clearly isn't fine. We're getting very clever results, but we are not seeing even basic reasoning.

It is entirely possible that AGI can be achieved within our lifetime. But there is substantial evidence that our current approach is a complete and total dead end.

Not to say that we won't use pieces of today's solution. Of course we will. But something unknown but also really important and necessary for AGI appears to be completely missing right now.

[–] Scubus@sh.itjust.works 3 points 14 hours ago (1 children)

Okay, so the rest of this is just theory crafting based on logical reasoning, but id like to hear your take. Quickly googling, it shows that we have succesfully mapped the neurons in one millimeter of mouse brain, and it had about 200,000 cells (neural nodes). Thats a lot of neural nodes to emulate, let alone the connections. It would seem to me that its far easier to customize our hardware. Mossfets dont strike me as up to the task, so it would seem to me that the future of ai lies in growing actual neurons and training them. You would achieve a much higher neural density that way, and the work is already being done to make that tech feasible.

Basically, do you think its a hardware issue?

[–] pinball_wizard@lemmy.zip 3 points 8 hours ago

Mossfets dont strike me as up to the task, so it would seem to me that the future of ai lies in growing actual neurons and training them. You would achieve a much higher neural density that way, and the work is already being done to make that tech feasible.

I think you've got it exactly.

We either need to achieve an unprecedented density (possibly through some novel computation medium), or we need to find a few more incredibly clever computational shortcuts.

[–] mech@feddit.org 21 points 2 days ago (2 children)

ten years from now(assuming it doesnt crash our economy in more ways than one) i would imagine the software will at least be comparable to an entry level programmer.

That's a big assumption. Also, AI stopped progressing in the past year, which shows it's already hit its ceiling.

[–] undeffeined@lemmy.ml 19 points 2 days ago

Like the user above said, virtually all human code has been fed to the models, now there's very little new original human code been put online and with more adoption of LLMs in coding will only exacerbate this.

[–] Scubus@sh.itjust.works 4 points 1 day ago

It is a massive assumption, but i tend to operate on the belief that capitalism will fall soon and some decent system will appear, because otherwise all this is a moot point anyways. Without the destruction of capitalism well all be dead within 20 years, so i dont find it as entertaining to speculate about a future where we are still bound by things like our economy. As far as the progression of ai this last year, didnt claude just learn to lie? Thats a huge step in development, not because its good, but because it shows our models are progressing. They know what were aiming for and theyre willing to lie to get to that target, which does actually show the most basic level of problem solving. Thats... huge actually.

[–] Dupelet@piefed.social -2 points 2 days ago (1 children)

Very cogent take, enjoy the incoming downvotes.

[–] Scubus@sh.itjust.works 1 points 1 day ago (2 children)

Downvotes mean nothing other than stifle conversations on lemmy anyways, and fortunately i woke up to find that a bunch fo people were willing to have pretty solid discussions on the matter. All in all, it definitely seems people here are more willing to doscuss the problems than somewhere like c/fuckai

I learned something and i like to think i got people thinking, so id say it was worthwhile :)

[–] pinball_wizard@lemmy.zip 2 points 1 day ago

Wait, we're not at c/fuckai? I must have gotten lost. LoL.

[–] flambonkscious@sh.itjust.works 0 points 1 day ago

I've hugely appreciated the nuanced and balanced debate!

Programmer Humor

Rules