Slopscore: An automated tool to find AI use in FOSS projects! : fuck

[–] MonaySimpson@lemmy.ml 1 points 18 hours ago

That's awesome.

A way to import a list from ontanimum would be a nice feature.

[–] Kangae_Hishiryo@scribe.disroot.org 6 points 1 day ago

I already use it. It's GLORIOUS. I'm free from a lot of stress, although not totally free of it. It's better, at least.

[–] the_wizard_of_0Z@lemmy.ca 3 points 1 day ago

neat.

[+] eremophila@lemmy.zip 1 points 1 day ago

[deleted]

[+] artwork@lemmy.world -6 points 1 day ago

Holy smokes... Freaking awesome!
Of course... Programming is normally a human art...
Programming is of human for human to automate machines...
It is as any of people to be left in the infinite history, to learn from and improve accountably, too...

Thank you very much for the marvel... art you do...

There's the following book I recall on the subject that is an essential for every accountable, astute, and respectful developer, artist, I believe.

...a computer language is not just a way of getting a computer to perform operations but rather that it is a novel formal medium for expressing ideas about methodology. Thus, programs must be written for people to read, and only incidentally for machines to execute.

...the essential material to be addressed by a subject at this level is not the syntax of particular programming-language constructs, nor clever algorithms for computing particular functions efficiently, nor even the mathematical analysis of algorithms and the foundations of computing, but rather the techniques used to control the intellectual complexity of large software systems.
...

Our traffic with the subject matter of this book involves us with three foci of phenomena: the human mind, collections of computer programs, and the computer.

Every computer program is a model, hatched in the mind, of a real or mental process. These processes, arising from human experience and thought, are huge in number, intricate in detail, and at any time only partially understood.

They are modeled to our permanent satisfaction rarely by our computer programs. Thus even though our programs are carefully handcrafted discrete collections of symbols, mosaics of interlocking functions, they continually evolve: we change them as our perception of the model deepens, enlarges, generalizes until the model ultimately attains a metastable place within still another model with which we struggle.

The source of the exhilaration associated with computer programming is the continual unfolding within the mind and on the computer of mechanisms expressed as programs and the explosion of perception they generate.

If art interprets our dreams, the computer executes them in the guise of programs!

~ Source: "Structure and Interpretation of Computer Programs" (SICP; or "Wizard Book") by Harold Abelson, Gerald Jay Sussman, Julie Sussman

[+] solrize@lemmy.ml -8 points 1 day ago (2 children)

Nobody thinks the output of that thing isn't itself slop?

[–] chickenf622@sh.itjust.works 20 points 1 day ago (1 children)

Looks like a very simple heuristic analysis looking for certain files/commiters. In fact it states in the README that it doesn't go through all the files so it is probably more reliable than those AI "detectors" that also rely on AI.

[–] CameronDev@programming.dev 13 points 1 day ago* (last edited 1 day ago) (3 children)

Its just reading the commit history. It doesnt read the files at all. So it only finds overt slop, anyone who does their commits manually would pass completely.

Edit: https://slopscore.ava.pet/repo/https%3A%2F%2Fgithub%2Ecom%2Fcameroncros%2Fedgy%2Dtable

This repo is 100% slop (its mine, I know what I did), and it gets marked clean.

[–] bugbear@lemmy.sdf.org 8 points 1 day ago (1 children)

I mean, realistically speaking that's what I would do manually. So it's just making my life easier by automating it.

I don't expect it to analyse individual files.

[–] FedX@quokk.au 7 points 1 day ago (1 children)

Exactly. It can produce false negatives, but by nature of Git's blaming everyone for every change, it makes it (probably) won't produce false positives. It's a give and take in that instance. Do you do a witch hunt and try and track down every LLM generated repo and get some legit repos caught up in an imperfect process. Or do you use actionable evidence to make an informed decision?

In my opinion, witch hunts are really quite unhealthy for society. When possible, I choose projects with blanket no-AI statements, but when not, this expedites the process of choosing between alternatives. Rustic has less AI generated code than Restic, let's do that. Kitty has hundreds of AI generated commits, let's delete that immediately.

[–] Kangae_Hishiryo@scribe.disroot.org 1 points 1 day ago

Yeah, and at least the site shows you the content of the files.

I think there can be a reasonable way for it to get false positives, and it's when a repo has an AGENTS.md/<insert-llm-here>.md file, or a .skills/, cursor/ or tabby/ folder, for example, but they're adversarial (for example, theres awful.system's AAA-NO-SLOP.md).

[–] chickenf622@sh.itjust.works 5 points 1 day ago

It also looks for certain files like AGENTS.md which your repo doesn't appear to have.

[–] eremophila@lemmy.zip 0 points 1 day ago (1 children)

*CameronSlop

[–] CameronDev@programming.dev 3 points 1 day ago (1 children)

Ha, I still hand write most of my code, i used it for that repo to try out local LLMs. Know thy enemy.

I did hand-polish that code as well, just the initial pass was slopped together.

[–] eremophila@lemmy.zip 1 points 1 day ago (1 children)

I do know my enemy ;)

[–] FedX@quokk.au 2 points 1 day ago (1 children)

They're the teachers who taught me to fight me. Compromise, conformity, Assimilation, submission, Ignorance, hypocrisy, Brutality, the elite. All of which are American dreams.

[–] eremophila@lemmy.zip 1 points 23 hours ago

https://www.youtube.com/watch?v=qKpik3zS_-o

"She cared for me and put me on this earth Oh, the pain of just a simple birth Right now, I find that she has left me dumb and blind Poisoned, twisted, and destroyed my mind She taught me things that simply were not true She taught me hate for race, that's why I hate you!"

also crypto bros, ai users, duopoly voters, amazon shoppers....

[–] artwork@lemmy.world 2 points 1 day ago* (last edited 1 day ago)

There's a self-scan:
- https://slopscore.ava.pet/repo/https://U:T@codeberg.org/polyphony/repo-slopscore

From the first glance, it works most of the times better than nothing.

Fuck AI