130
Data Poisoning could be a tool we use to identify AI that has used copyritten material
(www.youtube.com)
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
Traditionally, with machine learning, it is standard practice to mention what datasets and/or pretrains were used, so that the results are transparent and can be replicated. With GPT-2, it was "the common crawl and our own crawled 8 million web pages", and since then I feel it's mostly left out, falling back on (easily manipulated) benchmarks instead ๐ฌ
Yep. But just providing a list of millions of URLs and saying "we trained on this" as some models in the past have done also didn't make it possible to replicate; by the time anyone re-fetches them all, many of the URLs will inevitably have changed or disappeared.
That's exactly why projects like the common crawl exist though !