this post was submitted on 20 Oct 2026
570 points (98.5% liked)

Fediverse

44428 readers
1051 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, Mbin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 3 years ago
MODERATORS
 

I shared a link from NPR Tiny Desk but there was no image preview or video embed. After investigating this I learned that when you do that, each instance picks up the link and individually retrieves the link preview nearly simultaneously. For gargantuan sites like YT or Reddit, this is a trivial amount of traffic and not a problem, but for smaller sites like NPR this results in a sort of botnet DDOS attack on the site's servers. More here. Another example here . For that reason, NPR has blocked Fediverse servers like Mastodon.

I have experienced this on my personal server as well (DDOS), but at the time didn't know why, exactly.

This isn't the end of the world, but certainly is not great and hurts engagement with the content. Is there a solution for this? Perhaps using some sort of webtorrent service like PeerTube where they just fetch the information from another fediverse server instead of the source server? Maybe fetching embeds client-side? At least that would stagger the requests.

top 50 comments
sorted by: hot top controversial new old
[–] A_Random_Idiot@lemmy.world 9 points 3 hours ago (1 children)

So we need people to just mass post links to bad websites, is what you're saying.

[–] HeyThisIsntTheYMCA@lemmy.world 4 points 2 hours ago

i'm feeling less ambivalent about those reddit repost bots for a moment

[–] CultLeader4Hire@lemmy.world 30 points 8 hours ago (2 children)

Is this the same thing as the “Reddit hug of death”?

[–] FluorineBalloon@programming.dev 49 points 8 hours ago

Similar, except those are caused by users visiting a link, whereas the Fediverse issue is federated servers gathering info before users even see a link.

[–] 0x0@lemmy.zip 14 points 8 hours ago (1 children)
[–] _haha_oh_wow_@sh.itjust.works 6 points 7 hours ago

Or the Digg Effect

[–] FundMECFS@piefed.zip 59 points 12 hours ago (1 children)

Thanks for bringing this up. I think in general we need to work on optimisation of Activitypub and Threadiverse implementations of it.

[–] derpgon@programming.dev 4 points 2 hours ago

Either publishing server should serve the metadata - although it would be prone to bad actors, so a refetch in the next 0-180 seconds would be appropriate. Or just add a random 0-60 second delay before fetching the data.

[–] GenosseFlosse@feddit.org 39 points 12 hours ago (1 children)

Is there a reason why the publishing instance is not downloading the preview image, and then submits it with the post to the other instances? This way they would not have to fetch it themselves.

[–] Funkt4st1c@lemmy.world 30 points 12 hours ago (8 children)

Yeah, thats how it should be: one download, everyone else downloads from that server, not the original source.

Seems abusable though

[–] _haha_oh_wow_@sh.itjust.works 12 points 7 hours ago

It is, but that's what defederation is for: If there are instances that are being sketchy, they are supposed to get cut off from the rest of the Fediverse.

[–] Gibibit@lemmy.world 18 points 10 hours ago

Seems abusable though

If one instance doesn't trust another, they shouldn't federate in the first place.

load more comments (6 replies)
[–] glitchdx@lemmy.world 5 points 8 hours ago

So linking my own website here is a bad idea? Glad I haven't done that yet.

[–] cybervegan@lemmy.world 31 points 12 hours ago (2 children)

I have my blog address (which goes to my home server) in my Mastodon profile, and every time I post on Masto, my server gets a request from every Mastodon site that federates with my instance - i.e. hundreds of requests. It's no problem for my server, because my blog is a static site, but for anything that dynamically generates every single page impression (like worpress or joomla), it could be a problem. Caching settings might help, I suppose.

Truth is, though, I get far more traffic from vulnerability scanners and AI crawlers that don't honour robots.txt (or aren't yet listed).

[–] 0x0@lemmy.zip 9 points 8 hours ago

that don’t honour robots.txt (or aren’t yet listed).

Throw'em in the tar pit.

[–] zod000@lemmy.dbzer0.com 6 points 11 hours ago

that don’t honour robots.txt

That's essentially all of them in my experience.

[–] dropdrip@lemmy.ml 33 points 14 hours ago (5 children)

It's almost like the software that powers the internet was designed for a different time and is only still used because there's monied interest in keeping it around. We need GNUnet.

[–] mesamunefire@piefed.social 2 points 4 hours ago

Oh wow GNUNet I havent heard of that in a while. How is it nowadays?

[–] 0x0@lemmy.zip 4 points 8 hours ago
[–] milbyte11@lemmy.ml 17 points 12 hours ago

is there something that makes this different to 17 other proposals for a new internet or is it just a case of https://xkcd.com/927/

[–] sem@lemmy.blahaj.zone 12 points 13 hours ago (1 children)

GNUnet helps building a new Internet

GNUnet is a network protocol stack for building secure, distributed, and privacy-preserving applications.

With strong roots in academic research, our goal is to replace the old insecure Internet protocol stack.

GNUnet provides privacy-by design

It provides [improving addressing, routing, naming and content distribution](https://www.w3.org/2014/strint/papers/65.pdf) in a technically robust manner - as opposed to ad-hoc designs in place today.

[–] TrackenDaKracken@lemmy.world 15 points 12 hours ago (1 children)

GNUnet provides privacy-by design

Money doesn't want us to have privacy.

[–] tachikoma@lemmy.today 1 points 7 hours ago* (last edited 7 hours ago)

Forget the money. RevolutionOS!

load more comments (1 replies)
[–] ByteJunk@lemmy.world 43 points 17 hours ago (3 children)

I mean, just how many instances are gonna ping the URL? Several hundred, low thousands at worst?

Unless it happens to be some very large media content or a dynamic page with no caching, I'd think the automated federation hits shouldn't be too bad.

The influx of users that might come after a viral post though, that's rough....

[–] Doom@lemmy.world 10 points 10 hours ago

Yeah but we can't say we want to encourage people to have/build/share independent smaller websites then beat them up when they are linked. That's a huge mismatch of morality. Either we want to encourage people off the big platforms and should make it easier for the little guys or we are blowing magic smoke.

[–] dreamkeeper@lemmy.world 20 points 14 hours ago (2 children)

It's just bad design. What happens when/if the fediverse scales up to many more instances?

[–] WizardofFrobozz@lemmy.ca 2 points 2 hours ago

It better fucking not

[–] 1984@lemmy.today 5 points 12 hours ago (1 children)

I liked writing efficient code but every place I worked didn't care at all about it. All they wanted was a finished feature and a kanban note moved to finished.

[–] INeedMana@piefed.zip 10 points 9 hours ago

Thing is, Fediverse is not a product

[–] ayyy@sh.itjust.works 2 points 9 hours ago (1 children)

It’s obviously bad enough that major news orgs are blocking it.

[–] CultLeader4Hire@lemmy.world 5 points 8 hours ago

Is that really why they’re blocking it I wonder…

[–] wjs018@piefed.wjs018.xyz 196 points 22 hours ago (26 children)

There are two proposed solutions I have seen. I do not claim that this is exhaustive, just only limited to the proposals that I have stumbled across.

FASP - Fediverse Auxiliary Service Provider

The idea that mastodon has is to have a third-party service that does something like generate a link preview once and then share that to fediverse instances that need it. They have a whole spec they wrote up about these kinds of services that can be run to help out fediverse instances with different things like this, search, or discoverability. They call these FASPs - the repo with the spec is here.

I don't yet know of any FASP that is live and running, so it is kind of a paper spec at the moment. I don't do too much on the microblogging side of the fediverse though, so I very well could be wrong.

Federate link metadata and the post at the same time

This comes from an issue on PieFed's repo. It is basically just an idea at this point, but it is a pretty basic one; have the originating instance fetch the link preview information and simply federate it out alongside the post itself.

load more comments (26 replies)
load more comments
view more: next ›