this post was submitted on 20 Oct 2025
494 points (98.8% liked)

Selfhosted

60934 readers
908 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] GissaMittJobb@lemmy.ml 60 points 9 months ago (5 children)

It's mostly a skill issue for services that go down when USE-1 has issues in AWS - if you actually know your shit, then you don't get these kinds of issues.

Case in point: Netflix runs on AWS and experienced no issues during this thing.

And yes, it's scary that so many high-profile companies are this bad at the thing they spend all day doing

[–] village604@adultswim.fan 22 points 9 months ago (2 children)

Yeah, if you're a major business and don't have geographic redundancy for your service, you need to rework your BCDR plan.

[–] Bob_Robertson_IX@discuss.tchncs.de 11 points 9 months ago (1 children)
[–] village604@adultswim.fan 10 points 9 months ago

So does an outage, but I get that the C-suite can only think one quarter at a time

[–] sugar_in_your_tea@sh.itjust.works 5 points 9 months ago* (last edited 9 months ago)

Absolutely this. We are based out of one region, but also have a second region as a quick disaster recovery option, and we have people 24/7 who can manage the DR process. We're not big enough to have live redundancy, but big enough that an hour of downtime would be a big deal.

[–] tourist@lemmy.world 4 points 9 months ago (1 children)

What's the general plan of action when a company's base region shits the bed?

Keep dormant mirrored resources in other regions?

I presumed the draw of us-east-1 was its lower cost, so if any solutions involve spending slightly more money, I'm not surprised high profile companies put all their eggs in one basket.

[–] corsicanguppy@lemmy.ca 4 points 9 months ago

I presumed the draw of us-east-1 was its lower cost

At no time is pub-cloud cheaper than priv-cloud.

The draw is versatility, as change didn't require spinning up hardware. No one knew how much the data costs would kill the budget, but now they do.

[–] B0rax@feddit.org 4 points 9 months ago* (last edited 9 months ago) (1 children)

Case in point: Netflix runs on AWS and experienced no issues during this thing.

But Netflix did encounter issues. For example the account cancel page did not work.

[–] princessnorah@lemmy.blahaj.zone 1 points 9 months ago (1 children)

I would say that's a pretty minor issue that isn't related to the functioning of the service itself.

[–] kbobabob@lemmy.dbzer0.com 0 points 9 months ago (1 children)

It's probably by design that the only thing that didn't work was the cancel page

[–] princessnorah@lemmy.blahaj.zone 2 points 9 months ago (1 children)

That's honestly just a tin-foil hat sort of take, that entirely relies on planning for an unprecedented AWS outage specifically to screw over customers.

[–] kbobabob@lemmy.dbzer0.com 1 points 9 months ago

What I meant by that is that they probably didn't care if that service has a robust backup solution like authentication or something would.

[–] corsicanguppy@lemmy.ca 3 points 9 months ago

I love the "git gud" response. Sacred cashcows?

[–] Danquebec@sh.itjust.works 1 points 9 months ago

Netflix did encounter issues. I couldn't access it yesterday at noon EST. And I wasn't alone, judging by Downdetector.ca