this post was submitted on 21 May 2026
31 points (97.0% liked)

Selfhosted

60723 readers
345 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS
ruud@lemmy.world
Loki@lemmy.world
CannaVet@lemmy.world
devve@lemmy.world
ayyy@sh.itjust.works
curbstickle@anarchist.nexus
curbstickle_lw@lemmy.world
31
Proxmox Backup Server verifications stupidly slow on S3 storage (sopuli.xyz)
submitted 1 month ago by IsoKiero@sopuli.xyz to c/selfhosted@lemmy.world
7 comments fedilink hide all child comments
 

So, I've been running offsite copies to OVH S3 bucket via PBS running as an VM but I ran into an issue that verification of the backups is so slow that they're practically unusable.

Copies run nightly and I've set the storage to keep last 4 copies in place. Bigger VMs, like my immich-instance with a bit over terabyte of data, take several days to verify and logs show data rates at around 5MB/s or less. So, with the current schedule I'm running it'll mean in practise that backups expire before they're verified.

I could keep the copies longer, but that'd cost more, or run copies less frequently, which risks losing data if hardware fails at unfortunate moment (which it most likely will). Tuning settings are on default and based on what I've read, adding more runners wouldn't really help that much.

PBS VM itself shows very little load on proxmox monitoring and I've got plenty of bandwidth to use, so the verification shouldn't have any bottlenecks on my end at those speeds. Cache usage is at around 60% with ~30GB of total space available.

Does anyone have any ideas on how to speed that up? Or should I just give up and do something totally different? I attempted to run backups to Hetzner storagebox over cifs-mount, but that's pretty much the same or worse with performance.

you are viewing a single comment's thread
view the rest of the comments
[–] IsoKiero@sopuli.xyz 2 points 1 month ago (1 children)

I'm using OVH, not AWS. Their console gives estimation of ~20€/month for the ~2TB I have stored. Versioning is disabled and i'm currently runnign on their signup offer of 200€ credit, so I'm good to go for few weeks more. The storage I'm using includes the traffic, it's just practically unusable due to verification speeds.

[–] vk6flab@lemmy.radio 4 points 1 month ago

I apologise, I saw S3, never even noticed the "OVH", nor had I ever heard of it.

I'll leave my original reply as is with an added disclaimer for anyone who follows down the same path.