with optimizations that significantly increase HDD performance for the AI and cloud era
Can somebody do anything with a normal consumer in mind these days? 😭
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
No spam posting.
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
No trolling.
No low-effort posts. This is subjective and will largely be determined by the community member reports.
Resources:
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
with optimizations that significantly increase HDD performance for the AI and cloud era
Can somebody do anything with a normal consumer in mind these days? 😭
Not until somebody shuts off the investor money faucet for AI. Then they'll come crawling back — although inevitably not until after they go whining to all the world's governments about wanting a bailout.
But hey, look at the bright side. We've already had the cryptocurrency mining boom and bust, and "AI" boom and soon to be bust. There's still time for some idiot to invent the next tech scam fad which will conveniently require a shitload of hardware for no recognizably useful purpose.
Then they’ll come crawling back — although inevitably not until after they go whining to all the world’s governments about wanting a bailout.
And don't forget the part where, whether they get a bailout or not, they'll still have to double the prices of everything to make up for all the money they lost on that stupid AI bubble exploding in their face (which all of us are somehow to blame for, obviously, which is why we have to pay them back for it)
No, and it's by design.
You're gonna lease a tablet and use cloud-based storage services and like it.
The dystopia is here.
140 TB is a whole heck of a lot of movies and TV shows
It's about the storage I have in my server right now - using 15 drives ☠️
Normal consumers can install jellyfin. At some point they'll make downloading a crime, they wouldn't hurt people to have a decent collection of stuff ready for that day.
Okay cool, cool, so does this mean ridiculous data centers will use these things, and then can I get another 4TB RED for my NAS so I can fit my whole life on a mirrored total of 8TB without paying 8x what it's worth, please?
Thaaaaanks...
Is there a Lemmy community for trading surplus hardware yet?
I have a pile of HDDs and servers that I no longer use. I've transitioned almost all mine to 20tb+. I might have 8 or 10 4tb REDs laying around. They're old, probably have thousands of power on hours in the smart data though.
Right on!
I don't know if there's a hardware trading community yet. I think one challenge is simply how lemmy seems to aim for more general anonymity than reddit, and the DM system isn't really used to my understanding. (Except by "that fediverse girl" LOL)
Establishing a sense of reasonable trustworthiness to thwart bad actors might take some work.
I just hope smaller sized drives become cheaper. The word "hope" is doing a lot of heavy lifting here.
Ten years from now...
Amazon search: "hard drive"
Result: 4TB $198
BARGAIN!
Holy fuck can you imagine how long it would take to re-stripe a failed drive in a z2 array 😭
Not a clue. Care to eli5?
When you are running a server just to store files (a NAS) you generally set it up so multiple physical hard disks are joined together into an array so if one fails, none of the data is lost. You can replace a failed drive by taking it out and putting in a new working drive and then the system has to copy all of the data over from the other drives. This process can take many hours to run even with the 10-20 TB drive you get today, so doing the same thing with 140 TB drive would take days.
@SmoothLiquidation @Telorand They also claim up to 8x speed improvements with HAMR. Obviously that remains to be seen, but if they could roughly match capacity improvements, that would keep restriping in the same ballpark.
My Z2 had à drive failure recently, with 4To drives. Took me almost 3 days to re-silver the array 😅. fortunately had a hot spare setup, so it started as soon as it failed, but now a second drive is showing signs of failing soon, so I had to pay the AI tax (168€) to get one asap (arriving Monday), as well as a second one, cheaper (around 120€), but which won't arrive until the end of April.
This would be a bitch to have to rebuild in a raid array. At some point a drive can get TOO big. And this is looking to cross that line.
At some point a drive can get TOO big
I was thinking the same. I would hate to toast a 140 TB drive. I think I'd just sit right down and cry. I'll stick with my 10 TB drives.
This is not meant for human beings. A creature that needs over 140 TB of storage in a single device can definitely afford to run them in some distributed redundancy scheme with hot swaps and just shred failed units. We know they're not worried about being wasteful.
Rebuild time is the big problem with this in a RAID Array. The interface is too slow and you risk losing more drives in the array before the rebuild completes.
Realistically, is that a factor for a Microsoft-sized company, though? I'd be shocked if they only had a single layer of redundancy. Whatever they store is probably replicated between high-availability hosts and datacenters several times, to the point where losing an entire RAID array (or whatever media redundancy scheme they use) is just a small inconvenience.
It doesn't really matter, the current limitations are not so much data density at rest, but getting the data in and out at a useful speed. We breached the capacity barrier long ago with disk arrays.
SATA will no longer be improved, we now need u.2 designs for data transport that are designed for storage. This exists, but needs to filter down through industrial application to get to us plebs.
640K ought to be enough for anybody.
If you were to ask me a year ago I'd tell you that HDD's would be the next dead storage medium but now SSD's cost more then I spent on my rig and HDD's are pushing 140 TB's
As a result, will be able to offer drives beyond 140 TB in the 2030s.
Um thanks but tell us about 2026?
And how much will that cost? Sounds like something fantastic for my Jellyfin server. I’ll have all the 4k HDR I can get my hands on.
Probably still with only 1 year warranty...
And if it breaks at 10 months and they take another 2 to send your replacement back, well, they no longer need to send one that actually works this time either
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:
| Fewer Letters | More Letters |
|---|---|
| NAS | Network-Attached Storage |
| RAID | Redundant Array of Independent Disks for mass storage |
| SATA | Serial AT Attachment interface for mass storage |
| SSD | Solid State Drive mass storage |
| ZFS | Solaris/Linux filesystem focusing on data integrity |
5 acronyms in this thread; the most compressed thread commented on today has 7 acronyms.
[Thread #72 for this comm, first seen 8th Feb 2026, 00:30] [FAQ] [Full list] [Contact] [Source code]
Whats the point when the prices for 4-8TB disks are stable the last 5 years? (I think that they are getting higher even...)
The point is the need for more and more data storage is never going to stop.
Does the increased density mean that the speed also goes up? It would be nice if a 7200 RPM drive could finally saturate SATA3 bandwidth.
I wonder why current consumer HDD's don't have NVME connectors on them. Like I know speeding up the bus isn't going to make the spinning rust access faster but the cache ram would probably benefit from not being capped at 550MBps
Okay. I want total honesty here. How many of you could actually fill that thing up?
Archive.org, Anna's archive, Jan 6 footage, Epstein files, there's plenty to back up.
With useful stuff? Never. With random bullshit I think might be useful some day if only I find the time? Easy
Question: Are failures due to issues on a specific platter? Meaning, could a ZRAID theoretically use specific platters as a way to replicate data and not require 140TB of resilvering on a failure?
@Fmstrat @veeesix Since there's two very diffrent questions there.. The first, "where do the failures happen?": anywhere. It could be the controller dying (in which case the platters themselves are fine if you replace the board, but otherwise the whole thing is toast). It could be the head breaking. It could be issues with a specific platter. It could be something that affects _all_ the platters (like dust getting inside the sealed area). So basically, it very much depends.