Hello all, as the title says, I’d like to get to 100TB usable capacity. My current setup is 6x 8TB WD Reds in a RAIDZ2 array under TrueNAS. Usable is about 25TB give or take.
I have roughly $1500 to spend to make this happen but that must include the cost of a new case and drives. Current case is a Node 804 which will be retired. Current mobo is a Supermicro X9SCL with a E3-1220 V2, 16GB of RAM (will upgrade to 64 after this storage upgrade). LSI HBA but can’t remember the model off the top of my head.
Looking to move to a CSE-846 or 847, but not opposed to a more storage dense solution with an 826/827 or 836/837.
I’d like to keep the current drives for now but I’m not opposed to other options. I’m thinking adding either 2x RAIDZ2 arrays with 10TB drives or 1 with 20TB drives.
Does this seem reasonable or feasible for this price range? I’ve found manufacture refurb 10TB drives on eBay but I’m not sure of quality or reliability of seller.
Open to any and all suggestions.
I looked at those cases, ended up going with this because easier to expand and hte PSU size:
Can find them for less elsewhere:
https://www.amazon.com/gp/product/B095YMXW1K/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1Have a look at these HDD’s, I have seen them as low as $150. i run 20 of them right now, some have 3 years run time now. Been very happy with this vendor, usually only a few hours of runtime:
https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-0F31284-14TB-3.5-7.2K-RPM-512e-SATA-6GbStorage type:
If you need the speed, stick with ZFS.
But it should depend on the data and how risk averse you are (how easy to replace the data is). I started all ZFS, now I use this method:Unraid Array. For easily replaceable media, like movies. (Where I have a list and can easily re-download/upload) I use only the Unraid Array for that. Mainly for data that is write once read often.
Downside:
Unraid write speed is slow. No scrubbing.
Upside:
only the 1 disk that has the data spins up. This saves me about 180-200W of power and lots of wear on the drives.
It’s also very storage efficient, I only run 2 parity disks with 20 drives. I wouldn’t do that on a regular raidz. But with unraid data lives on each disk, so you don’t loose the entire array if you lose more than 2 disks. This changes the risk math.Then for all my critical data, that I need ZFS speed and scrubbing for, I setup a raidz1 pool with 4x Intel P4510 4TB. (Home pics/media)
Those I got for $200/pc new on eBay.If you don’t mind shucking, Best Buy has a sale on WD 18tb extensions for $200 each. Last day is today unless it returns in black Friday.
BB has 18TB WD externals that are supposedly white label Reds for 200USD a piece. 7 of those should be nice. That and more RAM.
Why retire the 804? It’s still one of the better cases out there. If it’s in good shape and has the parts, it’ll go for an easy $80-$100 on Facebook.
Supplied by NewEgg, $10 cheaper than NewEgg. Got (2), both checked out as new drives
Seagate-Exos-X20-ST20000NM007D-20TB
Here’s a Netapp shelf with 24x6tb drives for $825. Your ongoing power cost would be high though. https://www.ebay.com/itm/126080434670?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=pMrWKqdCRAG&sssrc=4429486&ssuid=Cb1tGoNLT-C&var=&widget_ver=artemis&media=COPY
This is a GREAT price for this type of storage unit, especially considering it’s full of Enterprise hard drives.
CAUTION: NetApp will require you purchase an expensive license from them to get the full 144TB storage usage. We rad many NetApp servers at the last datacenter I worked at, and selling them was always difficult because NetApp support is really difficult about requests to transfer licenses (atleast they were for us).
Their licensing is physically built into their hardware, so many functions are blocked without the required licenses. We also discovered that blowing up a disk partition kills the license, as we had to wipe the drives first for security reasons before selling the replaced units.
Here’s just one of thousands of forum posts from NetApps own website, showing one example of this problem:
https://community.netapp.com/t5/ONTAP-Discussions/NetApp-licensing/m-p/119703
From what I can tell this is just the DS4246 expansion shelf. If it had controllers, there would be a lot more ports on the back. If I remember right, you can repurpose these shelves as a generic SAS jbod. I believe you need to reformat the drives before they will work with anything but a Netapp controller.
I’d do a X12SDV-4C-SP6F with 10x 20TB in a raidz2 with an optane slog, and still have room for 4 NVME to add later. Grab the 8 core for an additional $1K if you absolutely need it, but you’d be surprised what the 4 core can do. Low power, won’t make any noise with the right case, 10 year build. You only need to 4x your budget.
X12SDV-4C-SP6F
Man, I have been looking into the X11SDV-8C-TP8F and I’m so close to pulling the trigger. I love the form factor.Do you know of any with 25g networking that also has EDIT: “QuickAssist” enabled like the X11SDV-8C-TP8F ? The jump from 4 core to 8 core on those adds QAT
this budget might be enough if you live in the US and buy cheapest used drives there are