If software depends on specific infrastructure to work, then it should have it as a hard requirement. Haven’t tried Ceph myself, but this sounds like there’s something very wrong with it conceptually or the way it’s set up.
It’s more that Proxmox has a weird niche laying between both enterprise/small-medium business and also homelab infrastructure.
Ceph is designed towards the former where 10Gbe fibre and hosts with a boatload of RAM is fairly commonplace.
My problems were a result of not paying close enough attention to those requirements and just hoping it would work on small micro PCs with 12GB of ram.
Yeah, but even if that’s the case, I would expect it 1) to refuse to run at all if something’s not fit or 2) to just be bottlenecked by the network instead of making data disappear altogether.
16sfp ports is basically a single home office amount.
You got the outside wire to firewall, firewall to router, router to your pc, wife pc, kid pc, home NAS, and home server. Maybe another one to a poe switch for cameras and doorbells too. Nine ports needed with just a basic setup.
Oh. That’s a no brainer for anyone who regularly uses their network though? I have a 70gb music library I move around a lot for my mp3 player because I’m still playing with conversion settings. The difference between a 15 minute transfer vs a 3 minute transfer is huge if it keeps coming up. Before that it was large amounts of family vhs recordings getting moved. Platee has their own example just below me too.
1gbps is plenty for like, the family watching Netflix or YouTube or whatever, but anyone running a homelab will eventually run into long wait times when playing around with the server and nas at just 1gbps. Maybe you don’t care and just wait it out, but for me at least, part of the fun is getting new parts, and then actually seeing those parts getting used entirely. A 16 port sfp switch isn’t necessarily cheap, but around 300$ means it could be this months hobby purchase without too much fuss.
Dude are u running a data center in ur basement or what lol
A Proxmox cluster with Ceph pretty much won’t work without 10Gbps.
It’ll slowly fail and all your data will get lost. Ask me how I know.
(Also, you need at least 4GB memory dedicated to Ceph on each node… Another compounding lesson learned)
If software depends on specific infrastructure to work, then it should have it as a hard requirement. Haven’t tried Ceph myself, but this sounds like there’s something very wrong with it conceptually or the way it’s set up.
It’s more that Proxmox has a weird niche laying between both enterprise/small-medium business and also homelab infrastructure.
Ceph is designed towards the former where 10Gbe fibre and hosts with a boatload of RAM is fairly commonplace.
My problems were a result of not paying close enough attention to those requirements and just hoping it would work on small micro PCs with 12GB of ram.
Yeah, but even if that’s the case, I would expect it 1) to refuse to run at all if something’s not fit or 2) to just be bottlenecked by the network instead of making data disappear altogether.
16sfp ports is basically a single home office amount.
You got the outside wire to firewall, firewall to router, router to your pc, wife pc, kid pc, home NAS, and home server. Maybe another one to a poe switch for cameras and doorbells too. Nine ports needed with just a basic setup.
I also converted my gaming rig into a hypervisor.
But I think they meant more along the lines of me running a 10gbps switch.
Oh. That’s a no brainer for anyone who regularly uses their network though? I have a 70gb music library I move around a lot for my mp3 player because I’m still playing with conversion settings. The difference between a 15 minute transfer vs a 3 minute transfer is huge if it keeps coming up. Before that it was large amounts of family vhs recordings getting moved. Platee has their own example just below me too.
1gbps is plenty for like, the family watching Netflix or YouTube or whatever, but anyone running a homelab will eventually run into long wait times when playing around with the server and nas at just 1gbps. Maybe you don’t care and just wait it out, but for me at least, part of the fun is getting new parts, and then actually seeing those parts getting used entirely. A 16 port sfp switch isn’t necessarily cheap, but around 300$ means it could be this months hobby purchase without too much fuss.
Nah, most people have an ISP provided router and have everything on WiFi.
People with a homelab and home network capable of 10gbps are a vast minority.
The nice thing about keeping most of my stuff on spinning rust is the throughput on the drives are just about the same as the network.