My little homelab (Lenovo Thinkpad + Synology NAS) is starting to hit
the wall. My primary workloads are the BBS, running in a 32-bit Windows
VM, and a docker host running PiHole.

PiHole is starting to complain that the load average is starting to
exceed the number of available threads. My CPU has 2 cores, 4 threads.

I'm tempted to find a bare-boned Dell Micro desktop - I could take the
SATA drive and 32GB of RAM out of the thinkpad, and get 8 cores, 8
threads.

I like the fact that most of my homelab was cast-off crap saved from
dumpsters or bought used - being able to keep crap out of landfill while
still serving a valid purpose is nice.



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

On 19 Nov 2024, poindexter FORTRAN said the following...

My little homelab (Lenovo Thinkpad + Synology NAS) is starting to hit
the wall. My primary workloads are the BBS, running in a 32-bit Windows VM, and a docker host running PiHole.

I like the fact that most of my homelab was cast-off crap saved from dumpsters or bought used - being able to keep crap out of landfill while still serving a valid purpose is nice.

Then save some more crap from the scrap heap and add to this noble project!

--- Steve K9ZW via SPOT BBS

--- Mystic BBS v1.12 A48 2022/07/15 (Linux/64)
* Origin: SPOT BBS / k9zw (1337:3/151)

k9zw wrote to poindexter FORTRAN <=-

Then save some more crap from the scrap heap and add to this noble project!

Waiting for someone to toss out a Thinkpad T480 with a broken screen -
I've got 32 GB of ram that'll fit into it, and they have nice i7s - 4
cores, 8 threads...



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

On 19 Nov 2024, poindexter FORTRAN said the following...

My little homelab (Lenovo Thinkpad + Synology NAS) is starting to hit
the wall. My primary workloads are the BBS, running in a 32-bit Windows VM, and a docker host running PiHole.

PiHole is starting to complain that the load average is starting to
exceed the number of available threads. My CPU has 2 cores, 4 threads.

I'm tempted to find a bare-boned Dell Micro desktop - I could take the SATA drive and 32GB of RAM out of the thinkpad, and get 8 cores, 8 threads.

I like the fact that most of my homelab was cast-off crap saved from dumpsters or bought used - being able to keep crap out of landfill while still serving a valid purpose is nice.

Sounds like you're getting to the point where a small rack and 1u or 2u server would do you good... perhaps look at getting a used Dell PowerEdge R620 or similar, you can get those dirt cheap on the bay of E's, load it up with disks and memory and you're golden. Install proxmox VE on it and start virtualising all your stuffs =)

Then when you want more, add another and create a cluster so you can do live migrations of vm's and containers to make maintenance easier, and have some redundancy.

This is where things can get really fun!

---
|14Best regards,
|11Ch|03rist|11ia|15n |11a|03ka |11Me|03aTLoT|11io|15N // @meatlotion:erb.pw

|07ÄÄ |08[|10eml|08] |15ml@erb.pw |07ÄÄ |08[|10web|08] |15www.erb.pw |07ÄÄÄ¿ |07ÄÄ |08[|09fsx|08] |1521:1/158 |07ÄÄ |08[|11tqw|08] |151337:1/101 |07ÂÄÄÙ |07ÄÄ |08[|12rtn|08] |1580:774/81 |07ÄÂ |08[|14fdn|08] |152:250/5 |07ÄÄÄÙ
|07ÄÄ |08[|10ark|08] |1510:104/2 |07ÄÙ

... Computers all wait at the same speed!

--- Mystic BBS v1.12 A49 2023/04/30 (Linux/64)
* Origin: thE qUAntUm wOrmhOlE, rAmsgAtE, uK. bbs.erb.pw (1337:1/101)

My little homelab (Lenovo Thinkpad + Synology NAS) is starting to hit the wall. My primary workloads are the BBS, running in a 32-bit Windo VM, and a docker host running PiHole.

Sounds like you're getting to the point where a small rack and 1u or 2u server would do you good... perhaps look at getting a used Dell
PowerEdge R620 or similar, you can get those dirt cheap on the bay of E

This is where things can get really fun!

Dude - believe it or not, even a Dell r320 (with upgrades) can get you running w/ 20 cores and 192GB RAM - around $50...

Upgrade CPU to best Xeon - $30. $120 for 128GB RAM - and its a pretty good Proxmox host. Only 4 3.5" drives, but it will accept the big 20TBs easily.

I am surprised how much I can run on that '$50' 1U server.



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

MeaTLoTioN wrote to poindexter FORTRAN <=-

Sounds like you're getting to the point where a small rack and 1u or 2u server would do you good... perhaps look at getting a used Dell
PowerEdge R620 or similar, you can get those dirt cheap on the bay of
E's, load it up with disks and memory and you're golden. Install
proxmox VE on it and start virtualising all your stuffs =)

Then when you want more, add another and create a cluster so you can do live migrations of vm's and containers to make maintenance easier, and have some redundancy.

This is where things can get really fun!

Right now, everything's running in my office. A rack-mount server would
make too much noise. If I were looking to splurge, I'd get 3 micro
systems, create a CEPH pool and set up HA on Proxmox instead of buying
one big server.

I have an old desktop system with a 6th gen i5, 4 cores, 4 threads. My
wife used it until she needed a newer CPU for some of her apps.
I'll get that up and running for the time being, that'll throw 4 more
cores and threads into the pool.



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

Dude - believe it or not, even a Dell r320 (with upgrades) can get you running w/ 20 cores and 192GB RAM - around $50...

Indeed. I have two here. One has 192GB RAM and the other is in a similar ballpark if I remember correctly. I think one has 24 cores and the other 16.

good Proxmox host. Only 4 3.5" drives, but it will accept the big 20TBs easily.

Mine have 6 x 3.5" bays, but my recollection is that the stock RAID controller doesn't like anything above 2TB? Of course there's no requirement to use the stock hardware RAID controller :-)

I am surprised how much I can run on that '$50' 1U server.

I don't know about where you are, but over here you'll be surprised how quickly it'll run up your power bill.

That's why I don't know the exact specs of mine - they've been powered off for a few months now and I've moved the "must have" things onto a smaller HP workstation that sips the power by comparison :-)

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: TassieBob BBS, Hobart, Tasmania (1337:2/106)

Dude - believe it or not, even a Dell r320 (with upgrades) can get yo running w/ 20 cores and 192GB RAM - around $50...

Indeed. I have two here. One has 192GB RAM and the other is in a
similar ballpark if I remember correctly. I think one has 24 cores and the other 16.

Nice - I have some 172GB or something... and 20 cores; I used the best CPU is accepts, for the r320 anyway. I also run a r330 - its 'faster', with 3.7Ghz Xeon CPU, but for Proxmox the r320 is almost better w/ more cores and RAM...

good Proxmox host. Only 4 3.5" drives, but it will accept the big 20T easily.

Mine have 6 x 3.5" bays, but my recollection is that the stock RAID controller doesn't like anything above 2TB? Of course there's no requirement to use the stock hardware RAID controller :-)

Nah - even in my r320, I'm running 16TB 3.5" HDDs... and I bet the new 24TBs would fly; can't say for sure, but I tested up to 18TB drives.

I am surprised how much I can run on that '$50' 1U server.

I don't know about where you are, but over here you'll be surprised how quickly it'll run up your power bill.

I know other countries have higher electricity bills, but in the U.S. its 'nominal'. Sure, I might not have the lowest bill - but nothing thats like out of this w0rld.

I'm actually currently looking at a r720xd. I *want* the r730xd, but if I spec out the CPUs (2 are better than 1!) and RAM I think it'll make a better proxmox host than the newer gen r330... yes, slower CPU and RAM but so much more cores/RAM.

So weird how the max RAM in the newer r330 is only 64GB. Sure, its DDR4 but as stated for running VMs/CTs I think you get more oomph from the amount rather than how blazing fast they are. Can't wait till the rx40 series comes to the used markets..



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

paulie420 wrote to tassiebob <=-

I'm actually currently looking at a r720xd. I *want* the r730xd, but if
I spec out the CPUs (2 are better than 1!) and RAM I think it'll make a better proxmox host than the newer gen r330... yes, slower CPU and RAM
but so much more cores/RAM.

I inherited a couple of Simplivity servers at work based on the 720xd -
they had a boot flash drive with Simplivity on it and a custom BIOS.
Flashed the BIOS with a Dell BIOS and put ESXi on them. They were
monsters - 384 GB of RAM, I don't recall how many cores on 2 CPUs, and
12TB of RAID 10.

I should have asked to take home the R610 or R420s that they replaced,
but I had nowhere to put them. :(



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

I inherited a couple of Simplivity servers at work based on the 720xd - they had a boot flash drive with Simplivity on it and a custom BIOS. Flashed the BIOS with a Dell BIOS and put ESXi on them. They were
monsters - 384 GB of RAM, I don't recall how many cores on 2 CPUs, and 12TB of RAID 10.

I should have asked to take home the R610 or R420s that they replaced,
but I had nowhere to put them. :(

Its a fun time to be in the used server market; so long as you live somewhere that you can afford to have them running 24/7. I'm stoked that I am!



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

paulie420 wrote to poindexter FORTRAN <=-

Its a fun time to be in the used server market; so long as you live somewhere that you can afford to have them running 24/7. I'm stoked
that I am!

Server infrastructure is a swinging pendulum, buy when you can!

Everyone went to the cloud, then balked at the prices and set up local
server farms. That's how I got my most recent job - they had 100
non-production instances running in AWS and realized they could set up a
local ESX node for a fraction of the cost! Servers costs were high, it
seemed like more and more people were moving on-prem.

Swing 2: Company closed the data center and said all on-prem services
had to go to the cloud. We are here now, and servers are cheap as other
people are moving back to the cloud.

Next up? The guys from 37Signals just wrote up a blog post and a podcast
entry in their re-work podcast about how the company saved $2million in
its first year by moving back on-prem.

Here's an interesting excerpt:

Speaking of new hardware, 37signals bought about $700,000 of Dell
systems to replace its cloud instances, but Hansson claims this cost was "entirely recouped" during 2023 as those contract commitments expired
one by one.

"Think about that for a second. This is gear we expect to use for the
next five, maybe even seven years! All paid off from savings accrued
during the second half of 2023," he commented.

https://www.theregister.com/2024/10/21/37signals_aws_savings/



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

I'm actually currently looking at a r720xd. I *want* the r730xd, but if
I spec out the CPUs (2 are better than 1!) and RAM I think it'll make a better proxmox host than the newer gen r330... yes, slower CPU and RAM
but so much more cores/RAM.

I'm running the r720xd with 384 gigs of ram, 24 cores. Don't think i'll be needing another VM server for a while! got that on a deal off of the "bay" for 180 bucks, included all 26 drives and accessories!

-Scuz

--- Mystic BBS v1.12 A48 (Windows/32)
* Origin: lopht | lopht.hexedbbs.com:1337 (1337:3/204)

Its a fun time to be in the used server market; so long as you live somewhere that you can afford to have them running 24/7. I'm stoked that
I am!

Actually after I got all of my virtual machines running, then turned off all of the physical computers i have, i cut down on my electric bill! I think i average maybe 70 bucks or so a month.

-Scuz

--- Mystic BBS v1.12 A48 (Windows/32)
* Origin: lopht | lopht.hexedbbs.com:1337 (1337:3/204)

I'm actually currently looking at a r720xd. I *want* the r730xd, but I spec out the CPUs (2 are better than 1!) and RAM I think it'll make better proxmox host than the newer gen r330... yes, slower CPU and RA but so much more cores/RAM.

I'm running the r720xd with 384 gigs of ram, 24 cores. Don't think
i'll be needing another VM server for a while! got that on a deal off
of the "bay" for 180 bucks, included all 26 drives and accessories!

Dude!! Big things happened last weekend - I found a Dell r730xd for $400! 28cores (gonna upgrade CPUs so I get 40cores/80threads) and it can accept lots of RAM, too. 128GB right now - running 32GB LRDIMMs... gonna add more here, too.

I'm thinking of grabbing another HBA RAID card so I can pass all 12 front bays to TrueNAS, and have the rear 2x2.5" SSDs for OS - and thinking of adding the 4 mid-bay 3.5" HDDs on that new HBA... its going to be awesome. :P

I'm super impressed with the r730xd. That being said, I also run a r330 and r320. And TBH, the r320 MIGHT be the better Proxmox machine - thats because while the r330 takes a max of 64GB RAM, the r320 can take up to 192GB... and I upgraded its CPU to 10cores/20threads - whereas the r330 has 4cores/8threads - its like they 'downgraded' the newer generation box and I just don't understand why...

I think I'll sell the r330, and migrate the r320 into a dedicated PBS machine; I currently run my PBS in an old Dell tower; the r320 would be much more solid IMO...

Thanks for chatting... I assume the r720 is awesome, too - I once thought I wanted to only use rX30 systems, but I've been proved wrong.



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

On 12 Dec 2024, paulie420 said the following...

Dude!! Big things happened last weekend - I found a Dell r730xd for $400! 28cores (gonna upgrade CPUs so I get 40cores/80threads) and it can
accept lots of RAM, too. 128GB right now - running 32GB LRDIMMs... gonna add more here, too.

I'm thinking of grabbing another HBA RAID card so I can pass all 12
front bays to TrueNAS, and have the rear 2x2.5" SSDs for OS - and
thinking of adding the 4 mid-bay 3.5" HDDs on that new HBA... its going
to be awesome. :P

I'm super impressed with the r730xd. That being said, I also run a r330 and r320. And TBH, the r320 MIGHT be the better Proxmox machine - thats because while the r330 takes a max of 64GB RAM, the r320 can take up to 192GB... and I upgraded its CPU to 10cores/20threads - whereas the r330 has 4cores/8threads - its like they 'downgraded' the newer generation
box and I just don't understand why...

I think I'll sell the r330, and migrate the r320 into a dedicated PBS machine; I currently run my PBS in an old Dell tower; the r320 would be much more solid IMO...

Thanks for chatting... I assume the r720 is awesome, too - I once
thought I wanted to only use rX30 systems, but I've been proved wrong.

pAULIE42o
.........

Wow cool Paulie! nice work. You can find R815's around that price too so keep an eye out. Most come with the quad CPU 16 for 64 COREs and 128 - 192G ram

|23|04Dr|16|12Claw |14W0CLW
|16|14Sysop |12Noverdu |14BBS |20|15Radio|10@|14HTTP://Noverdu.com:88
|16|10 Standard ports for SSH/Telnet |04 WEB|14@|12HTTP://noverdu.com:808 |20|15Global Chat, Global Messaging and Games! |16|10Ditch the Unsocial Media

--- Mystic BBS v1.12 A47 2021/12/24 (Linux/64)
* Origin: Noverdu BBS (1337:3/177)

Thanks for chatting... I assume the r720 is awesome, too - I once
thought I wanted to only use rX30 systems, but I've been proved wrong.

Hell yea man! I have a r620 here too, but i run my security system and home automation stuffs on that one. Sounds like you're going to be busy!

-Scuz

--- Mystic BBS v1.12 A48 (Windows/32)
* Origin: lopht | lopht.hexedbbs.com:1337 (1337:3/204)

Wow cool Paulie! nice work. You can find R815's around that price too
so keep an eye out. Most come with the quad CPU 16 for 64 COREs and 128
- 192G ram

There are so many great Dell servers. I haven't played with any 4-core ones yet; I assume as years pass we'll be able to get our hands on newer and newer generations. IMO the PowerEdge platform is the best for homelab servers... I've heard people like Proliant, too, but w/ iDrac enterprise licenses being available on eBay for $30 or less I think they beat out the competition - I've heard Proliant gear buckles down their enterprise BMCs...



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

Hell yea man! I have a r620 here too, but i run my security system and home automation stuffs on that one. Sounds like you're going to be busy!

:P The 2U servers are a lot louder than the 1U ones - and have a lot more going on, too - I take the challenge.

Just sourced a guy for 2TB SSDs @ $50per. They have 150-190TB written, so they still have 50% use to go... I'll throw them in a RAID1 and have backups on hand. :P (For use as Proxmox storage) I do PBS backups nightly, so I don't mind if they aren't tip top - LOL, taking risks in this homelab baby!



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

paulie420 wrote to claw <=-

There are so many great Dell servers. I haven't played with any 4-core ones yet; I assume as years pass we'll be able to get our hands on
newer and newer generations. IMO the PowerEdge platform is the best for homelab servers...

I liked the Optiplex 9xxx series towers as mini-servers. They supported
i7/i9 CPUs, had onboard RAID (don't know if they supported RAID5,
definitely RAID 1) and could take 64 GB of RAM.


--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

I liked the Optiplex 9xxx series towers as mini-servers. They supported
i7/i9 CPUs, had onboard RAID (don't know if they supported RAID5,
definitely RAID 1) and could take 64 GB of RAM.

I'm almost over RAID fully at this point - I mainly run ZFS software RAID and haven't l00ked back! :P



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

paulie420 wrote to poindexter FORTRAN <=-

I'm almost over RAID fully at this point - I mainly run ZFS software
RAID and haven't l00ked back! :P

Some day, I'll bite the bullet and set up ZFS and ceph with Proxmox and
make a real cluster... :(



--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

Some day, I'll bite the bullet and set up ZFS and ceph with Proxmox and make a real cluster... :(

Its really cool - the ONE thing I was missing before I could try all these different things out was a PBS. If you don't run a Proxmox Backup Server, its a worthy cause to install on almost any hardware.

What it does is allow you to create backups of any PVE CT/VMs - and even other file-based backups of HDDs or any NFS shares/whatnot.

Once you have these daily backups going, its super easy to scrap yer main PVE system; just shutdown your CT/VMs, make sure theres a current backup and re-create whatever setup you want to test. Restoring CT/VMs, or even file-based HDD/shares is super easy... this allows you to try things that weren't available without a PBS.



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

Hello paulie420!

16 Dec 24 19:11, you wrote to poindexter FORTRAN:

Some day, I'll bite the bullet and set up ZFS and ceph with
Proxmox and make a real cluster... :(

Its really cool - the ONE thing I was missing before I could try all
these different things out was a PBS. If you don't run a Proxmox
Backup Server, its a worthy cause to install on almost any hardware.

What it does is allow you to create backups of any PVE CT/VMs - and
even other file-based backups of HDDs or any NFS shares/whatnot.

+1 for PBS. It took me a while to realise that it was so much better than just NAS backups as it does incremental & ZFS de-deplication also - resulting in far less disk usage on my "backup" NAS.

Satch

|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

Satchmo


--- GoldED+/LNX 1.1.5--b20170303
* Origin: Sonic BBS - North Yorkshire, England (1337:1/107)

Re: FInally hit a wall...
By: Satchmo to paulie420 on Tue Dec 17 2024 04:38 pm

+1 for PBS. It took me a while to realise that it was so much better than just NAS backups as it does incremental & ZFS de-deplication also - resultin in far less disk usage on my "backup" NAS.

Ok, you sold me. I'm backing up the same download files over and over and over again...
--- SBBSecho 3.23-Win32
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

+1 for PBS. It took me a while to realise that it was so much better
than just NAS backups as it does incremental & ZFS de-deplication also - resulting in far less disk usage on my "backup" NAS.

Another thing I recently figured out w/ PBS is that it can handle much more than just Proxmox CT/VMs; it can also do file-based backups using proxmox-backup-client, meaning I now use it to make 3-2-1 backups of my entire NAS NFS shares...

Those run a bit slow, IMO - even tho I have them mounted on a 10GB NIC... kinda weird; maybe I need to check into that setup a bit more.

I hate that TrueNAS doesn't like me to install outside tools (like proxmox-backup-client) so I have to run it on the PBS machine instead of right on the TrueNAS box. :/

Having used rsync in the past, I really like this solution for more than just PVE stuff.



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

+1 for PBS. It took me a while to realise that it was so much better th just NAS backups as it does incremental & ZFS de-deplication also - res in far less disk usage on my "backup" NAS.

Ok, you sold me. I'm backing up the same download files over and over
and over again...

It's so cool - if you have a backup if:

file1.ext
file2.ext
file3.ext

And backup... and add files;

file1.ext
file2.ext
file3.ext
file4.ext

And backup again - only file4.ext takes up more space.... then, if you remove some stuffs;

file1.ext
file3.ext
file4.ext

And run a 'prune' command, file2.ext is removed. :P Its so flipping nice. As opposed to using other methods that have you copying the same data over and over again...



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

paulie420 wrote to poindexter FORTRAN <=-

+1 for PBS. It took me a while to realise that it was so much better th just NAS backups as it does incremental & ZFS de-deplication also - res in far less disk usage on my "backup" NAS.

Ok, you sold me. I'm backing up the same download files over and over
and over again...

It's so cool - if you have a backup if:

I think I'm going to run PBS as a VM under Proxmox instead of a
bare-metal install. My only spare system at the moment is a Pi 4, and
it sounds a bit complicated. If I needed to, re-installing Proxmox,
changing the basic settings and installing PBS shouldn't be too hard.

I'm backing up to NFS, not locally to PBS.

Deduping should save a ton of space - I do a full backup of the BBS VM
through Proxmox and a file-level backup to NFS weekly.




--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

I think I'm going to run PBS as a VM under Proxmox instead of a
bare-metal install. My only spare system at the moment is a Pi 4, and
it sounds a bit complicated. If I needed to, re-installing Proxmox,
changing the basic settings and installing PBS shouldn't be too hard.

So - if I move my PBS machine from the Dell tower to one of my Poweredge servers, I might run it on top of Proxmox, too; this way I could get rid of a Raspberry Pi Proxmox quorum node that I run. [I have a 3 node Proxmox cluster...]

I'm backing up to NFS, not locally to PBS.

I use my NFS for file storage; like on all my laptops ~/Downloads, ~/Documents, etc etc - I syncthing to the NAS... then I backup the entire NAS to my PBS. So I guess ONE of my backups gets sent to the NAS, but I try to keep a proper 3-2-1 backup system - its getting so big, however, that I'm gonna have to buy more hardware in order to get an offsite backup.

One really cool thing I've been looking into - is linking up with someone else who has the same sized NAS as I do, and doing the remote backups with them. I give them access to some share on my NAS/PBS, and they do the same for me, and we send encrypted backups offsite; sharing the hardware we run so we both have a FINAL 3-2-*1* backup offsite... I just need to find someone else who runs a 100TB+ NAS. :P



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

Re: Re: FInally hit a wall...
By: paulie420 to poindexter FORTRAN on Wed Dec 18 2024 07:37 pm

Howdy,

so we both have a FINAL 3-2-*1* backup offsite... I just need to find someone else who runs a 100TB+ NAS. :P

How much data is on that 100TB nas backup?

I dont use PBS, but I'm a restic fan. So a backup without a server - you just need a "target" to store your backups - and in my case, I have an S3 target setup (using minio).

It also supports de-dupe, compression and encryption :)

At the moment, my "offsite" is a 2TB pCloud disk, so I use restic to backup my important data on the NAS to a specific 2TB drive, and then replicate that drive to pCloud. (So I have fast recovery if I need it, and protection if my house burns down. :)

I'd actually prefer to restic to another s3 target (pCloud unforutnately doesnt support s3, so its a hack of rclone to make it work).

Be happy to be that 3rd party offsite, but I could only provide an S3 target (with an SSL client - so encrypted tunnel, and restic stores the backup encrypted).

I dont have 100TB, spare, but my NAS has spare slots and I have a couple of 4TB drives here, somewhere ;)

Restoring from it would be a pain though, while I'm 1000MBs down, I'm only 50MBs up at the moment, hoping to change that to 250down/100up soon...

Thought I'd mention it :)


...ëîåï
--- SBBSecho 3.20-Linux
* Origin: I'm playing with ANSI+videotex - wanna play too? (1337:2/101)

paulie420 wrote to poindexter FORTRAN <=-

I use my NFS for file storage; like on all my laptops ~/Downloads, ~/Documents, etc etc - I syncthing to the NAS... then I backup the
entire NAS to my PBS. So I guess ONE of my backups gets sent to the
NAS, but I try to keep a proper 3-2-1 backup system - its getting so
big, however, that I'm gonna have to buy more hardware in order to get
an offsite backup.

I do something similar - store media locally on a spinning drive. Use
Resilio Sync to back up to my Synology. Use Synology backup to back up
to an external USB drive.

One really cool thing I've been looking into - is linking up with
someone else who has the same sized NAS as I do, and doing the remote backups with them. I give them access to some share on my NAS/PBS, and they do the same for me, and we send encrypted backups offsite; sharing the hardware we run so we both have a FINAL 3-2-*1* backup offsite... I just need to find someone else who runs a 100TB+ NAS. :P

If you want to rent out space on your NAS, I might have a business
model for you. :) I'm looking into AT&T fiber, and once I'm off of
Comcast with their bandwidth caps, am looking at backing up to the
cloud somewhere as another layer of protection. I've only got around
3TB I'm backing up.




--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

so we both have a FINAL 3-2-*1* backup offsite... I just need to find someone else who runs a 100TB+ NAS. :P

How much data is on that 100TB nas backup?

Well; I'm currently @ 30TB or so, but for THAT offsite backup I wouldn't even mind finding a buddy for personal photos/stuff that would be much less. (Or, for the whole enchilada!!)

Restoring from it would be a pain though, while I'm 1000MBs down, I'm
only 50MBs up at the moment, hoping to change that to 250down/100up soon...

Thought I'd mention it :)

Thanks kindly; and I'm the same - I've been eying a much cheaper (so they say, anyway) fiber internet thats available here w/ 1Gbps/1Gbps - but it has that weird IP that changes and makes another step for running the public-facing services... (bbs, etc)



|07p|15AULIE|1142|07o
|08.........

--- Mystic BBS v1.12 A49 2024/05/29 (Linux/64)
* Origin: 2o fOr beeRS bbs>>>20ForBeers.com:1337 (1337:3/129)

Re: Re: FInally hit a wall...
By: poindexter FORTRAN to paulie420 on Thu Dec 19 2024 09:15 am

Howdy,

If you want to rent out space on your NAS, I might have a business
model for you. :) I'm looking into AT&T fiber, and once I'm off of
Comcast with their bandwidth caps, am looking at backing up to the
cloud somewhere as another layer of protection. I've only got around
3TB I'm backing up.

Have you heard of tahoe-lafs?

I played with it a few years ago - and its design is perfect for this.

It's effectively raid (or erasure coding) across unreliable targets. IE: Everybody provides capacity, and data stored is split, encrypted and erasure coded across everybody's drives (so no single person has a full file - and the data is encrypted anyway).

If a node goes down, your data is still recoverable from other targets - upto the parity setting. IE: If you set parity to 3, then 3 systems can go offline and your data is still accessible.

The trouble I had with it, is health check and repair, there didnt seem to be an easy way to manage, validate and repair as a hosting "node". IE: If I had two drives, one failed and I replaced it with a new drive, I couldnt recover all the "chunks" for data hosted there - only the data owner could.

Development was slow as well...


...ëîåï
--- SBBSecho 3.20-Linux
* Origin: I'm playing with ANSI+videotex - wanna play too? (1337:2/101)

deon wrote to poindexter FORTRAN <=-

Have you heard of tahoe-lafs?

No, I haven't. Sounds interesting!

I played with it a few years ago - and its design is perfect for this.

It's effectively raid (or erasure coding) across unreliable targets.
IE: Everybody provides capacity, and data stored is split, encrypted
and erasure coded across everybody's drives (so no single person has a full file - and the data is encrypted anyway).

I'm thinking Pied Piper, now. :)

If a node goes down, your data is still recoverable from other targets
- upto the parity setting. IE: If you set parity to 3, then 3 systems
can go offline and your data is still accessible.

That would be an interesting experiment, if a group of people got
together and offered x amount of disk space and bandwidth into a storage
pool.


--- MultiMail/Win v0.52
* Origin: realitycheckBBS.org -- information is power. (1337:3/178)

Re: Re: FInally hit a wall...
By: poindexter FORTRAN to deon on Fri Dec 20 2024 10:00 am

Howdy,

That would be an interesting experiment, if a group of people got
together and offered x amount of disk space and bandwidth into a storage pool.

So I'm in - I've been meaning to take another look at tahoe to see how it has progressed...

I'll look at making a docker image, so that's easier to install/setup. If others are interested (not necessarily using the docker image), then let me know - it'd be good to see how well it works - and performs.

Ideally there should be 5 minimum in the cluster, but more is better ;)


...ëîåï
--- SBBSecho 3.20-Linux
* Origin: I'm playing with ANSI+videotex - wanna play too? (1337:2/101)