Almost forgot before going to bed but I feel bi-weekly is a good rhythm for this.
Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.
Just set up Lemmy! I wonder if this gets through
I’m reading it so I’d say it works!
Hell yeah, you just sent the first notification to my instance :)
That’s actually so cool and the more I think about it the more it’s making me really want to host my own Lemmy instance. Can I ask what sort of hardware resources you’re running it on?
Sure! It’s a Lenovo m910q tiny. Mine has an i7-6700 and 32GB RAM but Lemmy runs in a VM with 4 cores and 8 GB RAM which should be plenty, it’s not even using half that RAM. Disk Space seems to be the limiting factor after a while since it keeps copies of all remote threads and comments but that can be cleaned up too.
Found some threads online on resource usage beforehand like this: https://lemmy.ml/post/440678
I’m currently looking to connect an NVMe SSD to a Pi 4 I have in a differences location to finally have proper 3-2-1 backups. I’m trying to find a NVMe to USB adapter that will work though.
Currently doing a full backup of 37TB to tape. Which I would normally do once per quarter but I got a smart error on one of my drive that I’ll have to replace but before shutting down and removing the drive I want to have a full backup I might even get warranty on the drive at least I got the last time this happened drive has lower then 200 days of runtime. We’ll see
What hardware are you using to read/write tape, and what does that cost you?
I’ve got around 30tb that I need to shift off of a Drobo at some point so I can repurpose the drives into a proper RAID setup that isn’t a closed source black-box from a dead company (that was a poor choice, 6 years ago 🙁). Keeping an eye out for solutions for when I get around to fixing that mess.
That’s why I initially got them to reorganize my raid setup and have them as backups in case I need them. So I’m using lto4 which is 800gb per tape (current standard is lto9 16TB per tape) And it really depends on how cheap you can get the drive for me I got a tape drive for like 200€ and bought bunch of tapes ~50 for 6€ per tape if you can get a LTO5 drive for a similar price you would only need half the amount of tapes. So all in for me it was 500€ but you can definitely buy less tapes if you don’t need that many all at once. For your 30tb that would be 228€ in tapes.
It was great fun researching the topic and comparing different eBay listings for hours 😅
Interesting; I’ll definitely have to keep that in mind. Much cheaper than getting basically a whole new set of hdds at almost $30/tb (new nas-grade drives, not referbs).
Thanks!
I upgraded immich without breaking everything. That’s always reason to celebrate.
How exactly does stuff get broken? Never rly had a problem bumping up the version in docker. The only issue has been the playstore version taking longer to push updates sometimes for the mobile apps.
A few versions ago I upgraded it and some default port configs changed rendering it unusable. Since my upgrades are a docker command, I had to go hunt down the error message. It didn’t take long, but it def broke the setup.
I feel you 😂
I’m running the Immich
FlatpakSnap specifically for this reason. It’s always one version out of date but always self updates without issues :)flatpak
You mean as a client or a server?
I misremembered; I run “Immich Distribution” which is a snap and I run it on a Debian server.
I finally moved from reddit to Lemmy. maybe a 3-4 hour set up time to get it all working lol.
Cool! Which installation method did you use?
I did manual docker. I host some other things as well, so running it through nginx proxy manager that I already had set up.
I also planned to do the same (bare nginx instead of NPM but otherwise the same). Did you just remove the nginx container from docker compose and use the same arguments in NPM or do you double-reverseproxy or something else?
Short answer, yes I removed the nginx container from the lemmy compose file. I followed this guide if it helps: https://www.reddit.com/r/nginxproxymanager/comments/1485y0d/getting_lemmy_running_with_a_separate_nginx_proxy/
Cool, thanks!
Finally moved all my lxc onto a lower-power Xeon D host, consumes 1/3 the electricity of my previous Dell R430, same essential performance.
I plan on setting up the *arr suite and getting rid of Netflix, Crunchyroll, Amazon Prime and Disney+
You can use https://schedule.lemmings.world/ to automate the posts. Or, given the community we’re in, you can selfhost it!
This week I’ve been doing some work on my GOG Downloader to finally back up all my GOG stuff when I buy new disks, that’s pretty much it for my selfhost/homeserver stuff this week.
I didn’t know that, cool! Though I should probably talk to the mods before setting up such a thing.
I’m the one who files the most bug reports on github under a different name. Our instance runs on Lemmy Schedule, so thanks!
Finally got my lemmy instance fully updated.
Been improving my backup scripts in advance of adding backup to a server.
Updated servers and other services.
I’ve had two failed harddrives in the last month. Not sure if bad batch or what. Thankfully the order these were on only were the two drives so may not see more. They are under warranty but it’s still a pain!
Otherwise I’m enjoying Mealie lately for my recipes. Kinda nice having them all in one place but accessible by anyone in the house.
I love mealie as well. My wife and I keep all our recipes in mealie.
I found Mealie to be a bit bloated and not fitting my needs too well. I moved to KitchenOwl. Small project but I love it.
Had a hard drive fail my main zfs array. First time I have experienced a disk failure so it was a bit worrying. Thankfully I had added an additional drive to expand the array so I was able to quickly rebuild to that drive. Currently shopping for a replacement. From now on I think I will keep a cold spare just in case this happens again. I just wish hard drives would stop increasing in price.
You save some money by buying recertified drives from Serverpartdeals.
Yea that is what I have been doing. Although it seems the smaller sizes are not a great deal anymore and I am hesitant to buy anything larger due to the long rebuild times
Trying to get my hands dirty with LLM, Ollama and Web Scrapping.
I don’t understand most of it , but hey, that’s the fun. No complaints.
Just swapped VPS hosts from ssdnodes to MassiveGRID. Got a pretty sweet deal, so I’m pretty excited.
Got my services transferred over this week and it’s been fun as hell. It’s interesting because I was discussing Portainer with my buddy and he has Portainer on his local PC to connect to his remote instances and with hindsight it sounds obvious of course, but it’s such a nice little setup. Just finished setting up my Jellyfin reverse proxy so I’m gonna watch a movie and chill.
I used Portainer for a while and still like it for checking out networking stuff, but try out Dockge! It’s more open sourcey and basic, but makes updating easier.
Dockge
Dockage was nice, and it was much simpler, however, I had to leverage more docker commands via my VPS with it, because there weren’t a lot of options, specifically network settings.
I’ve been working on some bash scripts to help manage my media files. I’ve been slowly working on learning more bash and I’m pretty pleased with my progress. After I finish this bash book I’m reading (can’t remember the title atm), I think I’m gonna jump into awk.
Bash is a really great shell, but consider trying out a functional shell scripting language like Elvish (which is also a shell). Syntatically it’s pretty similar and not hard to pickup, but it’s stupid powerful. A cool example is updating different servers via ssh in parallel using a
servers.json
file;[ {"name": "server.com", "user": "root", "identity": "~/.ssh/private_key0", "cmd": "apt update; apt upgrade -y"}, {"name": "serverb.com", "user": "root", "identity": "~/.ssh/private_key1", "cmd": "pacman -Syu"}, {"name": "serverc.com", "user": "root", "identity": "~/.ssh/private_key2", "cmd": "apk update; apk upgrade"} ]
and a little elvish magic;
var hosts = (from-json < servers.json) peach {|h| ssh $h[user]@$h[name] -i $h[identity] $h[cmd] > ssh-$h[name].log } $hosts
Just run the script and boom, done. You can even swap out
peach
which isparallel each
foreach
if you want to do each command procedurally–but I really love using peach, especially with file operations over many different files. Linux is fast, but peach is fuckin’ crazy fast. Especially for deleting files (fd -e conf -t file | peach {|x| rm $x }
, or one thing that I do is extract internal subs (so they play on my chromecast) in my Jellyfin server, using elvish makes it really fast;fd -e mkv | peach {|x| ffmpeg -i $x -map 0:s:0 $x.srt }
Find all
*.mkv
files, pass the filenames through ffmpeg (using peach) and extract the first subtitle asfilename.mkv.srt
. Takes only about a few seconds to do thousands and thousands of video files. I highly recommend it for home-labbers.
Pretty dumb example, but
peach
is like 6x faster;❯ time { range 0 1000 | each {|x| touch $x.txt }} 5.2591751s ❯ time { range 0 1000 | peach {|x| touch $x.txt }} 776.2411ms
Since it’s winter and I mostly don’t want to leave my house, I busted out an unused Raspberry Pi 4b a couple weeks ago. Started with CasaOS and AdGuard. Have now added a few other services including Navidrome to serve up a lot of local-area music for myself and friends. Got a Cloudflare tunnel set up, then some authentication through CF as well. And finally secured a static IP from my ISP. This is the farthest along I’ve ever gotten with any of this and it’s been going great. Nearly every hurdle I’ve encountered I’ve been able to work through.
Two things causing me grief today though:
-
I also have Nextcloud hosted on a VPS and I cannot get to the point of running occ commands. First it wasn’t found, then no php cli, then just errors. I gave up.
-
I’m using Homer because it’s just so simple, but the theming and CSS is driving me nuts. Sure, I can change colors, but will this little bar in the neon theme change from 4em to 100% for me? NOPE. Override fonts? Nosir. All good though.
Try the OCCWeb app in nextcloud apps.
Thanks! It just threw an error at me when I launched it, but I’ll see what I can do. Based of the warnings in the admin panel, there isn’t anything critical for me to address, I just hate that orange.
-