This is your annual reminder to do a snapshot (timeshift or whatever you prefer) before doing relatively minor changes to your system.
I was supposed to be in bed now, but instead I am stuck troubleshooting xorg refusing to start after an apt-get dist-upgrade.
And as far as friendly reminders go, I should’ve given myself an unfriendly reminder beforehand, as it’s not the first time…
UPDATE: Fuck nvidia 545. All my homies hate nvidia 545. 535 4 lyf!
BTW, nixos allows you to easily roll back to a previous generation on boot in case an update breaks something.
Just sayin’ 😁
So does Fedora Silverblue for the record.
It is a damn impressive feature to realize you just broke your install and are able to say “no problem”.
deleted by creator
Silverblue gang!
Si does tumbleweed, two-clicks rollback from the GRUB menu
Opensuse’s aeon is gold
Friendly reminder: just don’t buy nvidia
Unfortunately for those of us that use Cuda features, AMD just really isn’t that viable of an alternative. Anyone who’s had to deal with ROCM can attest to this…
As soon as AMD is competitive in price/performance in my region. I won’t give them money just becauae they have open source drivers.
nvidia mentioned
… the single worst company …
Nestle has entered the chat.
Woah, stop! No professionals!
BP has entered the chat
IG Farben fades away the competition.
I wish. They are not even close.
Linux noobie here. Any tips on what to search for for instructions on how to do this? Bonus points if it has a GUI and is easy to use.
Timeshift. It has an easy to understand GUI that doesn’t really need much of an intro: You create snapshots of your system files and configs that can be restored if/when you bungle it up.
Timeshift works best if you use BTRFS for your root partition because snapshots can be taken instantly. I have mine setup to automatically take a snapshot every day.
Never used it myself and i am still a linix noob but what is the restore process if your OS isnt bootable?
If their like a rescue environment you boot into or something?
There are many approaches, depending on what broke. In my case the system was fine, just xorg being completely borked. So I logged into the console and fixed it.
If regular console doesn’t work, something really went bad during boot, for which there’s single-user mode which is kind of similar to safe mode from Windows 98 (I’m sure there’s something similar in newer windows versions).
And of that doesn’t work, there’s the minimalistic rescue shell.
And if that doesn’t work, you can boot from a USB or some other external media and try to fix your system from that, maybe even using chroot to use the system somewhat normally.
As long as your file system is on BTRFS, timeshift is, I O, the easiest backup app for Linux, specially if you’re just getting your feet wet in it.
Why does Timeshift only support btrfs? Is it just a lack of developers? LVM supports snapshots too, even if you’re just using ext4. ZFS supports snapshots too.
Timeshift supports rsync snapshots. No btrfs needed :)
Thanks for letting me know. It’s never worked on any FS other than BTRFS for me, I’ll give it another shot.
I will never install a Linux desktop without a snapshotting root filesystem ever again. Nvidia driver updates, /boot getting too full during kernel or driver updates, a bad update of pipewire half a year ago, and more I can’t remember. Was always able to boot to previous snapshot of the OS, and address whatever it was. Some ZFS here, some BTRFS there… and my small fleet of Linux desktops are as easy to recover as any immutable OS. Better even, because snapshots allow me to pull individual items or things between states easily, too.
When u realize you dont even use a backup software rn
I just copy my whole-ass home dir to an external drive every so often like a caveman.
I just make sure I don’t have any important data.
Which you should absolutely do even if you snapshot the eff out of your system. What about hardware failure, eh? Can’t snap that nvidia shit can you?
Am on LMDE6 with an ancient Nvidia card. Because I’ve had to resort to using the Nvidia OEM driver installer (which can be a pain to use), installed Xorg updates lurk quietly until a full reboot at which point they generally cause offloading of GPU tasks to the CPU instead because it hasn’t figured things out properly.
Timeshift has been useful at least twice in getting me back to a less stressed system.
I think I have a procedure figured out now though (documented here for posterity even if it helps no-one today):
-
Make a Timeshift snapshot just in case
-
Install the pending Xorg update
-
Reboot so it’s fully active
-
Check to see if GPU tasks are being offloaded to the CPU by doing something graphics intensive and noting temperatures or usage%. If not, a miracle has occurred and continuing isn’t needed.
-
sudo
remove the execute permission on/usr/bin/Xorg
so that it can’t immediately be restarted by subsystems designed to protect the average Mint user from command lines and consoles. -
Kill Xorg
-
Log in through a console, via Ctrl+Alt+F1 or similar if not dumped to one by killing Xorg.
-
Re-install the Nvidia OEM driver
-
sudo
put the aforementioned execute permission back on -
Repeat steps 2 and 3 and hope that this time the GPU is doing the work.
Reboots ought to be replaceable by running specific commands, but I haven’t gone deep enough into things to know the right things to do there. Reboots are quick and easy enough.
Obvious intermediate steps include not doing anything else important during this and saving important work before starting.
e.g. did you know it’s possible to bookmark all open tabs? Well worth looking into.
-
Timeshift with BTRFS kicks ass. I have mine set for daily snapshots, retained for a week. Only the changes between snapshots are stored, so the extra disk usage is minimal, and easily justified by the peace of mind in case of fuck-ups or broken updates.
Only the changes between snapshots are stored, so the extra disk usage is minimal
If you want to use a similar approach for backups, Borgbackup is a pretty nice piece of software. I have two backups of my most important files: One on my NAS at home, and one “in the cloud” on a storage VPS (ends up way cheaper than using S3, B2 or anything like that).
Which storage VPS have you selected? I’m looking at Hetzner atm.
I’ve got one with HostHatch that’s 10TB of space for $10/month. It was an offer they had during Black Friday 2020. They had a similar offer during Black Friday 2023 but I think it was around $20/month, paid yearly.
I live in the San Francisco Bay Area and my storage server is in Los Angeles, which is around 10ms round-trip ping time from my home internet connection.
Hetzner is good too. They have relatively cheap “storage boxes” that are a shared environment rather than a VPS. You don’t get proper SSH access, but they do support FTPS, SFTP, Samba, Borgbackup, Restic, rclone, rsync and WebDAV. https://www.hetzner.com/storage/storage-box
Borgbackup encrypts the backups, so the host won’t be able to actually view your backups.
Sorry cant hear you, too busy computing with the safety switched off and the action set to full auto.
Neat little guide (Arch, systemd) to set up automatic snapshots when you run a pacman/yay update and the option to chose snapshots in grub during startup. Really useful.
Is it dumb that I only backup my docs and anything else I think is important? I can rebuild fairly quickly if something would happen. I ask since I know that people backup a variety of their directories
If you’re comfortable, you’re fine. Anything more would just be to speed up the rebuild, so it’s less important if you don’t mind taking the time.
The nvidia 545 drivers are an absolute dumpster fire. Even for beta drivers they are easily the worst drivers I’ve ever used. They claim to fix the vrr gsync bug tho… so as soon as they fix gestures broadly everything else, maybe they’ll be good
Remember to check your three "B"s; your balls, your breasts and your backups.
I’m on 545 and I have no issues. But I’m also not using Ubuntu…
Maybe it’s the distro that’s the problem not the backup. I mean I’d rather have a distro with smooth updates than one that makes me need snapshots.
What’s even the point with such a distro, ok so I restore previous working state, then what, I can’t do updates anymore? Living in fear of official updates sounds terrible.
I think it’s just dumb to not make a backup before large updates. There’s so many things happening, a lot can go wrong, especially if you have added 3rd party repos and have customized core parts of the system, not just through config files but let’s say you switched to latest kde plasma from the one your distro ships.
And what happens if you have to restore the backup?
You can look up what’s the solution to your problem in peace while everything is still working. If it was a server, all the services are still available, if it was your desktop you don’t have to use a live linux usb that’s without all your configs to find the solutionYou make a good point. Ubuntu gives you so many ways to shoot yourself in the foot that it’s pretty much a given that it will get messed up eventually. So you have to use snapshots.
On Arch based distros the updates just work. I’ve never had to snapshot anything. But having just one single community repo (AUR) contributes to that a great deal.
I don’t like Ubuntu, and I do like Arch’s philosophy. But I think Arch is the more prone to breakage of the two.
Except that time a year and a bit ago where an Arch update broke Grub for a huge number of users.
No distro is immune to breakage.
And a filesystem snapshotting tool would help you restore bootloader how?..
So you agree, Arch can also break by updating.
Of course it can. And your PC can also fall off the desk. I’m saying a snapshot tool is a really poor solution for distro problems, it’s really a bandaid for a problem that shouldn’t exist.
Use a decent distro, take proper backups, and use snapshots for what they were intended — recovering small mistakes with personal files, not for system maintenance.
Use a decent distro
That’s the point – your claim about deb-based distros is just anecdotal.
The example here is Nvidia updates borking the system. I’ve have that happen to me numerous times on Arch-based systems.
I’ve run deb-based distros on some boxes over years of updates with no issues. On the other hand I’ve had updates cause breakages on Arch-based systems pretty much every time I’ve run them.
Which is to say anecdotes are useless, updates can break systems, and being able to immediately roll back to a working system and deal with updating later is a simple, nice thing to have with no downsides.