4 comments

  • jpgvm 10 days ago
    So if the author is here some feedback:

    You should rewrite this with libdevmapper instead of shelling out to 10's of shell tools. It will likely be both more robust, faster and result in cleaner logic.

    Otherwise the idea looks great. I would also consider adding native cloud storage option, ala S3 and friends as that would make it the most useful.

    • sillysaurusx 9 days ago
      > I would also consider adding native cloud storage option, ala S3 and friends as that would make it the most useful.

      Careful! Egress bandwidth is insanely expensive for almost all cloud providers. GCP is $0.12/GB, so downloading a 1TB backup would cost you $120.

      You can get a 64TB Hetzner server for 79 euros a month + free bandwidth: https://www.hetzner.com/dedicated-rootserver/matrix-sx

      • minimalist 9 days ago
        I remember this tool coming out of the Qubes community, where people seem to be justifiably skeptical to adding dependencies. Also if this were to run in say Dom0, a shell script is easier to use and inspect than installing applications in the privileged environment that may be stuck on whatever old version your Dom0 environment may be.

        So, please keep it as is, continue to do this one thing well, and leave cloud synchronization to the number of other tools already exist to this end.

        I wonder if it is useful to consider the duties of backup (which may include version) and synchronization as separate. At least it helps me not fall for the false security in thinking that one system will just do everything.

      • phdelightful 10 days ago
        Of course last weekend I just stitched lvm2 and restic together to do an incremental snapshot backup. I'll have to consider whether this is a better solution.
      • creshal 10 days ago
        Would be interesting, if we hadn't moved everything to ZFS years ago.
        • linsomniac 10 days ago
          My backup server has been running ZFS for over a decade and I love it for that and for archives. The bulk of my systems run ext4, because until 20.04 it wasn't really a thing to have bootable ZFS on Ubuntu (yes you could do it, I didn't because reasons). My backups use rsync to pick up incremental changes, so full filesystem scans are involved and the backup server gets pretty busy because of those.

          One interesting thing I did at one point was to clone and mount LVs of running Windows VMs, so I could then rsync backup them on the same backup server. With the exception of a handful of physical boxes, my fleet is entirely Linux VMs running on Ganeti hosts with LVM for storage.

          This project has me imagining doing VM-level backups by talking to the ganeti hosts and backing up LVM clones outside the host, rather than rsyncing into the host.

        • linsomniac 10 days ago
          TL;DR: zfs send/receive for LVM