Nightly restic backup takes nine hours and the repo grew 400GB in a month Backups
Backing up about 3TB from the server to a remote object store with restic, nightly, single job. It started at around 90 minutes and it now takes nine hours, and the repository has grown by roughly 400GB in the last month even though I have not added anywhere near that much new data. Retention is set to keep daily for 30 days. There is a photo library, a media folder, and a couple of database dumps in there. Where is that growth coming from?
@cloze_kai · 7mo ago · 2 replies
For the nine hours, check whether you are running
forgetwithprunein the same window. Prune on a large remote repository is enormously slower than the backup itself and it is easy to have scheduled them together. Splitting prune to weekly took my nightly job from six hours to 40 minutes.Reply
Report
@quietpackets · 6mo ago
Also worth separating the media folder into its own repository with a different schedule. Backing up rarely-changing bulk data nightly is mostly a waste of scanning time.
Reply
Report