14 months after the last release, here is a new version of my website backup script. As you can see in the changelog, this version is essentially released to fix some bugs.
Changelog:
--debug option to --verbose--dry-run option for testingpexpect methodsI’ve just released a new version of my system-backup.py script.
The main update is about the lock file, which I implemented in the last version to keep the script to run twice (or more) in parallel. This is a nice feature to avoid overlapping processes that fight each other to use the same ressources. But in some extreme cases (reboot or power failure during backup, …), the lock file will remain and so will prevent the script to start (until you notice the problem and remove the lock file manually). This new version take care of this problem and is now able to remove the lock automatically if a timeout is reached. It also kill all remaining child processes.
Here is the detailed changelog:
--preserve-numerical-ids option when adding rdiff-backup increment.I’ve updated the system backup script I’ve released 3 weeks ago to let it clean automatically rdiff-backup folders. This is mandatory because incremental backup process is transactionnal and a power failure or a reboot can break the consistency of the rdiff-backup data repository. So even if such a misfortune happened, the script will be able to revert backups to a previously consistent state.
I’ve also added a locking mechanism to prevent the script to be run twice on the same machine. I’ve added this feature because I start my script every day thanks to cron and some backups can take more than one day.
Finally, all rsync commands will now be run first to reduce the time-window during which all external machines are reached and, as mentionned above, because rdiff-backup can take lots of time to finish its job.
Here is a direct link to the new version of the script. You can also find it in my page dedicated to various linux scripts.
I’ve just write a brand new script called system-backup.py. It’s similar to my website-backup.py script but instead of website and MySQL databases, it is designed to backup systems of several machines. This script is based on an idea from the “Backup up on unreliable link” article from the official rdiff-backup wiki. It use rdiff-backup to keep the last 20 backups and rsync to speed-up the backup process.
I run this script to backup all the local machines within my LAN. I start the backup process everyday thanks to a cron entry similar to this one:
0 20 * * * root /root/system-backup.py >> /mnt/backup-disk/backup.log
If you need more information about the rsync part the script, please have a look to my previous Remote Backup with rsync article, which detail how-to setup key authentification with ssh.
Three months after the last version, here is a big update of my backup scripts for websites. The script was greatly improved and among new features, the most important is the support of backups over SSH and backups of MySQL databases.
Change log:
backup_list must specify the type property (FTP, FTPs, SSH, MySQLdump or MySQLdump+ssh).site is now host./ftp-mirror folders renamed to /mirror.rsync whenever it’s possible for bandwidth efficiency.lftp make the decision for you to send your clear password on the net.mysqldump.pexpect lib to simulate user password input.If you were using a previous version of my backup script and want to use this updated version, take care of changes, especially the ones describes in the first 3 items of the change log above.
I’ve updated my website-backup python script.
Change log:
set ftp:list-options -a command to force lftp to download hidden files (like .htaccess and so on).--force parameter to allow auto-deletion of multiple outdated rdiff-backup increments.I also added a debug mode as suggested by Sacha.
