Because of the version conflict I got to thinking that using rdiff-backup might not be such a good thing. All machines would have to be the same version, etc.etc.
Sjau's similiar experience and comment got me to read the rsync snapshot backup HowTo. Additionally I am reading Dave Taylor's book "Wicked Cool Shell Scripts" which has a couple of scripts for backing up.
I think I like the rsync backup method because rsync seems to work no matter which OS your using (Is there an "Rsync" for Windows??).
No matter which method you use for backup you also have to decide what's important to backup. Regarding this, I have seen some discussion as to doing "binary" backups of MySQL and backups using the mysqldump command. Which do most people prefer and why? Additionally if someone would wish to point me to any other articles/books/howto's that discuss the reasoning behind backing up certain directories/file trees I would be appreciative.