We've been trying to get our backups into a state where we would be able to easily rsync them from our live server over to our backup server. The problem is that to date we've been unable to move them over in a reasonable amount of time due to the number of files.
Somewhat recently we found out about the --zip and --zipStore switches for the zmbackup command. From what we read everything indicated that the zip options would put all the blobs into zip files, drastically reducing the number of files in the backups, because the blobs would be clumped into the zip files.
However after running the backup command with the --zip option was out of the question for us as when we tried using it, by the time we go into the office at nine in the morning the full backup had no completed after eight hours. In comparison our normal full backups typically take around half an hour to complete. We then attempted to run the backup command with the --zipStore option. This was much more successful, as it took almost the time time as the normal full backup took run. But after comparing the number of files contained within the two full backups, there was almost no difference.
Here is the output for the first unzipped backup file:
And the output for the zipStore backup file:
zimbra@server:~/backup/sessions$ nice ls -R full-20081202.060006.336 | wc
1454668 1370892 60737837
Further more when I explored into the zipStore backup file, there was no sign of any zips.
zimbra@server:~/backup/sessions$ nice ls -R full-20081203.163307.186 | wc
1461372 1376489 60965519
For the record the commands used to create the backups were:
zimbra@pat01:~$ zmbackup -f -a all
zimbra@pat01:~$ zmbackup -f --zipStore -a all