The last few months have seen me working at an insane pace at Bulletproof in the lead up to a launch of our latest and greatest product Dedicated Virtual Machine Hosting or DVMH for short. I’ll ramble on a bit more about it after it’s launched but basically it is similar to our existing Managed Dedicated Hosting but running on VMware and with a whole heap of cool features due to the benefits of virtualisation.
Today saw me working with one of these cool features, Consolidated Backup. Basically what this lets you do is have a Windows 2003 server directly plugged into the SAN which can directly see all the VM images sitting in the VMFS LUNs. It then talks to the ESX servers takes a snapshot and makes a copy of it t local disk. Hey presto Disaster Recovery. Well mostly anyway, the restoration aspect isn’t all that crash hot as you’ll see below.
Documentation on performing the backups is a bit scarce. VMware provide some scripts that let you tie it in to some commercial backup products like Legato, Veritas and NetBackup but no real docs on how to do it yourself.
So here are some quick examples. (You can find all these commands in C:Program FilesVMwareVMware Consolidated Backup Framework
Getting a list of VMs on your ESX farm.
vcbVmName.exe -h VC_HOST -u USERNAME -p PASSWORD -s any:
Backing up a VM
vcbMounter.exe -h VC_HOST -u USERNAME -p PASSWORD -a moref:MOREF -r DESTINATION -t fullvm -m san
where MOREF comes from the list you created above and DESTINATION is a local path on your VCB proxy.
You should then strictly unmount it by doing
vcbMounter.exe -d DESTINATION
but I don’t think this does anymore than delete the files, since the snapshot on the ESX server has already been closed.
The above creates something like this
Mounting a VM image locally
vmmount.exe -d VMDK -cycleId -sysdl LOCATION
VMDK needs to be scsi0-0-0-MyVM.vmdk from above.
You can then unmount it by doing
vmount.exe -u LOCATION
This is nice and easy and really useful means you can now easily backup everything to tape.
Recovery is another matter entirely, apparently in the Beta releases vcbRestore was distributed with Consolidated Backup but in the final release it now only exists on the ESX servers. So you need to move your directory above to one of your ESX boxes. You then do
vcbRestore -h VC_HOST -u USERNAME -p PASSWORD -s DIRECTORY
This will totally replace your existing VM, if you wanted a copy then you should copy the catalog file elsewhere, edit it to change the paths and
vcbRestore -h VC_HOST -u USERNAME -p PASSWORD -s DIRECTORY -a CATALOG
There are a couple more features I haven’t mentioned which you can work out for yourself by using -h. eg File level backups for Windows VMs.
Now all of the above is great but VMware have taken things a step further. With the above if your VM is running VMware Tools the equivalent of a sync is done before the snapshot is taken which effectively gives you slightly better than a crash consistent dump. Though you could still lose some DB data.
So VMware have added some functionality to rectify this. Just before the snapshot is made /usr/sbin/pre-freeze-script or C:Windowspre-freeze-script.bat is run and /usr/sbin/post-thaw-script or C:Windowspost-thaw-script.bat are run afterwards. Taking a snapshot only takes a few minutes so you could use these scripts to stop your database for example.
I highly recommend reading the VMware Consolidated Backup manual for all the extra features I haven’t covered.