Design a clustered VM application that can fully leverage VMotion, DRS, and HA?
This post is more of an idea then a report. If you’ve experimented with a design similar to my thoughts below please post a comment and let me know!
Have you tried to configure VMs in a MS cluster across separate ESX hosts? How about clustering a physical server with a VM? VMware’s guide can be found here. Referencing this guide I am specifically talking about “Clustering Virtual Machines Across Physical Hosts (Cluster Across Boxes)” and “Clustering Physical Machines and Virtual Machines (Standby Host)”.
Read the guide and you’ll find there are several prerequisites and restrictions. The most important ones being:
- you must use RDMs in physical mode for shared storage
- dedicate at least 2 physical nics to the VMs
- you can not use multipathing software
- you must use the LSILogic virtual SCSI adapter in your VMs
- you can only use 32 bit VMs. You can not cluster with 64 bit VMs
- iSCSI disks are not supported. NAS disks are not supported.
- you can only use 2 node clustering
- the boot disks for the VMs must be on local storage
- clustered VMs can not participate in an ESX cluster and use VMotion, DRS and HA
So how do we design a clustered VM application that can fully leverage VMotion, DRS, and HA?
What if a virtual appliance was used to present storage as iSCSI LUNs to the nodes, and what if the iSCSI LUNs were really inside a .vmdk file on a VMFS volume? If all of the VMs also had their boot OS drives on a VMFS on shared storage then all the nodes and the virtual appliance could freely vmotion between ESX hosts without issue.
In case you need to visualize what I am talking about then look at the following: (click image for a larger view)
As illustrated above, any one of the three VMs could Vmotion to any of the three ESX hosts and still have necessary connectivity to the VMFS with the .vmdks, as well as the private, public, and iSCSI networks.
Microsoft has already announced support for iSCSI in MSCS.
There are numerous server applications that can be installed in a VM to provide virtual iSCSI storage to Windows OS es:
- Openfiler is opensource
- Windows Storage Server 2003
- Datacore offers SANmelody
- LeftHand Networks has SAN/iQ VSA
Those are just a few I could think of off the top of my head.
The trick to this design is the iSCSI storage is actually inside a .vmdk file. Add some common sense and create DRS and HA rules that prevent the VM nodes from being on the same ESX host, and be sure to prevent each node from restarting if an ESX host is isolated.
Here’s an example of using a MSCS iSCSI cluster in VMware workstation from baeke.info. The concepts and configuration are similar.
Am I smoking crack here? Let me know!
Related Posts
-
http://www.equallogic.com Wade
-
http://www.equallogic.com Wade
-
http://www.rtfm-ed.co.uk Mike Laverick
-
http://www.rtfm-ed.co.uk Mike Laverick
-
Jim
-
Jim
-
http://treesum.homeip.net Rich
-
http://treesum.homeip.net Rich
-
http://vmetc.com rbrambley
-
http://www.peachtreedata.com Richard
-
http://www.peachtreedata.com Richard
-
http://vmetc.com rbrambley
-
Anonymous










