Feature Article #1
Cisco UCS and Nexus 1000V design diagram with Palo adapter
This is a follow-up and enhancement of a previous design diagram in which I showed Cisco UCS running the standard VMware vSwitch. In this post I am once again showing Cisco UCS utilizing the Cisco (Palo) virtualized adapter with an implementation of VMware vSphere 4.0, however in this design we are running ESXi and the [...]
Brad Hedlund | August 11th, 2009 | Continued
Feature Article #2
Cisco UCS and VMWare vSwitch design with Cisco 10GE Virtual Adapter
This diagram is a sample design of Cisco UCS running vSphere 4.0 utilizing the VMWare vSwitch and Cisco’s virtualization mezzanine adapter. The Cisco adapter is a dual port 10GE Converged Network Adapter supporting Fibre Channel over Ethernet (FCoE) and Network Interface Virtualization (NIV). The Cisco adapter is “virtual” in the sense that this single physical [...]
Brad Hedlund | July 5th, 2009 | Continued
Feature Article #3
Top of Rack vs End of Row Data Center Designs
This article provides a close examination and comparison of two popular data center physical designs, “Top of Rack” and “End of Row”. We will also explore a new alternative design using Fabric Extenders, and finish off with a quick look at how Cisco Unified Computing might fit into this picture.
Brad Hedlund | April 5th, 2009 | Continued
Feature Article #4
Nexus 1000V with FCoE CNA and VMWare ESX 4.0 deployment diagram
What does the virtual data center environment look like when you have a CNA (Converged Network Adapter) installed in a ESX 4.0 server running the Cisco Nexus 1000V virtual switch? I decided to draw it out in a diagram and came up with this:
(Click the diagram to view a larger image in a new browser [...]
Brad Hedlund | January 1st, 2009 | Continued
About this Site
Brad Hedlund is a Consulting Systems Engineer at Cisco Systems focused on Data Center technologies with 13 years combined experience as a Cisco customer, Cisco Partner, and now as a Cisco employee.
Awards @ Cisco:
“Top Engineer” (August 2007)
“Systems Engineer Sales Champion” (August 2008)
“Systems Engineer Sales Champion” (August 2009)
“Data Center CSE of the Quarter, US & Canada” [...]
In this example the hypervisor scans the PCI bus, and sees each virtual adapter as if it were a physical adapter. The server adminitstrator can then assign the virtual adapters to be used as uplinks for a vSwitch, vNetwork Distributed Switch, or Nexus 1000V.
In this example the hypervisor has scanned the PCI bus, and sees each virtual adapter as if it were a physical adapter. The server administrator then enables VMDirectPath I/O and chooses virtual adapters on Palo to be used by a virtual machine directly. This configuration results in bare metal like I/O and low latency for the VM I/O, however currently there is a trade off in that vMotion will not be possible (yet). This is because the hypervisor no longer “owns” the virtual hardware presented to the virtual machine as a network adapter, and as a result the I/O state of the virtual machine cannot be transfered to another hypervisor. There are ways to solve this problem, but they are not available yet.
In this case the hypervisor scans the PCI bus and sees each virtual adapter as if it were a physical adapter. The server administrator then assigns the virtual adapters to a special hypervisor switch that doesn’t actually do any switching, rather is just passes through I/O from a VM to an uplink adapter explicitly for that VM only. This configuration reduces the CPU cycles on the server required for VM I/O, improves I/O throughput, and reduces latency, but not to the same degree that VMDirectPath I/O does. By putting the hypervisor back in the I/O path, but only now with a more limited pass-through only role, we can now acheieve vMotion becuase the hypervisor is presenting the VM it’s virtual hardware for networking and is able to move the VM’s I/O state to another host.
In this case I am showing that there is flexability in how you use NIV in a virtual environment. The server administrator has decided one of the VM’s is really I/O intense and needs full blown VMDirectPath I/O, while other more common VM’s are just fine with standard hypervisor switching.
In this example I am showing that NIV is not just for VMware, because NIV operates at the hardware level in the server. The server administrator is running for example Oracle or Microsoft Exchange on the bare metal and is using the multiple virtual adapters to satify requirements for multiple adapters these applications may require. One example would be adapters dedicated to Oracle RAC heartbeat, public, and private networks.

