VMware: Bad performance on HP ProLiant DL380 G6 with ESXi 3.5 U4

At first I was really happy with my new HP ProLiant DL380 G6 because it is a really nice machine.  This machine was going to be an ESX-server so I added a few disks, a second CPU and plenty of memory, new specifications:

  • CPU(s): 2x Intel Xeon Quad E5520 (2.27GHz)
  • Memory: 28GB (2x 2GB, 6x 4GB) DDR3
  • Disk(s): 2x 36GB, 3x 300GB

Enough to make the machine running really fast, you would think. Once I had installed ESXi 3.5 U4 on the machine I started to install the environment consisting of a 4 Windows-servers and 5 client-systems (XP and Vista).

While installing I noticed that the machine appeared to be really slow when it comes to Disk I/O: During the installation of two 2008-Servers the extraction process of the disk image took over an hour (I installed both 2008 servers simultaneously, which normally would be no problem at all). When finished installing I saw the “Disk Performance” statistics (in the vSphere Client) peaking no higher than 7-8MB/s which was really frustrating. The esx-top utility on the command-line of the ESX-server gave the exact same results.

After some searching Arne Fokkema sent me a link where some people had similar problems on the VMware Communities and there was one response with someone who solved it by upgrading the firmware of the DL380’s Smart Array P410i Controller to version 2.00, and also by adding the Battery Pack for Smart Array to enable the Posted-Write Cache.

So here are the steps to take to solve this issue:

  • Order the Battery Pack for Smart Array P212/P410/P411 (P/N: 462969-B21). Since ordering this can take some time it’s the smartest thing to do first ;)
  • Upgrade your Smart Array P410i Controller’s firmware to version 2.00. Which is not really easy of you’re not used to doing such. You can do this by:
    • Downloading the latest HP ProLiant Firmware CD – which is version 8.60 at this moment and can be found here: http://bit.ly/1Luqts
    • Download the Smart Array P410i v2.00 Firmware (both the CP011340.scexe and CP011340.md5 file) which can be found here: http://bit.ly/mDiqE
    • Open the Firmware 8.60 ISO-file with your ISO-editor (PowerISO for example) and add the two files of the Smart Array firmware update and add them to the compaq\swpackages directory and save the ISO-file.
    • Burn or mount the ISO through ILO on your server and boot from it and make it run all the Firmware-updates and it will automatically say it wants to update the Smart Array controller firmware to version 2.00, and this is what you need to do
  • Furthermore, after receiving your Batttery Pack order, place it in the server and connect it to the memory of the Smart Array controller. If you don’t know how: consult the ProLiant DL380 G6 Manuals.

NOTE: The usage of the ‘altered’ HP ProLiant Firmware CD is necessary because normally you can run Firmware update like these from the server’s commandline or within Windows using the HP Smart Update tool. But ESXi 3.5 U4 lacks some commandline tools to do this.

After doing all of this you will still have to wait a few hours for the Battery Pack is fully charged, because the Posted-Write Cache will not work until then. After this your server will run on steroids and will reach up-to and above 70MB/s.

I hope I have saved you all lots of trouble finding the cause of the lack of disk performance on your brand-new server ;)

  1. We found out that too and since then any HP server we order comes up with the battery Pack option by default :)
    Also, you can even more increase the bandwidth by enabling the Physical Drive Write Cache State setting that you can find in the Array Configuration Utility, a tool that runs under Windows. You must have a UPS to turn that thing on!

    Cheers,
    Didier

    • laez
    • September 14th, 2009 3:07pm

    @PiroNet
    I’m afraid that won’t work for us. We don’t have UPSes connected directly to the servers.

  2. I had exactly the same problem.

    Only firmware updates will not solve the problem.

    I bought a 512mb bbwc controller (pn: 462967-B21) and my transfer rate was great.
    In stead of 2 / 3 MB/s i’ve got now 70 till 100 MB/s disk transfer speed on my local disks.

    HP Dl380G6
    2x Quad Core
    8 GB memory
    4x 146 GB 10 K 2,5″inch disks in Raid 1+0
    HP P410i controller 512mb BBWC
    ESXi 4.0

    • Julio
    • September 23rd, 2009 9:17pm

    I’m planning on buying an HP DL380 G6 and will use vmware ESXi 4.0 too with 3 VM (2 with Windows Server 2008 + 1 Linux) so this issue concerns me very much.
    The model that is on stock right now in my country (Argentina) is 491324-001 which includes HP Smart Array P410i/256MB Controller.
    What are my options? HP recommends 1) 512MB BBWC 462967-B21 2) Battery Kit upgrade (for BBWC) 462969-B21 3) 256MB Cache Module 462968-B21. But I’m not sure which one is for me. Do I need 512MB BBWC for use Battery Kit upgrade (for BBWC) 462969-B21?
    I would appreciated your help.

  1. No trackbacks yet.