Tuesday, July 26, 2011

The Oracle Hardware Management Pack

I've recently acquired some new servers - some SPARC T3-1s and some x86 based X4170M2s.

One of the interesting things about these is that the internal drives are multipathed by default - so you get device names like c0t6006016021B02C00F22A3EED6CADE011d0s2 rather than the more traditional c0t0d0s2.

This makes building a jumpstart profile a bit more tedious than normal, because you need to have a separate disk configuration section for every box - because the device names are different on each box.

However, there's another minor problem. How do you easily map from the WWN-based device names to physical positions in the chassis? You really need this so you're sure you're swapping the right drive. And while a SPARC system really doesn't mind which disk it's booting from, for an x86 system it helps if you install the OS on the first disk in the BIOS boot order.

The answer is to install the Oracle Hardware Management Pack. (Why this isn't even on the preinstalled image I can't explain.) This seems to work on most current and recent Sun server models.

Now, actually getting the Hardware Management Pack isn't entirely trivial. So prepare to do battle with the monstrosity called My Oracle Support.

So, you're logged in to My Oracle Support. Click the Patches & Updates tab. In the Patch Search area, click the link marked 'Product or Family (Advanced)'. Then scroll down the dropdown list and select the item that says 'Oracle Hardware Management Pack'. Then choose some of the most recent releases (highest version numbers - note that different hardware platforms match different version numbers of the software) and select your desired platform (essentially, SPARC or X86 or both) from the dropdown to the right of where it says 'Platform is'. Then hit the Search button.

Assuming the flash gizmo hasn't crashed out on you (again) you should get a list of patches. No, I have no idea why they're called patches when they're not. You can then click on the one you want and download it.

What you get is a zip file, so you can unzip that, cd into it and then into the SOFTWARE directory inside it, and then run the install.bin file you find there. (You may have to chmod the install.bin file to make it executable.) I just accept all the defaults and let it get on with it.

On a preinstalled system it may claim it's already installed. It probably isn't - just 'pkgrm ipmitool' first. And if you're using your own jumpstart profile, make sure the SUNWCsma cluster is installed. It may be necessary to wait a while and then 'svcadm restart sma' to get things to take the first time.

So, once it's installed, what can you do?

The first thing is that there's a Storage tab in the ILOM web interface. Go there once you've got the hardware management pack installed and you should be able to see the controllers and disks enumerated.

On the system itself, the raidconfig command is very useful. Something like

raidconfig list all
will give you a device summary, and

raidconfig list disk -c c0 -v

will give a verbose listing of the disks on controller c0. (And. just to remind you, the c0 in c0t6006016021B02C00F22A3EED6CADE011d0s2 doesn't refer to physical controller 0.)

The hardware management pack is really useful - if you're running current generation Sun T-series or X-series hardware, you ought to get it and use it.


Paul said...

Could the name
be caused having mpxio turned on?


Sugan Moodley said...

You are SO right about MOS' flash crashing. Thanks for post - Sugan Moodley

Anonymous said...


i have problem to install hmp on sparc T3-1. i installed solaris10 U9 and than applied EIS-DVD 3.3.1(latest one), and than i tried to install HMP. but it had error like;

Another version of the software is installed. It (including Sun SSM Component
Manager) must be removed before installing this version of the software.


-> Quit:

but i couldnt discover what i should uninstall to install new HMP. i need HMP to use FWupdate command to update expander's fw to use SAS2 controller zonning. also when i tried to use FWupdate command, it says; Illegal Instruction (core dumped).

thanks for helps,

Peter Tribble said...

Yusuf: My guess would be that EIS ships with a duplicate copy of ipmitool, so 'pkgrm ipmitool' would help. That's certainly true of preinstalled systems from the factory (although I always wipe the preinstalled OS, I'll boot into that just to check he hardware and install HMP to get the disk map).

talkbackjohnny said...

Peter, thanks for the info. The WWN's threw me for a loop. I of course get all the new "challenges". I'm having issue with my jumps. Servers are jumping correctly but either boot with Bad MBR sig, or No active partition.

Getting this message during jump
bootadm: biosdev command failed for disk: /dev/rdsk/c0t5000C500335DBDC7d0s0.
bootadm: is_bootdisk(): cannot determine BIOS disk ID 'hd?' for disk: /dev/rdsk/c0t5000C500335DBDC7d0s0
- Installing boot blocks (c0t5000C500335AA05Fd0)
- Installing boot blocks (/dev/rdsk/c0t5000C500335AA05Fd0s0)

DO I need to have the newer version of JET?

Any Help would be greatly appreciated

pcora said...

Hi Peter,
This is a useful article, thanks!

I have another probably not-so-related question: Is SMC (sun management center) not available any more? We used it previously, so now should we use HMP or should we use Enterprise Manager? Can you point us to some site where we can answers to these or differences between HMP and EM (assuming SMC is already out)?

Thanks again.

pcora said...

Hi Peter,

The article helps, thanks!

I have another probably not-so-related question: Is SMC (sun management center) not available any more? We used it previously, so now should we use HMP or should we use Enterprise Manager?

Can you point us to some site where we can get answers to the above or differences between HMP and EM (assuming SMC is already out)?

Thanks again.

Peter Tribble said...

As for the different tools, the HMP is a simple local utility - I would install that on all new hardware.

It's entirely unrelated to SMC/SunMC/OEM which are much higher level management tools. I think it's fair to say that Oracle Enterprise Manager is the current direction, so that would be the tool to look at.

pcora said...

Thanks Peter.

I would like to understand why do you refer to HMP as a simple & local tool and why the others as High level ones. Basically what is the difference, mainly between HMP and SMC. I thought SMC was also for monitoring (incl hardware monitoring).

However I dont want to trouble you much. Is there a link that explains the differences or some comparison?