SPARC® Enterprise M4000/M5000 Servers Product Notes For XCP version 1050 Manual Code C120-E481-01EN Part No.
Copyright 2007 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. and FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, Nakahara-ku, Kawasaki-shi, Kanagawa-ken 211-8588, Japan. All rights reserved. Sun Microsystems, Inc.
Copyright 2007 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. et FUJITSU LIMITED, 1-1, Kamikodanaka 4-chome, Nakahara-ku, Kawasaki-shi, Kanagawa-ken 211-8588, Japon. Tous droits réservés. Entrée et revue tecnical fournies par Fujitsu Limited sur des parties de ce matériel. Sun Microsystems, Inc. et Fujitsu Limited détiennent et contrôlent toutes deux des droits de propriété intellectuelle relatifs aux produits et technologies décrits dans ce document.
Contents Preface vii Technical Support vii Software Resources vii Accessing Documentation viii Fujitsu Welcomes Your Comments ix SPARC Enterprise M4000/M5000 Servers Product Notes Supported Versions of Firmware and Software Patch Information Known Issues 1 1 2 3 General Functionality Issues and Limitations Issues and Limitations Fixed in Solaris 10 8/07 Notes for XCP 1050 Notes for XSCF Web 3 3 4 4 Hardware Installation and Service Issues Specific Issues and Workarounds 5 5 Cautions fo
Updates of the SPARC Enterprise M4000/M5000 Servers Service Manual Installing the PCI Cassette DIMM Replacement Software Issues 12 13 15 XCP Issues and Workarounds 15 Solaris Issues and Workarounds 22 Identifying Permanent Memory in a Target Board Preparing to Upgrade to XCP 1050 Upgrading to XCP 1050 31 32 Software Documentation Updates vi 31 37 SPARC Enterprise M4000/M5000 Servers Product Notes for XCP Version 1050 • September 2007 12
Preface These product notes contain late-breaking information about the SPARC® Enterprise M4000/M5000 server hardware, software, or documentation that became known after the documentation set was published. Technical Support If you have technical questions or issues that are not addressed in the SPARC Enterprise M4000/M5000 servers documentation, contact a sales representative or a certified service engineer.
Note – For latest patch information go to: Global Site http://www.fujitsu.com/global/support/software/security/products-s/patch-info/ Japanese Site http://software.fujitsu.com/jp/security/products-others/unix/index.html North American Site https://download.computers.us.fujitsu.com/ Installation information and README files are included in the patch download.
Fujitsu Welcomes Your Comments If you have any comments or requests regarding this manual, or if you find any unclear statements in the manual, please state your points specifically, and forward it to a sales representative or a certified service engineer. Please include the title and part number of your document with your feedback.
x SPARC Enterprise M4000/M5000 Servers Product Notes for XCP Version 1050 • September 2007
SPARC Enterprise M4000/M5000 Servers Product Notes These product notes contain late-breaking information about the SPARC® Enterprise M4000/M5000 server hardware, software, or documentation that became known after the documentation set was published.
Note – When the XCP version preinstalled in your server is under XCP 1050, you must upgrade to XSCF Control Package(XCP) 1050 or later. Use the web browser interface, also known as the browser user interface (BUI), to import XCP firmware and then execute the flashupdate command to upgrade the XCP firmware with the XSCF Shell. Caution – CR ID #6534471: Improper handling of large page in kernel memory may cause random panics.
Known Issues This section describes known issues in this release. General Functionality Issues and Limitations ■ Domains using the ZFS file system can not use Dynamic Reconfiguration. ■ SPARC Enterprise M4000/M5000 servers are cold service machines. Hot-swapping of the CPU/Memory board unit (CMU), I/O Unit (IOU), or any eXtended System Control Facility (XSCF) unit is not supported.
■ The target board (SB/XSB) with optional I/O cards because of some restrictions on specific cards. Caution – Use of DR in an unsupported configuration might result in a domain panic or might hang the system. ■ PCI Hotplug feature is not available for this release. Please contact your sales representative or technical support for additional information and software support.
Hardware Installation and Service Issues This section describes hardware specific issues and workarounds. Specific Issues and Workarounds TABLE 1 lists known hardware issues and possible workarounds. TABLE 1 Hardware Issues and Workarounds CR ID Description Workaround 6433420 The domain console might display a Mailbox timeout or IOCB interrupt timeout error during boot. Issue a reset-all command from the OBP (OK) prompt and reboot.
Cautions for mounting the server in the 19-inch rack When you mount the SPARC Enterprise M4000 or M5000 server on the 19-inch rack, as you insert it all the way seated in the rack, the nut anchoring the bezel may interfere with the rack column and the server may fail to be seated correctly. In such a case, please replace the bezel anchoring nut and ring with the E-Ring. 1. Remove the interfering bezel anchoring nut and ring.
2. In place of the removed nut and ring, attach the E-Ring, included in the rack mount kit. E-Ring 3. Insert the server all the way seated in the rack, to lock it in place.
Hardware Documentation Updates TABLE 2 lists known documentation updates. TABLE 2 Documentation Updates Title Page Number Update All DVD references are now referred to as CD-RW/DVD-RW. All SPARC Enterprise M4000/M5000 servers documentation Updated glossary terms: External I/O Expansion Unit — A rack mountable device to add-on PCI slots. It is connected to the system’s I/O unit through the PCIe connection and contains one or two I/O boats. I/O boat — An I/O unit in the External I/O Expansion Unit.
TABLE 2 Documentation Updates (Continued) Title Page Number Update SPARC Enterprise M4000/M5000 Servers Service Manual 4-11 4.4.3, "Powering the Server Off Manually" Step 4 "Verify the state of the status XSCF STANDBY LED on the operator panel is off" should be replaced with the following description: "Verify the state of the status Power LED on the operator panel is off." SPARC Enterprise M4000/M5000 Servers Service Manual 8-5 8.1.
TABLE 2 Documentation Updates (Continued) Title Page Number Update SPARC Enterprise M4000/M5000 Servers Service Manual 9-1 15-1 CHAPTER 9, "XSCF Unit Replacement" CHAPTER 15, "Operator Panel Replacement" The following important message will be added. Note – If you replace the XSCF unit and the operator panel simultaneously, system will not operate normally.
Cable Connections The following changes belong in the SPARC Enterprise M4000/M5000 Servers Installation Guide.
Updates of the SPARC Enterprise M4000/M5000 Servers Service Manual The following information supersedes the information in the SPARC Enterprise M4000/M5000 Servers Service Manual. Installing the PCI Cassette Caution – Do not force the PCI cassette into a slot. Doing so can cause damage to the cassette and server. 1. Align the PCI cassette on the gray plastic guide and install it into the slot. 2. Lock the lever into place to seat the cassette.
DIMM Replacement The DIMMs are cold FRU replacement components. The entire server must be powered off and the power cords disconnected to replace the DIMMs. FIGURE 1 shows the memory board memory slot locations.
Here are the DIMM mount conditions: ■ ■ ■ In each group, 4 DIMMs are mounted in a unit. The capacity of the DIMMs in group A must be equal to or larger than the capacity of the DIMMs in group B. You need not necessarily mount DIMMs in group B. In each of the groups, mount the DIMM of same capacity and of same rank. The DIMMs of different capacity can’t be mixed in a group.
Software Issues This section describes software specific issues and workarounds. XCP Issues and Workarounds TABLE 5 lists known XCP issues and possible workarounds. TABLE 5 XCP Issues and Workarounds ID Description Workaround RTIF1070418-005 If you log in to the XSCF while it is still booting, you may get a bash$ prompt instead of the XSCF> prompt, and be unable to perform most operations. Log out of the bash$ prompt and wait for the XSCF to finish booting.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070418-025 showaudit all shows a long list of defaults in the policy section after the database is cleared. Update the database with the following: setaudit -a opl=enable setaudit -a opl=default RTIF1070528-002 While XSCF is running, watchdog timeout may occur and XSCF may reboot. Check that XSCF is started.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070824-004 On the XSCF Web, on the Domain Status screen, when you select an XSB displayed on the Domain Component List, and in case the selected XSB is not yet mounted or is Uni-XSB, the pop-up screen displays no data. None available at this time. RTIF1070824-005 On the XSCF Web, when you changed the Refresh Interval value of the Monitor Message Frame, the invalid pop-up "Confirmation Domain mode" may appear.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070904-003 An incorrect domain state is reported. After the command sendbreak to domain is issued, showdomainstatus continues to show the state as "Running" when the domain is actually at "ok" prompt. There is no workaround. This is expected behavior of the sendbreak operation. RTIF1070904-004 The latest communication field in showarchiving is not updated regularly.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070914-005 On the XSCF Web, when using Internet Explorer 7, on the User Accounts screen, User Local Accounts doesn't show the Status of each user. None available at this time. RTIF1070914-006 When you set the XSCF user account name to the maximum 32 characters, you can log in, but then, when you execute the XSCF Shell or operate the XSCF Web, "Permission denied" occurs.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070914-012 On the XSCF Web, on the SNMP-Properties screen, when you don't select Trap Host and execute the Remove button, the invalid message "The trap host will be removed" appears as a pop-up. And when you select OK on the pop-up screen, the invalid message "Remove trap host failed. setsnmp: invalid trap type" appears. None available at this time.
TABLE 5 XCP Issues and Workarounds (Continued) ID Description Workaround RTIF1070914-019 When you use a user account which is not the user account when you performed the LDAP configuration and execute the showldap(8) command with the -c option to display the LDAP configuration, "Permission denied" occurs. And on the XSCF Web, when you display the LDAP configuration, the pop-up screen displays no data. Use the user account which used when you performed the LDAP configuration.
Solaris Issues and Workarounds TABLE 6 lists known issues and possible workarounds.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6466617 Performing a hot plug operation with the PCIExpress slot too quickly interrupts a PCI leaf reset and fails, creating a cfgadm: Component system is busy error. Pause a few seconds between the issue of each cfgadm -c command.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6496337 The "cpumem-diagnosis" module may fail to load after uncorrectable error(UE) panic. Systems will function correctly but events normally automatically diagnosed by FMA using this module will require manual diagnosis.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6502204 Unexpected error messages may be displayed on console on booting after CPU UE panic. Example: SUNW-MSG-ID: FMD-8000-11, TYPE: Defect, VER: 1, SEVERITY: Minor EVENT-TIME: Tue Jan 9 20:45:08 JST 2007 PLATFORM: SUNW,SPARC-Enterprise, CSN: 2030636002, HOSTNAME: P2-DC116-d0 If you see unexpected messages, use the XSCF command showdomainstatus(8) to check system status on XSCF.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6515648 "Replumb Failed" error appears when dr@0:SB1::memory fails. Once the DR operation is complete, it can be plumbed up manually. Example steps to re-plumb the interface manually: # ifconfig interface plumb xxx.xxx.xxx.xxx netmask + broadcast + up # ifconfig interface group group-name # ifconfig interface addif xxx.xxx.xxx.xxx -failover deprecated up This workaround assumes that the /etc/hostname.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6527811 showhardconf(8) on XSCF can not display PCI card information that is installed in External I/O Expansion Unit, if the External I/O Expansion Unit is configured using PCI hotplug. No workaround is available at this time. In case of each PCI card in the External I/O Expansion Unit is configured using PCI hotplug, the PCI card information is displayed correctly.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6535564 PCI hot plug to PCI slot #0, #1 or External IO Expansion Unit may fail on XSB added by DR. There is no workaround. Use DR instead of PCI hot plug if need to add or remove PCI card on the XSB. This bug has been fixed in Solaris 10 8/07.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6545685 If the following message displayed on the OS console, memory degradation or XSB deconfiguration may occur in the subsequent reboot.
TABLE 6 Specific Issues and Workarounds Concerning Solaris (Continued) CR ID Description Workaround 6559504 Messages of the form nxge: NOTICE: nxge_ipp_eccue_valid_check: rd_ptr = nnn wr_ptr = nnn will be observed on the console with the following cards: • X4447A-Z, PCI-e Quad-port Gigabit Ethernet Adapter UTP • X1027A-Z1, PCI-e Dual 10 Gigabit Ethernet Fiber XFP Low profile Adapter These messages can be safely ignored.
Identifying Permanent Memory in a Target Board 1. Log in to XSCF. 2. Execute the following command: XSCF> showdevices -d domain_id The following example shows a display of the showdevices -d command where 0 is the domain_id. XSCF> showdevices -d 0 ... Memory: ------DID 00 00 00 XSB 00-0 00-2 00-3 board mem MB 8192 8192 8192 perm mem MB 0 1674 0 base address 0x0000000000000000 0x000003c000000000 0x0000034000000000 domain target deleted remaining mem MB XSB mem MB mem MB 24576 24576 24576 ...
Upgrading to XCP 1050 Note – By upgrading to XCP 1050, XSCFU_B#1 will start working. When your system is using RCI network, XSCFU_B#1 needs proper configuration of cabling or termination to setup RCI network, properly. For further information, please contact to your service provider. Note – Do not access the XSCF units via the "Takeover IP address". Note – LAN connections are disconnected when the XSCF resets. It is recommended to use the XSCF serial connection to simplify the XCP upgrade procedure. 1.
7. Upload the XCP 1050 upgrade image by using the command line getflashimage. XSCF> getflashimage http://server.domain.com/XCP1050/images/DCXCP1050.tar.gz The BUI on XSCFU#0 can also be used to upload the XCP 1050 upgrade image. 8. Update the firmware by using the flashupdate (8) command. Caution – Flashupdate will update one bank, reset the XSCF and commence update of the second bank. Verify that the current and reserve banks are both updated.
13. Wait until XSCF firmware reaches the ready state. This can be confirmed when the READY LEDs of XSCF_B#0 and XSCF_B#1 remain lit. 14. Log in on to XSCFU#0 using a serial connection or LAN connection. 15. Confirm no abnormality occurred by using showlogs error -v and showstatus commands. XSCF> showlogs error -v XSCF> showstatus If you encounter any hardware abnormality of the XSCF contact your authorized service representative. 16. Confirm and update the imported XCP image again.
19. Confirm that both the current and reserve banks of XSCFU#1 display the updated XCP versions. XSCF> version -c xcp XSCF#1 (Active) XCP0 (Reserve): 1050 XCP1 (Current): 1050 XSCF#0 (Standby) XCP0 (Reserve): 1050 XCP1 (Current): 1050 If the Current and Reserve banks on XSCF#1 do not indicate XCP revision 1050, contact your authorized service representative. Note – Setup RCI network if RCI is used. To setup RCI network, please consult your service provider. 20.
b. Confirm switching over between XSCFs using the following commands: XSCF> showhardconf Confirm XSCF#1 is standby, and XSCF#0 becomes active. XSCF> showlogs error Confirm new log is not recorded since you checked on Step 16. XSCF> showlogs event Confirm a message XSCFU entered active state from standby state. XSCF> showstatus Confirm a message "No failures found in System Initialization". 21. In case the takeover IP address is specified, confirm the IP address.
Software Documentation Updates This section contains late-breaking software information that became known after the documentation set was published and corrections in the SPARC Enterprise M4000/M5000 Servers Software documentation. The corrections for SPARC Enterprise M4000/M5000/M8000/M9000 Servers XSCF Reference Manual, if not otherwise specified, also apply to the man pages which XSCF provides. And they supersede the information on the man pages. TABLE 7 lists known documentation updates.
38 SPARC Enterprise M4000/M5000 Servers Product Notes for XCP Version 1050 • September 2007
