Cisco CRS-1 Carrier Routing System Multishelf System Upgrade and Conversion Guide Cisco IOS XR Software Release 3.4 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
C O N T E N T S Preface v Changes to This Document v Obtaining Documentation v Cisco.
Contents Converting to an Integrated Switch System Contents 2-1 2-1 Prerequisites for the Integrated Switch System 2-2 Cisco CRS-1 Multishelf Conversion to an Integrated Switch System Introduction Cisco CRS-1 Multishelf Integrated Switch Solution 2-3 Benefits of the Cisco CRS-1 Multishelf Integrated Switch Solution Naming Conventions 2-2 2-3 2-3 How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems 2-4 Validating
Preface This guide describes how to upgrade a single-shelf Cisco CRS-1 to a multishelf system. The upgrade process is similar to the process for a new multishelf system installation. This guide documents only the differences between the upgrade process and the new installation process.
Preface Documentation Feedback You can access the Cisco website at this URL: http://www.cisco.com You can access international Cisco websites at this URL: http://www.cisco.com/public/countries_languages.shtml Product Documentation DVD The Product Documentation DVD is a library of technical product documentation on a portable medium. The DVD enables you to access installation, configuration, and command guides for Cisco hardware and software products.
Preface Product Alerts and Field Notices A current list of security advisories, security notices, and security responses for Cisco products is available at this URL: http://www.cisco.com/go/psirt To see security advisories, security notices, and security responses as they are updated in real time, you can subscribe to the Product Security Incident Response Team Really Simple Syndication (PSIRT RSS) feed. Information about how to subscribe to the PSIRT RSS feed is found at this URL: http://www.cisco.
Preface Obtaining Technical Assistance To access the Product Alert Tool, you must be a registered Cisco.com user. (To register as a Cisco.com user, go to this URL: http://tools.cisco.com/RPF/register/register.do) Registered users can access the tool at this URL: http://tools.cisco.com/Support/PAT/do/ViewMyProfiles.do?local=en Obtaining Technical Assistance Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. The Cisco Technical Support & Documentation website on Cisco.
Preface Obtaining Additional Publications and Information Submitting a Service Request Using the online TAC Service Request Tool is the fastest way to open S3 and S4 service requests. (S3 and S4 service requests are those in which your network is minimally impaired or for which you require product information.) After you describe your situation, the TAC Service Request Tool provides recommended solutions.
Preface Obtaining Additional Publications and Information • The Cisco Product Quick Reference Guide is a handy, compact reference tool that includes brief product overviews, key features, sample part numbers, and abbreviated technical specifications for many Cisco products that are sold through channel partners. It is updated twice a year and includes the latest Cisco channel product offerings. To order and find out more about the Cisco Product Quick Reference Guide, go to this URL: http://www.cisco.
CH A P T E R 1 Upgrading to a Multishelf System This chapter describes how to upgrade a single-chassis Cisco CRS-1 Carrier Routing System router to a Cisco CRS-1 Carrier Routing System Multishelf System. Note For an introduction to the multishelf system, see Cisco CRS-1 Carrier Routing System Multishelf System Description. For information on planning a multishelf system installation, see Cisco CRS-1 Carrier Routing System Multishelf System Site Planning Guide.
Chapter 1 Upgrading to a Multishelf System Restrictions for Upgrading to a Multishelf System • Prepare the single chassis system as follows: – Obtain the chassis serial number, which is required for configuration. The serial number is on a chassis label and can be displayed using the show diag chassis, as described in Cisco IOS XR Getting Started Guide. – Upgrade the ROM Monitor software to Version 1.42 or later, as described in Cisco IOS XR ROM Monitor Guide.
Chapter 1 Upgrading to a Multishelf System Information About Upgrading to a Multishelf System Information About Upgrading to a Multishelf System The difference between upgrading a single-chassis system to a multishelf system and installing a multishelf system is the fabric upgrade. A single-chassis system uses fabric cards designed for single-chassis systems (FC/S cards), and an LCC in a multishelf system uses fabric cards designed for a multishelf system (FC/M cards).
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System Upgrading the Fabric Cards and Adding an FCC This section describes how to upgrade the fabric cards in a single-chassis system and establish communications between the designated shelf controller (DSC) LCC and one or more FCCs. Prerequisites Software Requirements Caution • Cisco IOS XR Software Release 3.4.0 or later • ROMMON 1.42 or later The ROM Monitor software must be upgraded to version 1.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System 8. Apply power to the FCC. 9. show platform Frack/**/* 10. configure 11. do show controllers fabric plane all 12. controllers fabric plane planeNumber shutdown 13. commit 14. end 15. In Rack 0, remove the FC/S card for the plane that was shut down in Step 12. 16. In Rack 0, insert the FC/M card for the plane that was shut down in Step 12. 17. show platform 0/smslotNumber/sp 18.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System Step 4 Command or Action Purpose dsc serial serialNumber rack Frack Configures the FCC identified by the serial number as an FCC rack within the multishelf system. Example: • Replace serialNumber with the serial number of the FCC. • Replace rack with the FCC number as it appears in the fabric cabling plan, which is described in Cisco CRS-1 Carrier Routing System Multishelf System Interconnection and Cabling Guide.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System Step 9 Command or Action Purpose show platform Frack/**/* Displays the status of all FCC modules in the specified rack. • Replace rack with the rack number of the FCC to examine. • Repeat this command for all FCCs. • The state for all modules should be IOS-XR RUN. • It can take a few minutes for all FCC modules to start.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System Step 17 Command or Action Purpose show platform 0/smslotNumber/sp Displays the status of the Rack 0 fabric slot specified by slotNumber. Example: Note RP/0/RP1/CPU0:router(admin)# show platform 0/sm0/sp The fabric card status appears only when the show platform command is executed in administration EXEC mode. Step 18 In Rack 0, attach the fabric cable connectors to the plane that was shut down in Step Step 12.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System What to Do Next When the Rack 0 upgrade is completed and Rack 0 is communicating with FCCs, the next step is to add a second LCC to the multishelf system. Adding an LCC to a Multishelf System This section describes how to add an LCC to a multishelf system. Prerequisites Software Requirements • Cisco IOS XR Software Release 3.4.0 or later • ROMMON 1.
Chapter 1 Upgrading to a Multishelf System How to Upgrade to a Multishelf System DETAILED STEPS Step 1 Command or Action Purpose admin Places the router in administration EXEC mode. • Example: All commands listed in this procedure should be entered on the pre-existing single-chassis system. RP/0/RP1/CPU0:router# admin Step 2 configure Places the router in administration configuration mode.
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System Step 10 Command or Action Purpose do show controllers fabric fabric-backpressure summary Displays the backpressure status for all racks. • The status for the row labeled “Rack 1: All Groups Received? :” should be “Yes.
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System RACK 0 : MAIN: board type 0001e0 800-24872-01 rev 20 dev N/A S/N TBA08260159 PCA: 73-7640-05 rev 20 PID: CRS-16-LCC VID: V01 CLEI: IPM6700DRA ECI: 445022 RACK NUM: 0 RACK MAIN: 1 : board type 0001e0 800-24872-01 rev 20 dev N/A S/N TBA08260159 PCA: 73-7640-05 rev 20 PID: CRS-16-LCC VID: V01 CLEI: IPM6700DRA ECI: 445022 RACK NUM: 0 RACK 240 : MAIN: board type 0001e0 800-24872-01 rev 20 dev N/A S/N TBA08
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System RP/0/RP1/CPU0:router(admin-config)# controllers fabric plane 3 RP/0/RP1/CPU0:router(admin-config)# oim count 1 RP/0/RP1/CPU0:router(admin-config)# oim instance 0 location F0/SM0/FM RP/0/RP1/CPU0:router(admin-config)# controllers fabric plane 4 RP/0/RP1/CPU0:router(admin-config)# oim count 1 RP/0/RP1/CPU0:router(admin-config)# oim instance 0 location F0/SM12/FM RP/0/RP1/CPU0:router(admin-config)# controll
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System 0 1 2 3 4 5 6 7 UP UP UP UP UP UP UP UP UP UP UP UP UP UP UP UP RP/0/RP1/CPU0:router(admin-config)# controllers fabric plane 0 shutdown RP/0/RP1/CPU0:router(admin-config)# commit RP/0/RP1/CPU0:router(admin-config)# end RP/0/RP1/CPU0:Mar 4 18:37:55.055 : fsdb_aserver[173]: %FABRIC-FSDB-1-PLANE_UPDOWN : Plane 0 state changed to DOWN: RP/0/RP1/CPU0:Mar 4 18:37:55.
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System RP/0/RP1/CPU0:router(admin-config)# end RP/0/RP1/CPU0:router(admin)# show controllers fabric plane all Flags: P C L A B I N o f m - plane admin down, p card admin down, c link port admin down, l asic admin down, a bundle port admin Down, b bundle admin down, i node admin down, n other end of link down d failed component downstream plane multicast down plane oper down card oper down linkport oper down
Chapter 1 Upgrading to a Multishelf System Configuration Examples for Upgrading to a Multishelf System 5 6 7 F0 NORMAL UP UP UP UP UP UP DOWN DOWN DOWN PRESENT RP/0/RP1/CPU0:router(admin-config)# do show controllers fabric rack-status all detail Rack Num ---0 1 Rack Status -----NORMAL INSTALL Server Status -----PRESENT PRESENT Plane Num ----0 1 2 3 4 5 6 7 F0 NORMAL Oper State ---------------------Rack in Rack out Install of Install ---------------UP UP UP UP UP UP UP UP UP UP UP UP UP UP UP U
Chapter 1 Upgrading to a Multishelf System Where to Go Next Where to Go Next When all fabric planes on both LCCs are configured and connected to the FCCs, see Cisco IOS XR Getting Started Guide for information on general system setup and operation. Additional References The following sections provide references related to upgrading a single-chassis system to a multishelf system.
Chapter 1 Upgrading to a Multishelf System Additional References Related Documentation for the Catalyst 6509 Switch For additional documentation related to the installation and configuration of the Catalyst 6509 switch, see the following Cisco Systems documents: Related Topic Document Title Catalyst 6509 installation Cisco Catalyst 6500 Series documentation Catalyst 6509 configuration and general system configuration after the fabric installation and configuration is complete Cisco IOS XR Getting St
CH A P T E R 2 Converting to an Integrated Switch System This chapter describes the following concepts: • Convert to a Cisco CRS-1 Multishelf System that uses an external Cisco Catalyst 6509 Switches, to a system that uses integrated switches that are located on the 22-port shelf controller Gigabit Ethernet (22-port SCGE) card. • Remove the Cisco Catalyst switches and replace them with 22-port SCGE cards. • Remove and replace techniques are used to complete the process.
Chapter 2 Converting to an Integrated Switch System Prerequisites for the Integrated Switch System Prerequisites for the Integrated Switch System Hardware Requirements • Ensure that all fabric card chassis (FCCs) have two power shelves and that all three power entry modules (PEMs) in each power shelf are running correctly. During the conversion, when one 22-port SCGE is removed, the chassis must have both power shelves populated to keep all the fans in the chassis engaged.
Chapter 2 Converting to an Integrated Switch System Benefits of the Cisco CRS-1 Multishelf Integrated Switch Solution Cisco CRS-1 Multishelf Integrated Switch Solution When the Cisco Catalyst 65xx switches are phased out of the multishelf network, the new 22-port SCGE cards, which are installed in the Cisco CRS-1 Multishelf FCCs, are connected directly to the Cisco CRS-1 Multishelf LCC RPs.
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems This section contains the following procedures: • Validating the 22-port SCGE Cards (Single-FCC Multishelf and Two-FCC Multishelf Systems), page 2-4 • Connecting the 22-port
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems Partner node (0/RP1/CPU0) is in STANDBY role Standby node in 0/RP1/CPU0 is ready Reload and boot info ---------------------RP reloaded Fri Feb 2 16:09:51 2007: 3 days, 1 hour, 46 minutes ago Active node booted Fri Feb 2 16:09:51 2007: 3 days, 1 hour, 46 minutes ago Standby node boot Fri Feb 2 16:13:40 2007: 3 days, 1
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems Replace the interface number argument with the port that is connected to the active Cat6k. Replace the node-id argument with the newly inserted standby 22-port SCGE card.
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems Performing a Failover to a Standby 22-port SCGE (Single-FCC Multishelf and Two-FCC Multishelf Systems) To perform a failover to a standby 22-port SCGE and swap the remaining 2-ports SCGE in the system with the new 22-port SCGEs, perform the following steps: Step 1 Perform a failover of the current active 2-ports SCG
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems Standby node last went not ready Fri Feb 2 16:30:39 2007: 3 days, 1 hour, 26 minutes ago Standby node last went ready Fri Feb 2 16:30:44 2007: 3 days, 1 hour, 26 minutes ago There have been 0 switch-overs since reload Redundancy information for node F0/SC0/CPU0: ========================================== Node F0/SC0
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for Single-FCC Multishelf and Two-FCC Multishelf Systems ##### MST Bridge Root 1 vlans mapped: 1 address 5246.48f0.20ff this switch for MST1 Interface ---------------GE_13 GE_14 GE_15 GE_17 GE_22 priority Role Sts Cost Prio.Nbr ---- --- --------- -------Desg FWD 20000 128. 14 Desg FWD 20000 128. 15 Desg FWD 20000 128. 16 Desg FWD 20000 128. 18 Desg FWD 20000 128.
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System This section contains the following procedures: • Validating the 22-port SCGE Cards (Four-FCC Multishelf System), page 2-10 • Connecting the 22-port SCGE to an Active Cat6K (Four-FCC Multishelf System), page 2-10 • Trans
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System The following example displays sample output from the show controllers switch inter-rack udld command: RP/0/RP0/CPU0:router(admin)# show controllers switch inter-rack udld all location f0/sc0/CPU0 Interface Gig port# 0 --Port enable administrative configuration setting: Enabled Port enable operational state: Enabled Current bidirectional st
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System Port enable administrative configuration setting: Enabled Port enable operational state: Enabled Current bidirectional state: Bidirectional Current operational state: Advertisement - Single neighbor detected Message interval: 7 Time out interval: 5 Entry 1 --Expiration time: 15 Device ID: 1 Current neighbor state: Bidirectional Device name
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System The following example shows how to display information for the Spanning Tree Protocol (STP) from the show controllers switch inter-rack stp command: RP/0/RP0/CPU0:router(admin)# show controllers switch inter-rack stp ports 0 location GE_0 of MST1 is designated forwarding Edge port: no (default) port guard : none Link type: point-to-point (a
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System Step 2 Step 3 Move the disabled GE links between RPs and the backup Cat6K to the newly inserted 22-port SCGE cards.
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System Connecting the 22-port SCGEs into a Full Mesh Configuration (Four-FCC Multishelf System) To connect the 22-port SCGEs in a full mesh configuration, perform the following steps: Step 1 Connect all of the 22-port SCGE cards to every other 22-port SCGE cards in the system in a mesh connection topology.
Chapter 2 Converting to an Integrated Switch System How to Convert from the Cisco Catalyst 65xx Switch to the Integrated Switch System for a Four-FCC Multishelf System Transferring an Active Cat6K Gigabit Ethernet Connections to the Active 22-port SCGE (Four-FCC Multishelf System) To transfer an active Cat6K GE connections to the active 22-port SCGE and isolate the active Cat6K from the control network, perform the following steps: Step 1 Disable the active Cat6K port that is connected to the active RP
I N D EX fabric card, single-chassis system A See FC/S cards admin configure command 1-5, 1-10 fabric card chassis See FCC FC/M cards C 1-3 FC/S cards cabling documentation FCC 1-17 Catalyst 6509 documentation installation documents 1-18 chassis serial number, location commit command 1-3 LEDs 1-2 1-8, 1-10, 1-17 serial number configuration 1-6, 1-10 considerations serial number location switch fabric upgrade FCC-SFC cards 1-3 controllers fabric plane command 1-7, 1-8 controllers
Index P planning documentation 1-17 R ROMMON, version required for LCC 1-9 S serial number displaying 1-11 FCC configuration 1-6 LCC configuration 1-10 location 1-2 rack 0 configuration 1-5 show controllers fabric fabric-backpressure summary command 1-11 show controllers fabric plane all command show controllers fabric plane command 1-7, 1-8 1-8 show controllers fabric rack-status all detail command 1-10 show controllers rack-status all detail command show platform command 1-11 1-7 swit
