Table Of Contents
Cisco MDS Fibre Channel Switch for IBM Blade Center
LEDs on the Supervisor-2 Module
LEDs on the Supervisor-1 Module
Cisco MDS 9000 Series Module Compatibility
48-Port 4-Gbps Fibre Channel Switching Module
24-port 4-Gbps Fibre Channel Switching Module
12-port 4-Gbps Fibre Channel Switching Module
4-port 10-Gbps Fibre Channel Switching Module
LEDs on the Generation 2 Switching Modules
32-Port 2-Gbps Fibre Channel Switching Module
16-Port 2-Gbps Fibre Channel Switching Module
LEDs on the Generation 1 Switching Module
18/4-Port Multiservice Federal Information Processing Standards Module
LEDs on the 18/4-Port Multiservice Module
14/2-Port Multiprotocol Services Module
LEDs on IP Storage Services Modules
32-Port Fibre Channel Advanced Services Module
LEDs on the Fibre Channel Advanced Services Modules
32-Port Fibre Channel Storage Services Module
LEDs on the Storage Services Modules
LEDs on the Caching Services Module
Fibre Channel SFP Transceivers
Combination Fibre Channel/Gigabit Ethernet SFP Transceivers
CWDM Combination Fibre Channel/Gigabit Ethernet SFP Transceivers
Gigabit Ethernet SFP Transceivers
DWDM Fibre Channel SFP Transceivers
Product Overview
The Cisco MDS 9500 Multilayer Director elevates the standard for director-class switches. Providing industry-leading availability, scalability, security, and management, the Cisco MDS 9500 Series allows deployment of high-performance SANs with lowest total cost of ownership. Layering a rich set of intelligent features onto a high-performance, protocol-agnostic switch fabric, the Cisco MDS 9500 Series of Multilayer Directors addresses the stringent requirements of large data-center storage environments: uncompromisingly high availability, security, scalability, ease of management, and transparent integration of new technologies.
The Cisco MDS 9500 Series includes the Cisco MDS 9513 Director, the Cisco MDS 9509 Director, and the Cisco MDS 9506 Director, which all provide the following high availability features:
•
Redundant Supervisor-2 modules with associated external crossbar modules for the Cisco MDS 9513 Director.
•
•
•
•
•
•
•
•
•
For more information about high availability features, redundant supervisor operation, and how to configure the Cisco MDS 9500 Series, see the Cisco MDS 9000 Family CLI Configuration Guide and the Cisco MDS 9000 Family Fabric Manager Configuration Guide.
The Cisco MDS 9500 Series supports the following hot-swappable, field-replaceable modules:
•
•
•
•
•
•
•
•
•
•
•
•
•
•
This chapter includes the following sections:
•
•
Chassis
This section describes the different chassis offerings in the Cisco MDS 9500 Series:
Cisco MDS 9513 Director
The Cisco MDS 9513 Director is a 13-slot Fibre Channel switch. The front panel consists of 13 horizontal slots, where slots 1 to 6 and slots 9 to 13 are reserved for switching and services modules only, and slots 7 and 8 are for Supervisor-2 modules only. A variable speed fan tray, with 15 individual fans, is located on the front left panel of the chassis.
The Cisco MDS 9513 Director uses a midplane. Modules exist on both sides of the plane. (See Figure 1-1.) The Cisco MDS 9513 Director supports the following:
•
•
•
•
•
•
•
Note
Figure 1-1 Cisco MDS 9513 Chassis Front Panel View
Switching or services modules in slots 1-6
Switching or services modules in slots 9-13
Supervisor-2 modules in slots 7 and 8
Fan tray
The rear of the chassis supports two vertical, redundant power supplies, two clock modules, two vertical, redundant, external crossbar modules, and a variable speed fan tray with two individual fans located above the crossbar modules. (See Figure 1-2.)
Figure 1-2 Rear Panel 9513 Chassis
Power supplies
Clock module1
crossbar module fans
Air vent panels
crossbar modules
1 Clock modules are located inside the air vent panel. You must remove the air vent panel to access the clock modules.
Cisco MDS 9509 Director
The Cisco MDS 9509 Director has a 9-slot chassis as shown in Figure 1-3, and it supports the following:
•
•
•
•
•
Figure 1-3 Cisco MDS 9509 Chassis
Cisco MDS 9506 Director
The Cisco MDS 9506 Director has a 6-slot chassis as shown in Figure 1-4, and it supports the following:
•
•
•
•
•
Figure 1-4 Cisco MDS 9506 Chassis
Backplane and Clock Modules
The Cisco MDS 9500 Series includes one or more clock modules that are accessible from the back of the chassis. The Cisco MDS 9513 and 9509 Directors have two field-replaceable clock modules for redundancy and failover. The Cisco MDS 9506 Director has one field-replaceable clock module. In the unlikely event of a clock module failure, the Cisco MDS 9500 Series generates an error message and an automatic switchover occurs from one clock module to the other, causing the system to reset automatically. The standby clock module is hot-swappable only on the Cisco MDS 9513 Director. Cisco recommends that the failed clock module be replaced during a maintenance window. The active clock module is not hot-swappable. See the "Removing and Installing Clock Modules" section on page 2-76 for information on replacing clock modules.
There are two LEDs per clock module. Figure 1-5 shows the upper and lower LEDs.
Figure 1-5 Clock Module LEDs
Cisco MDS Fibre Channel Switch for IBM Blade Center
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter is designed for IBM BladeCenter environments. The Cisco MDS Fibre Channel Bladeswitch is based on the Cisco MDS 9000 Family SAN switching technology, which integrates the Cisco MDS 9000 Family of switches and directors into a blade-switch architecture. The advanced architecture of the Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter, along with 4-GB technology, provides outstanding performance between Bladeswitches and the rest of the Fibre Channel infrastructure.
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter provides 4-GB Fibre Channel performance to blade-server switching. It also provides network intelligence features such as virtual SANs (VSANs), quality of service (QoS), and N-port interface virtualization (NPIV). It also offers nondisruptive software upgrades and on-demand port activation and is the most complete embedded Fibre Channel switching available for the IBM BladeCenter, BladeCenter-T, and BladeCenter-H platforms.
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter provides up to 20 nonblocking 1-, 2-, and 4-GB Fibre Channel ports that are available in two configurations: 7 internal ports and 3 external ports, or 14 internal ports and 6 external ports. Each port provides line-rate performance up to 4-GB without any performance loss for integrated features such as VSANs, QoS, or Network Address Translation (NAT). The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter supports up to 16 VSANs per blade switch.
Each external port on the Cisco MDS FC Bladeswitch for IBM BladeCenter also provides line-rate performance up to 4-GB for Inter-Switch Links (ISLs) or additional device connectivity such as storage or host bus adapters (HBAs).
The Cisco SAN-OS software provides role-based access control (RBAC) for management access of the Cisco Fibre Channel Bladeswitch for IBM BladeCenter command-line interface (CLI) and Simple Network Management Protocol (SNMP). For more information, see the Cisco 9000 Family Command Reference.
Power Supplies
The Cisco MDS 9500 Series supports dual hot-swappable power supplies, each of which is capable of supplying sufficient power to the entire chassis should one power supply fail. The power supplies monitor their output voltage and provide status to the supervisor modules. To prevent the unexpected shutdown of an optional module, the power management software only allows a module to power up if adequate power is available.
The power supplies can be configured to be redundant or combined. By default, they are configured as redundant, so that if one fails, the remaining power supply can still power the entire system. For information about how to configure the power supplies, see the Cisco MDS 9000 CLI Family Configuration Guide.
Cisco MDS 9513 Power Supplies
The Cisco MDS 9513 Director supports the 6000-W AC power supply (AC input). (See Figure 1-6.)
Figure 1-6 Cisco MDS 9513 Power Supply
Table 1-2 describes the LEDs for the Cisco MDS 9513 Director power supplies.
Cisco MDS 9509 Power Supplies
The Cisco MDS 9509 Director supports the following types of power supplies:
•
The 4000-W AC power supply has a permanently attached power cable, and it requires 220-VAC input. (See Figure 1-7.)
•
The 3000-W AC power supply requires 220 VAC to deliver 3000 W of power. If powered with 110 VAC, it delivers only 1400 W. (See Figure 1-8.)
•
The 2500-W AC power supply requires 220 VAC to deliver 2500 W of power. If powered with 110 VAC, it delivers only 1300 W. (See Figure 1-9.)
•
The 2500-W DC power supply requires positive, negative, and ground wires. (See Figure 1-10.
Figure 1-7 4000-W AC Power Supply for the Cisco MDS 9509 Director
AC power connection
Power supply switch
Power supply LEDs
Permanent power cable
Captive screws
Figure 1-8 3000-W AC Power Supply for the Cisco MDS 9509 Director
Figure 1-9 2500-W AC Power Supply for the Cisco MDS 9509 Director
AC power connection
Captive screws
Cable retention device
Power supply LEDs
Power supply switch
Figure 1-10 2500-W DC Power Supply for the Cisco MDS 9509 Director
Cisco MDS 9506 Power Supplies
The Cisco MDS 9506 Director supports the following types of power supplies:
•
•
Power is supplied to the Cisco MDS 9506 power supplies though PEMs in the front of the chassis. The AC power requires an AC PEM, and the DC power requires a DC PEM.
The 1900-W AC and DC power supplies are similar in appearance (see Figure 1-11), except for the label that indicates whether the power supply is AC or DC.
Figure 1-11 Cisco MDS 9506 Power Supply (1900-W AC or DC)
Table 1-3 describes the power supply LEDs for the Cisco MDS 9509 and 9506 Directors.
Fan Modules
The Cisco MDS 9513 Director has a front panel fan tray with 15 fans with an abrupt stop-to-fan rotation safety feature after power is disconnected or the fan tray is removed from the midplane. The Cisco MDS 9509 Director has a front panel fan module with nine fans and the Cisco MDS 9506 Director has a front panel fan module with six fans.
Sensors on the supervisor module monitor the internal air temperature. If the air temperature exceeds a preset lower-level threshold, the environmental monitor displays warning messages. If the air temperatures exceeds a preset higher-level threshold, the switch will shut down.
If one or more fans within the module fail, the Fan Status LED turns red and the module must be replaced. If the higher-level temperature threshold is not exceeded, the switch continues to run for five minutes after the fan module is removed. This allows you to swap out a fan module without having to bring the system down. For information on how to replace a fan module, see the "Removing and Installing Fan Modules" section on page 2-68.
The fan module has one status LED that indicates the following conditions:
•
•
•
Caution
The Cisco MDS 9513 Director also has crossbar module fan trays located at the back of the chassis. There is one fan per crossbar module. There is one LED that provides operational status. Figure 1-2 shows the fan status LED on the Cisco MDS 9513 Director To replace these fan modules, see the "Removing and Installing Fan Modules" section on page 2-68.
Supervisor Modules
The Cisco MDS 9500 Series supports two types of supervisor modules: Supervisor-1 and Supervisor-2 modules. Both the supervisor modules provide the control and management functions for the Cisco MDS 9500 Series. The Cisco MDS 9500 Series supports two supervisor modules for redundancy. In the event of an internal component failure, the standby supervisor module takes over, if installed. This section discusses the following modules:
•
•
Note
Supervisor-2 Modules
The Cisco MDS 9500 Series offers redundant, hot-swappable, Supervisor-2 modules. (See Figure 1-12.) Supervisor-2 modules can be used in the Cisco MDS 9509 and 9506 Directors in slots 5 and 6. Supervisor-2 modules must be used in slots 7 and 8 of the Cisco MDS 9513 Director.
Supervisor-2 modules provide an integrated crossbar switching fabric to connect all the switching modules when used in a Cisco MDS 9509 or 9506 Director. Single fabric configurations provide 720-Gbps full duplex speed with 80-Gbps full duplex bandwidth per switching module. Dual fabric configurations provide 1.4-Tbps speed with 160-Gbps full duplex bandwidth per switching module. This integrated crossbar switching fabric is disabled when a Supervisor-2 module is installed in a Cisco MDS 9513 Director. The Cisco MDS 9513 Director supports two external crossbar modules located at the rear of the chassis that handle this function. (For more information, see the "Crossbar Modules" section.)
Figure 1-12 Cisco MDS 9500 Series Supervisor-2 Module
Status, System, Active, and Power Management LEDs1
CompactFlash LED
Reset button
CompactFlash eject button
Console port
CompactFlash slot
MGMT 10/100/1000 Ethernet port (with integrated Link and Activity LEDs)
USB ports
COM1 serial port
The main functions and components of the Supervisor-2 modules are as follows:
•
Control and Management
The Supervisor-2 modules provide the following control and management features:
•
•
A service running on the Supervisor-2 module keeps track of the high availability policy of each process and issues a restart when a process fails. The type of restart issued is based on the process's capability:
–
–
•
If the Supervisor-2 module has to be restarted, then the secondary Supervisor-2 (which is continuously monitoring the primary) takes over. Once a switchover has occurred and the failed Supervisor-2 has been replaced or restarted, operation does not switch back to the original primary Supervisor-2, unless it is forced to switch back or another failure occurs.
Processor
The Supervisor-2 module has a processor running at 1.4 GHz. It contains a PowerPC class processor and offers the following memory specifications:
DRAM
1 GB
1 internal CompactFlash card1
512 MB
1 external CompactFlash slot2
NA3
1 The card stores software images.
2 The slot is for optional cards to store additional images, and for configuration, debugging, and syslog information.
3 NA = not applicable.
Port Interfaces
The Supervisor-2 module provides the following port interfaces:
•
–
–
–
•
•
•
Note
•
•
•
•
Caution
LEDs on the Supervisor-2 Module
The front panel on the supervisor module has the following LEDs:
•
•
•
•
•
–
–
•
The front panel on the Supervisor-2 module also includes a reset button (see Figure 1-13).
The LEDs on the Supervisor-2 module indicate the status of the Supervisor-2 module, power supplies, and fan module. Table 1-4 provides more information about these LEDs.
Figure 1-13 Supervisor-2 Module LEDs
Supervisor-1 Modules
The Cisco MDS 9509 and 9506 Directors support up to two Supervisor-1 or Supervisor-2 modules that can be installed in slots 5 and 6 only. The main functions and components of the Supervisor-1 modules are as follows:
•
Note
Figure 1-14 shows a Cisco MDS 9500 Series Supervisor-1 module.
Figure 1-14 Cisco MDS 9500 Series Supervisor-1 Module
Status, System, Active, and Pwr Mgmt LEDs1
CompactFlash LED
Reset button
CompactFlash eject button
Console port
CompactFlash slot
MGMT 10/100 Ethernet port (with integrated Link and Activity LEDs)
Asset tag
COM1 serial port
Control and Management
The supervisor modules provide the following control and management features:
•
•
A kernel service running on the supervisor module keeps track of the high availability policy of each process and issues a restart when a process fails. The type of restart issued is based on the process's capability:
–
–
If the kernel service cannot perform a warm restart of the process, it issues a cold restart.
•
If the supervisor module has to be restarted, then the secondary supervisor (which is continuously monitoring the primary) takes over. Once a switchover has occurred and the failed supervisor has been replaced or restarted, operation does not switch back to the original primary supervisor, unless it is forced to switch back or another failure occurs.
Crossbar Switching Fabric
The Cisco MDS 9500 Series supervisor modules provide an integrated crossbar switching fabric to connect all the switching modules. Single fabric configurations provide 720-Gbps full duplex speed with 80-Gbps full duplex bandwidth per switching module. Dual fabric configurations provide 1.4-Gbps speed with 160-Gbps full duplex bandwidth per switching module.
The Cisco MDS 9500 Series supports redundant supervisor modules. Upon power up with slots 5 and 6 active, the supervisors negotiate to determine which one is active and which is the standby supervisor.
Each supervisor exchanges its own status and updates the signal quality error (SQE) status periodically. If the active supervisor becomes disabled, the standby supervisor switches over to become the active supervisor.
Dual supervisor modules provide dual crossbar switching fabrics for redundancy.
Processor
The Supervisor-1 module contains a Pentium III class processor. It has the following memory specifications:
DRAM
1 GB
1 internal CompactFlash card1
512 MB
1 external CompactFlash slot2
NA3
1 The card stores software images.
2 The slot is for optional cards to store additional images, and for configuration, debugging, and syslog information.
3 NA = not applicable.
Port Interfaces
The Supervisor-1 module provides the following port interfaces:
•
–
–
–
•
•
•
Caution
LEDs on the Supervisor-1 Module
The front panel on the Supervisor-1 module has the following LEDs:
•
•
•
•
•
–
–
•
The front panel on the supervisor module also includes a reset button (see Figure 1-15).
The LEDs on the Supervisor-1 module indicate the status of the Supervisor-1 module, power supplies, and fan module. Table 1-5 provides more information about these LEDs.
Figure 1-15 Supervisor-1 Module LEDs
Table 1-5 LEDs for the Cisco MDS 9500 Series Supervisor Modules
Status
Green
All diagnostics pass. The module is operational (normal initialization sequence).
Orange
One of the following occurs:
•
•
Red
One of the following occurs:
•
•
System1
Green
All chassis environmental monitors are reporting OK.
Orange
One of the following occurs:
•
•
•
Red
The temperature of the supervisor module exceeded the major threshold.
Active
Green
The supervisor module is operational and active.
Orange
The supervisor module is in standby mode.
Pwr Mgmt1
Green
Sufficient power is available for all modules.
Orange
Sufficient power is not available for all modules.
MGMT 10/100 Ethernet Link LED
Green
Link is up.
Off
No link.
MGMT 10/100 Ethernet Activity LED
Green
Traffic is flowing through port.
Off
No link or no traffic.
CompactFlash
Green
The external CompactFlash card is being accessed.
Off
No activity.
1 The System and Pwr Mgmt LEDs on a redundant supervisor module are synchronized to the active supervisor module.
Crossbar Modules
The Cisco MDS 9513 Director supports two external crossbar modules located at the rear of the chassis. Each Supervisor-2 module has an associated external crossbar module for redundancy. The Supervisor-2 module in slot 7 is associated with crossbar module 1 and Supervisor-2 in slot 8 is associated with crossbar module 2. Redundant crossbar modules act in an active-active method, where each switching module forwards traffic across both crossbar fabrics based on the intended destination. Therefore the traffic load is shared across both crossbar modules. Each crossbar fabric channel connects to a fabric interface ASIC on the switching modules through serial links on the midplane. Each Supervisor-2 processor also has a 20-Gbps (40-Gbps FDX) link to each crossbar fabric for participating in management and control protocols and for in-band diagnostics.
The LEDs on the crossbar modules indicate the status of the crossbar modules. Table 1-6 provides more information about these LEDs.
Figure 1-16 Crossbar Module LEDs
Cisco MDS 9000 Series Module Compatibility
Table 1-7 lists the hardware modules available and the chassis compatibility associated with them.
