IBM System Storage SAN384B
ꢀꢁꢂ
Installation, Service, and User Guide
Service information: 2499-192
Read Before Using
This product contains software that is licensed under written license agreements. Your use of such software is subject to
the license agreements under which they are provided.
GC52-1333-02
Download from Www.Somanuals.com. All Manuals Search And Download.
IBM System Storage SAN384B
ꢀꢁꢂ
Installation, Service, and User Guide
Service information: 2499-192
GC52-1333-02
Download from Www.Somanuals.com. All Manuals Search And Download.
Note:
Before using this information and the product it supports, read the information in “Notices” on page 141.
Copyright © 2009-2010 Brocade Communications Systems, Inc. All Rights Reserved.
The following paragraph does not apply to any country (or region) where such provisions are inconsistent with
local law.
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT
WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE
IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or
regions) do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement
may not apply to you.
© Copyright IBM Corporation 2009, 2010.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Download from Www.Somanuals.com. All Manuals Search And Download.
Read this first
Summary of changes
|
This is the third edition of the IBM System Storage SAN384B Installation, Service, and
User Guide. The content changes since the last edition of this publication are noted
by a vertical line placed in the left margin beside each change. Minor edits are not
identified by this mark. A summary of the changes for each edition are listed
below.
|
|
|
|
|
|
Third edition
The following changes were made in this edition:
v Addition of a Fibre Channel 8 Gbps 64-port blade (FC8-64)–Feature code 3864
v New mini-SFP (mSFP) transceivers associated with the FC8-64 blade
v Introduction of 8 Gbps FICON Accelerator
v Addition of the Server Application Optimization (SAO) optional feature
|
|
v A change to the Fabric Operating System (FOS) version required for the FC8-64
blade
|
v Update of the Notices section
Second edition
The following changes were made in the second edition:
v The addition of the CEE 10GbE 24-port blade (FCOE10-24)
v The addition of the 8 Gbps routing blade (FX8-24)
v 3-way ICL connection configuration was added
v An update of how to submit comments on this publication
v Battery removal and disposal instructions were added
Getting help
For the latest version of your product documentation, visit the web at
number or title.
For more information about IBM® SAN products, see the following Web site:
|
|
|
IBM Redbooks often provide in depth information about product best practices,
configurations, and more technical information. For redbooks associated with this
For support information for this product and other SAN products, see the
select Storage Area Network (SAN) from the linked page.
For Fabric OS Release Notes and access to Fabric OS firmware downloads, go to
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
iii
Network (SAN) from the linked page. From the displayed page, select your
product, then select Download. From the displayed page, click the release notes or
firmware links.
You can also contact IBM within the United States at 1-800-IBMSERV
(1-800-426-7378). For support outside the United States, you can find the service
For detailed information about the Fibre Channel standards, see the Fibre Channel
For information about storage industry standards, see the Storage Networking
Taiwan Contact Information
IBM Taiwan Product Service Contact Info:
IBM Taiwan Corporation
3F, No 7, Song Ren Rd., Taipei Taiwan
Tel: 0800-016-888
How to send your comments
Your feedback is important in helping us provide the most accurate and
high-quality information. If you have comments or suggestions for improving this
include the following:
v Exact publication title
v Publication form number (for example, GC26-1234-02)
v Page, table, or illustration numbers
v A detailed description of any information that should be changed
iv SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Contents
|
|
|
|
|
© Copyright IBM Corp. 2009, 2010
v
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
|
|
|
|
|
|
|
|
vi SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Contents vii
Download from Www.Somanuals.com. All Manuals Search And Download.
viii SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
x
SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
xii SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Safety notices
This section contains information about:
Safety notices and labels
When using this product, observe the danger, caution, and attention notices
contained in this guide. The notices are accompanied by symbols that represent the
severity of the safety condition. The danger and caution notices are listed in
numerical order based on their IDs, which are displayed in parentheses, for
example (D004), at the end of each notice. Use this ID to locate the translation of
these danger and caution notices in the IBM Systems Safety Notices (G229–9054)
publication, which is on the CD-ROM that accompanies this product.
The following notices and statements are used in IBM documents. They are listed
below in order of increasing severity of potential hazards. Follow the links for
more detailed descriptions and examples of the danger, caution, and attention
notices in the sections that follow.
v Note: These notices provide important tips, guidance, or advice.
programs, devices, or data.
potentially hazardous to you.
lethal or extremely hazardous to you. Safety labels are also attached directly to
products to warn of these situations.
product to warn of potential hazards.
Danger notices
A danger notice calls attention to a situation that is potentially lethal or extremely
hazardous to people. A lightning bolt symbol accompanies a danger notice to
represent a dangerous electrical condition. Read and comply with the following
danger notices before installing or servicing this device.
DANGER
To prevent a possible shock from touching two surfaces with
different protective ground (earth), use one hand, when possible, to
connect or disconnect signal cables. (D001)
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
xiii
DANGER
Overloading a branch circuit is potentially a fire hazard and a
shock hazard under certain conditions. To avoid these hazards,
ensure that your system electrical requirements do not exceed
branch circuit protection requirements. Refer to the information
that is provided with your device or the power rating label for
electrical specifications. (D002)
DANGER
If the receptacle has a metal shell, do not touch the shell until you
have completed the voltage and grounding checks. Improper wiring
or grounding could place dangerous voltage on the metal shell. If
any of the conditions are not as described, STOP. Ensure the
improper voltage or impedance conditions are corrected before
proceeding. (D003)
DANGER
An electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices that
attach to the system. It is the responsibility of the customer to
ensure that the outlet is correctly wired and grounded to prevent
an electrical shock. (D004)
A general electrical danger notice provides instructions on how to avoid shock
hazards when servicing equipment. Unless instructed otherwise, follow the
procedures in the following danger notice.
xiv SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
DANGER
When working on or around the system, observe the following
precautions:
Electrical voltage and current from power, telephone, and
communication cables are hazardous. To avoid a shock hazard:
v Connect power to this unit only with the IBM provided power
cord. Do not use the IBM provided power cord for any other
product.
v Do not open or service any power supply assembly.
v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an
electrical storm.
v The product might be equipped with multiple power cords. To
remove all hazardous voltages, disconnect all power cords.
v Connect all power cords to a properly wired and grounded
electrical outlet. Ensure that the outlet supplies proper voltage
and phase rotation according to the system rating plate.
v Connect any equipment that will be attached to this product to
properly wired outlets.
v When possible, use one hand only to connect or disconnect
signal cables.
v Never turn on any equipment when there is evidence of fire,
water, or structural damage.
v Disconnect the attached power cords, telecommunications
systems, networks, and modems before you open the device
covers, unless instructed otherwise in the installation and
configuration procedures.
v Connect and disconnect cables as described below when
installing, moving, or opening covers on this product or attached
devices.
To Disconnect:
1. Turn off everything (unless instructed otherwise).
2. Remove the power cords from the outlets.
3. Remove the signal cables from the connectors.
4. Remove all cables from the devices.
To Connect:
1. Turn off everything (unless instructed otherwise).
2. Attach all cables to the devices.
3. Attach the signal cables to the connectors.
4. Attach the power cords to the outlets.
5. Turn on the devices.
(D005)
The weight of the SAN cabinet (2109-C36) with two SAN384Bs is greater than 227
kg (500 lb), and has a fully loaded capacity of 816 kg (1795 lb). Under these
conditions, the following statement and notice apply.
Safety notices xv
Download from Www.Somanuals.com. All Manuals Search And Download.
Delivery and subsequent transportation of the equipment
The customer should prepare his environment to accept the new product based on
the installation planning information provided, with assistance from an IBM
Installation Planning Representative (IPR) or IBM authorized service provider. In
anticipation of the equipment delivery, the final installation site should be prepared
in advance such that professional movers/riggers can transport the equipment to
the final installation site within the computer room. If for some reason, this is not
possible at the time of delivery, the customer will need to make arrangements to
have professional movers/riggers return to finish the transportation at a later date.
Only professional movers/riggers should transport the equipment. The IBM
authorized service provider will only perform minimal frame repositioning within
the computer room, as needed, to perform required service actions. The customer
is also responsible for using professional movers/riggers in the case of equipment
relocation or disposal.
DANGER
Heavy equipment—personal injury or equipment damage might
result if mishandled. (D006)
> 500 lbs. (> 227 kg.)
Caution notices
A caution notice calls attention to a situation that is potentially hazardous to
people because of some existing condition. A caution notice can be accompanied
by different symbols, as in the examples below:
If the symbol
is...
It means....
A hazardous electrical condition with less severity than electrical danger.
A generally hazardous condition not represented by other safety
symbols.
A specification of product weight that requires safe lifting practices. The
weight range of the product is listed below the graphic, and the wording
of the caution varies, depending on the weight of the device.
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
A potential hazard of pinching the hand or other body parts between
parts.
P/N 18P5850-B
SJ000752
A hazardous condition due to moving parts nearby.
A hazardous condition due to the use of a laser in the product. Laser
symbols are always accompanied by the classification of the laser as
defined by the U.S. Department of Health and Human Services (for
example, Class I, Class II, and so forth).
xvi SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Read and comply with the following caution notices before installing or servicing
this device.
CAUTION:
Energy hazard present. Shorting may result in system outage and
possible physical injury. Remove all metallic jewelry before servicing.
(C001)
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It takes
specially trained persons, a lifting device, or both to safely lift this
part or unit. (C011)
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
CAUTION:
This product is equipped with a 3-wire (two conductors and ground)
power cable and plug. Use this power cable with a properly grounded
electrical outlet to avoid electrical shock. (C018)
CAUTION:
Servicing of this product or unit is to be performed by trained service
personnel only. (C032)
CAUTION:
For CA residents only: IBM recommends installing this product in a room size
of 62 cubic meters (2190 cubic feet) or larger at 0.4 ACH ventilation rate to
reduce the concentrations of any chemicals emitted by the product.
Safety labels
As an added precaution, safety labels are often installed directly on products or
product components to warn of potential hazards. These can be either danger or
caution notices, depending upon the level of the hazard.
The actual product safety labels may differ from these sample safety labels:
DANGER
Hazardous voltage, current, or energy levels are present inside
any component that has this label attached. Do not open any
cover or barrier that contains this label. (L001)
DANGER
Rack-mounted devices are not to be used as a shelf or work space.
(L002)
Safety notices xvii
Download from Www.Somanuals.com. All Manuals Search And Download.
DANGER
Multiple power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages,
disconnect all power cords. (L003)
DANGER
Hazardous voltage present. Voltages present constitute a shock
hazard, which can cause severe injury or death. (L004)
CAUTION:
Hazardous energy present. Voltages with hazardous energy might
cause heating when shorted with metal, which might result in
splattered metal, burns, or both. (L005)
CAUTION:
Hazardous moving parts nearby (L008)
CAUTION:
Pinch hazard. (L012)
P/N 18P5850-B
SJ000752
Attention notices
An attention notice indicates the possibility of damage to a program, device, or
system, or to data. An exclamation point symbol may accompany an attention
notice, but is not required. A sample attention notice follows:
Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can
damage the cable. Tie wraps are not recommended for optical cables because they
can be easily overtightened, causing damage to the cable.
ESD precautions
Attention: Many of the field replaceable units (FRUs) are sensitive to electrostatic
discharge (ESD), and can potentially be damaged by improper handling. Wear a
wrist grounding strap connected to chassis ground (if the SAN384B is plugged in)
or a bench ground. Store all ESD-sensitive components in antistatic packaging.
xviii SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Rack safety
Rack installation
DANGER
Observe the following precautions when working on or around your IT rack system:
v Heavy equipment—personal injury or equipment damage might result if
mishandled.
v Always lower the leveling pads on the rack cabinet.
v Always install stabilizer brackets on the rack cabinet.
v To avoid hazardous conditions due to uneven mechanical loading, always install the
heaviest devices in the bottom of the rack cabinet. Always install servers and
optional devices starting from the bottom of the rack cabinet.
v Rack-mounted devices are not to be used as shelves or work spaces. Do not place
objects on top of rack-mounted devices.
v Each rack cabinet might have more than one power cord. Be sure to disconnect all
power cords in the rack cabinet when directed to disconnect power during servicing.
v Connect all devices installed in a rack cabinet to power devices installed in the
same rack cabinet. Do not plug a power cord from a device installed in one rack
cabinet into a power device installed in a different rack cabinet.
v An electrical outlet that is not correctly wired could place hazardous voltage on the
metal parts of the system or the devices that attach to the system. It is the
responsibility of the customer to ensure that the outlet is correctly wired and
grounded to prevent an electrical shock.
(R001 part 1 of 2)
CAUTION:
v Do not install a unit in a rack where the internal rack ambient temperatures will
exceed the manufacturer’s recommended ambient temperature for all your
rack-mounted devices.
v Do not install a unit in a rack where the air flow is compromised. Ensure that air flow
is not blocked or reduced on any side, front, or back of a unit used for air flow
through the unit.
v Consideration should be given to the connection of the equipment to the supply circuit
so that overloading of the circuits does not compromise the supply wiring or
overcurrent protection. To provide the correct power connection to a rack, refer to the
rating labels located on the equipment in the rack to determine the total power
requirement of the supply circuit.
v (For sliding drawers) Do not pull out or install any drawer or feature if the rack stabilizer
brackets are not attached to the rack. Do not pull out more than one drawer at a time.
The rack might become unstable if you pull out more than one drawer at a time.
v (For fixed drawers) This drawer is a fixed drawer and must not be moved for servicing
unless specified by the manufacturer. Attempting to move the drawer partially or
completely out of the rack might cause the rack to become unstable or cause the
drawer to fall out of the rack.
(R001 part 2 of 2)
Safety notices xix
Download from Www.Somanuals.com. All Manuals Search And Download.
Rack relocation (19" rack)
CAUTION:
Removing components from the upper positions in the rack cabinet improves
rack stability during relocation. Follow these general guidelines whenever you
relocate a populated rack cabinet within a room or building:
v Reduce the weight of the rack cabinet by removing equipment starting at the
top of the rack cabinet. When possible, restore the rack cabinet to the
configuration of the rack cabinet as you received it. If this configuration is not
known, you must do the following:
– Remove all devices in the 32U position and above.
– Ensure that the heaviest devices are installed in the bottom of the rack
cabinet.
– Ensure that there are no empty U-levels between devices installed in the
rack cabinet below the 32U level.
– If the rack cabinet you are relocating is part of a suite of rack cabinets,
detach the rack cabinet from the suite.
– Inspect the route that you plan to take when moving the rack to eliminate
potential hazards.
– Verify that the route that you choose can support the weight of the loaded
rack cabinet. Refer to the documentation that came with your rack cabinet
for the weight of a loaded rack cabinet.
– Verify that all door openings are at least 760 x 2030 mm (30 x 80 in.).
– Ensure that all devices, shelves, drawers, doors, and cables are secure.
– Ensure that the four leveling pads are raised to their highest position.
– Ensure that there is no stabilizer bracket installed on the rack cabinet
during movement.
– Do not use a ramp inclined at more than 10 degrees.
– Once the rack cabinet is in the new location, do the following:
- Lower the four leveling pads.
- Install stabilizer brackets on the rack cabinet.
- If you removed any devices from the rack cabinet, repopulate the rack
cabinet from the lowest position to the highest position.
– If a long distance relocation is required, restore the rack cabinet to the
configuration of the rack cabinet as you received it. Pack the rack cabinet in
the original packaging material, or equivalent. Also, lower the leveling
pads to raise the casters off of the pallet and bolt the rack cabinet to the
pallet.
(R002)
xx SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Safety inspections
Perform the following safety checks to identify unsafe conditions. Be cautious of
potential safety hazards that are not covered in the safety checks. If unsafe
conditions are present, determine how serious the hazards are and whether you
should continue before you correct the problem.
Removing AC power
Perform the following steps to remove the alternating current (ac) power:
1. Perform a controlled system shutdown.
2. Set the power switch on the product to the off position.
3. Disconnect the power cables from the power source.
DANGER
Multiple power cords. (L003)
External machine checks
Perform the following external machine checks:
1. Verify that all external covers are present and are not damaged.
2. Ensure that all latches and hinges are in correct operating condition.
3. Check the power cable for damage.
4. Check the external signal cable for damage.
5. Check the cover for sharp edges, damage, or alterations that expose the internal
parts of the device.
6. Check that any unused serial ports are covered for dust and ESD protection.
The cover should be kept on the serial port whenever it is not being used.
7. Correct any problems that you find.
Internal machine checks
Perform the following internal machine checks:
1. Check for any non-IBM changes that might have been made to the machine. If
any are present, obtain the “Non-IBM Alteration Attachment Survey” form,
number R009, from the IBM branch office. Complete the form and return it to
the branch office.
2. Check the condition of the inside of the machine for:
v Metal or other contaminants
v Indications of water or other fluid
v Fire or smoke damage
3. Check for any obvious mechanical problems, such as loose components.
4. Check any exposed cables and connectors for wear, cracks, or pinching.
Safety notices xxi
Download from Www.Somanuals.com. All Manuals Search And Download.
Product recycling and disposal
Refer to the IBM Systems Environmental Notices and User Guide (Z125-5823) on the
product documentation CD for translated environmental statements and
information regarding product recycling and disposal. This document may be
provided either in printed version or on the product documentation CD. See
“Removing the battery” on page 105 for battery removal instructions, if needed to
meet environmental regulations.
xxii SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
About this document
This document describes how to install and service the IBM System Storage™
SAN384B fabric backbone product. Throughout this document, the product is
referred to as the SAN384B. This document includes information specific to the
SAN384B running Fabric OS version 6.4.0. and later. For information about a Fabric
OS version other than 6.4.0, refer to the documentation specific to your Fabric OS
version.
|
|
|
|
The sections that follow provide information about:
Who should read this document
This document is intended for trained service representatives who are responsible
for installing and servicing the SAN384B, and for network administrators
responsible for maintaining and using the SAN384B.
Product documents
The following documents contain information related to this product. The
documentation may be printed material or may be on the documentation CD that
is shipped with the product.
v IBM System Storage SAN384B Installation, Service, and User Guide, GC52-1333 (this
document, which is also available in accessible HTML format on the
documentation CD)
v IBM Systems Safety Notices, G229–9054
v IBM Systems Environmental Notices and User Guide, Z125-5823
v IBM Warranty
|
|
v Implementing an IBM/Brocade SAN with 8 Gbps Directors and Switches, (an IBM
Redbook), SG24-6116
Brocade documents
IBM switches use software licensed from Brocade Communications Systems, Inc.
You can find information related to the software that supports the SAN384B in the
following documents on the CD-ROM supplied with this product:
Brocade Fabric OS
v Fabric OS Administrator's Guide
v Fabric OS Command Reference Manual
v Fabric OS MIB Reference
v Fabric OS Message Reference
v Fabric OS Troubleshooting and Diagnostics Guide
v Fabric OS FCIP Administrator's Guide
v FICON Administrator's Guide
© Copyright IBM Corp. 2009, 2010
xxiii
Download from Www.Somanuals.com. All Manuals Search And Download.
v SAN Glossary
Brocade Fabric OS optional features
v Fabric Watch Administrator's Guide
v Web Tools Administrator's Guide
|
|
Brocade HBA publication
v Brocade Adapters Administrator’s Guide
IBM and Brocade product matrix
When you use any of the Brocade documents, you will notice that the model
for you to use to correlate the Brocade products and models to the IBM product
names and machine types and model numbers. Products withdrawn from
marketing are not listed.
Table 1. Brocade and IBM product and model number matrix
IBM machine type and
Brocade product name
Brocade DCX-4S
Brocade DCX
Brocade 48000
Brocade 8000
IBM product name
SAN384B
model number
2499 Model 192
SAN768B
2499 Model 384
SAN256B Director
IBM Converged Switch B32
SAN06B-R
2109 Model M48
3758 Models B32 and L32
2498 Model R06
Brocade 7800
Brocade 7500E
Brocade 5300
SAN04B–R
2005 Model R04
SAN80B-4
2498 Model B80
Brocade 5100
SAN40B-4
2498 Models B40 and 40E
2498 Models B24 and 24E
Brocade 300
SAN24B-4
Accessibility features for SAN384B
Accessibility features help users who have a disability, such as restricted mobility
or limited vision, to use information technology products successfully.
Accessibility features
Use and operation of this device is accomplished primarily through external
devices which may provide different accessibility features.
The following list includes the major accessibility features in the SAN384B either
directly or through external devices or interfaces:
v Keyboard-only operation
v Interfaces that are commonly used by screen readers
v Keys that are discernible by touch but do not activate just by touching them
v Industry-standard devices for ports and connectors
v The attachment of alternative input and output devices
Keyboard navigation
This product uses standard Microsoft® Windows® navigation keys.
xxiv SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Vendor software
The SAN384B includes certain vendor software that is not covered under the IBM
license agreement. IBM makes no representation about the accessibility features of
these products. Contact the vendor for the accessibility information about its
products.
Related accessibility information
You can view the publications for the SAN384B in Adobe Portable Document
Format (PDF) using the Adobe Acrobat Reader. The PDFs are provided on a CD
that is packaged with the product. An accessible HTML version of this document is
also included on the documentation CD for this product.
IBM and accessibility
See the IBM Human Ability and Accessibility Center for more information about
About this document xxv
Download from Www.Somanuals.com. All Manuals Search And Download.
xxvi SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 1. Introduction
This chapter introduces the features and components of the IBM System Storage
SAN384B fabric backbone. Throughout this document, the product is referred to as
the SAN384B, or more generically as system, device, or chassis, where appropriate.
This chapter contains the following information:
Overview of the SAN384B
The SAN384B is part of IBM's industry-leading backbone-class product line, a
highly robust class of network switching platform that combines breakthrough
performance, scalability, and energy efficiency with long-term investment.
Supporting open systems and System z®, SAN backbones are designed to address
the data growth and application demands of evolving enterprise data centers,
achieve server, SAN, and data center consolidation, and reduce infrastructure and
administrative costs.
Key features of the SAN384B include:
|
|
v A horizontal chassis with up to 256 ports through four port blades (in addition
to two core switching and two core processing blades).
v Support for all of the application, port blade, and control processor (CP) blades
supported in the SAN768B, providing flexible system configurations and fewer
types of new blades. (SAN768B CR8 core switch blades are not supported in the
SAN384B chassis.)
v Up to 768 ports can connect with the use of inter-chassis links (ICLs).
v Support for high-performance port blades running at 1-, 2-, 4-, 8-, or 10-Gbps,
enabling flexible system configuration.
v Supports 1-, 2-, 4-, and 8-Gbps auto-sensing Fibre Channel ports. Trunking
technology groups up to eight ports to create high performance 64-Gbps ISL
trunks between switches. (10 Gbps ports (FC10-6) are 10 Gbps only.)
v Dual-redundant control processor blades (CP8) and core switch blades (CR4S-8)
provide high availability and enable nondisruptive software upgrades.
v Redundant and hot-swappable CP8 and CR4S-8 blades, power supplies, blower
assemblies, and WWN cards enable a high availability platform for mission
critical SAN applications.
v Universal ports that self-configure as E_ports, F_ports, FL_ports, Ex_ports, and
M_ports (mirror ports). 10 Gbps ports (FC10-6) are E-Ports only.
v Fibre Channel over IP (FCIP) functionality through the FX8-24 blade.
v Fibre Channel over Ethernet (FCoE) capability through the FCOE10-24 blade.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
1
Hardware components
The SAN384B features a modular and scalable mechanical construction that allows
a wide range of flexibility in installation, fabric design, and maintenance. The
chassis may be mounted with the cables facing the front of the equipment rack or
to the rear, and consists of the following:
v Up to four hot-swappable port blade assemblies can be configured in a single
|
|
chassis, delivering up to 256 Fibre Channel ports
v Two slots for control processor blades (CP8):
– A single active CP8 blade can control all 256 ports in the chassis
– The standby CP8 blade assumes control of the SAN384B if the active CP fails
v Two slots for core switch blades (CR4S-8):
– CR4S-8 blade interconnects all port blades
– Two inter-chassis link (ICL) connectors per blade to connect to another chassis
– Both CR4S-8 blades are active
v Modular hot-swappable port blades:
– 16-port, 8-Gbps blades (FC8-16)
– 32-port, 8-Gbps blades (FC8-32)
– 48-port, 8-Gbps blades (FC8-48)
|
– 64-port 8-Gbps blades (FC8-64)
– 6-port, 10-Gbps blades (FC10-6)
v Modular hot-swappable application blades:
– FR4-18i: 18-port (16 FC + 2 GbE), up to 4 blades per chassis, supporting Fibre
Channel Routing Services and FCIP
– FX8-24: 24-port (12 FC, 10 GbE, 2 10GbE) FCIP extension blade enabling long
distance communication over existing IP infrastructure
– FCOE10-24: 24-port (24 10GbE) CEE-based FCoE blade enabling enhanced
connectivity using existing Ethernet infrastructure. This blade cannot be used
in the same chassis as the high density port blade FC8-64 or the FX8-24 or
FR4-18i application blades.
|
|
|
v Modular hot-swappable field replaceable units (FRUs):
– Two blower assemblies
– Two 100 to 240 VAC power supplies. 240 VAC is recommended for efficiency
and high availability.
– Two WWN cards
|
|
|
– Small Form-factor Pluggable (SFP, SFP+, and mSFP) optical transceivers. SFP
transceivers support speeds of 1, 2, and 4 Gbps. SFP+ and mSFP transceivers
support speeds of 2, 4, and 8 Gbps.
– Extended Form-factor Pluggable (XFP) optical transceivers (10-Gbps)
– 1 GbE copper SFP transceivers for the IP ports on the routing blade
|
|
Note: The 8-Gbps SFPs and mSFPs auto-negotiate at 2, 4, and 8 Gbps. The
4-Gbps SFPs auto-negotiate at 1, 2, and 4 Gbps.
v Port-side exhaust kit (standard), which directs the exhaust airflow to the cabinet
service aisle
v All blades are serviced from the port side of the SAN384B. Blowers, power
supplies, and power cables are serviced from the nonport side
v World Wide Name (WWN) cards on the nonport side, with WWN status LEDs
located under the bezel
2
SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
v Improved cable management using two vertical cable management finger
assemblies
v Constant intake and FRU temperature monitoring
v Redundant AC primary power connections to ensure high availability. Each
power supply has its own connector
Note: Airflow in the SAN384B is from the non-port (non-cable) side to the left side
of the chassis. With the port-side exhaust kit installed (see Figure 2 on page
4, the air flows out the vent on the port side of the chassis.
Figure 1 shows a sample configuration of the port side of the SAN384B with four
FC8-48 port blades installed.
1
2
3
4
Figure 1. Port side of the SAN384B (sample configuration)
ꢀ1ꢁ
ꢀ2ꢁ
FC8-48 port blade (example, 4x)
Core switch blade (CR4S-8) (2x)
ꢀ3ꢁ
ꢀ4ꢁ
Control processor blade (CP8) (2x)
Exhaust vent
Figure 2 on page 4 shows the SAN384B with the port-side exhaust kit installed
over the chassis exhaust vent (sample configuration). The exhaust is routed from
the chassis exhaust vent through the port-side exhaust kit. The exhaust exits
through the vent grill below the chassis.
Chapter 1. Introduction
3
Download from Www.Somanuals.com. All Manuals Search And Download.
Figure 2. Port side of the SAN384B with the exhaust kit installed (sample configuration)
Figure 3 shows the non-port side of the SAN384B.
1
2
3
Figure 3. Blower (non-port) side of the SAN384B
ꢀ1ꢁ
ꢀ2ꢁ
WWN bezel
ꢀ3ꢁ
Blower assembly (2x)
Power supply (2x)
4
SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
SAN384B blades
that are available for the SAN384B.
Table 2. Blades available for the SAN384B
Description
Feature Code
Name
Function
Control processor
blade
N/A
CP8
The CP8 blade
contains the control
plane for the chassis.
There are two CP8
blades for
redundancy. This
control processor
blade is compatible
with the SAN768B
and SAN384B.
Core switch blade
N/A
CR4S-8
The CR4S-8 blade
contains the ASICs
for switching
between port blades.
Every port blade
connects to each core
switch blade. There
can be up to 256 total
ports for port blades.
Each core switch
blade connects to 128
backplane ports. Core
switch blades have
additional front port
connectivity to
|
|
|
|
|
|
|
|
connect multiple
chassis and
backplane
connections for the
storage server blade.
This core switch
blade is compatible
only with the
SAN384B.
16-port 8-Gbps port
blade
FC3816
FC3832
FC3848
FC8-16
FC8-32
FC8-48
A 16-port blade
supporting 1–, 2–, 4–,
and 8–Gbps port
speeds.
32-port 8-Gbps port
blade
A 32-port blade
supporting 1-, 2-, 4-,
and 8-Gbps port
speeds.
48-port 8-Gbps port
blade
A 48-port blade
supporting 1-, 2-, 4-,
and 8-Gbps port
speeds.
Chapter 1. Introduction
5
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 2. Blades available for the SAN384B (continued)
Description
Feature Code
Name
Function
|
|
|
|
|
|
|
64-port 8-Gbps port
blade
FC3864
FC8-64
A 64-port port blade
supporting 2, 4, and
8 Gbps port speeds.
This blade cannot be
used in the same
chassis with an
FCOE10-24 blade.
6-port 10-Gbps port
blade
FC3870
FC10-6
FR4-18i
A 6-port blade
supporting 10-Gbps
port speed. Blade
provides 10-Gbps
ISLs.
Fibre Channel router FC3850
blade
The FR4-18i blade
has 16 4-Gbps
physical Fibre
Channel SFP ports
supporting Fibre
Channel Routing
Services and two
physical Gigabit
Ethernet (GbE) SFP
ports supporting
Fibre Channel Over
IP (FCIP). The two
physical GbE ports
can support up to 16
virtual E_ports.
FCIP extension blade FC3890
FX8-24
The FX8-24 blade
enables FCIP
functionality over
existing IP
infrastructure. It has
twelve FC ports, ten
1 GbE ports, and two
10 GbE ports
available.
Fibre Channel over
Ethernet blade
FC3880
FCOE10-24
The FCOE10-24 blade
enables FCoE
functionality over
existing Ethernet
infrastructure
utilizing CEE
protocols. It has
twenty-four 10 GbE
ports available. This
blade cannot be used
in the same chassis
with an FC8-64 high
density port blade or
the FR4-18i or FX8-24
application blades.
|
|
|
|
|
|
|
6
SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
High availability
The following features contribute to the SAN384B's high-availability design:
v Redundant, hot-swappable blades and FRUs
v Enhanced data integrity on all data paths
v Fabric Shortest Path First (FSPF) rerouting around failed links
v Integration with Simple Network Management Protocol (SNMP) managers
v Automatic control processor failover
v Nondisruptive "hot" software code loads and activation
v Easy configuration, save, and restore
v Hot-swappable World Wide Name (WWN) cards
The high-availability software architecture of the SAN384B provides a common
framework for all applications that reside on the system, allowing global and local
status to be maintained through any component failure. High-availability elements
consist of the High Availability Manager, the heartbeat, the fault/health
framework, the replicated database, initialization, and software upgrade.
The High Availability Manager controls access to the standby control processor,
facilitates software upgrades, prevents extraneous switchover activity, closes and
flushes streams, provides flow control and message buffering, and supports a
centralized active and standby state.
Reliability
The SAN384B uses the following error detection and correction mechanisms to
ensure reliability of data:
|
|
|
v Error Detection and Fault Isolation (EDFI) mechanism, which checks for encoder
errors and fault isolation, such as cyclic redundancy checking (CRC), parity
checking, checksum, and illegal address checking.
v Power-on self test (POST)
v Dual control processors that enable hot, nondisruptive fast firmware upgrades
v Each control processor contains one serial port and two Ethernet ports, for
management and for service. Offline control processor diagnostics and remote
diagnostics simplify troubleshooting. The standby control processor monitors
diagnostics to ensure it is operational, should a failover be necessary
v Bus monitoring and control of blades and other field-replaceable units (FRUs).
Serviceability
The SAN384B provides the following features to enhance and ensure serviceability:
v Modular design with hot-swappable components
v Flash memory that stores two firmware images per control processor
|
|
v USB port on control processor blades for all tasks that formerly required an
FTP/SCP server, including software and firmware upgrades
v Nonvolatile random-access memory (NVRAM), containing the OEM serial
number, IBM serial number, revision information, and part number information
v Background health-check daemon
v Memory scrubber, self test, and bus ping to determine if a bus is not functioning
v RASlog messages
Chapter 1. Introduction
7
Download from Www.Somanuals.com. All Manuals Search And Download.
v SMI-S compliant
v Watchdog timers
v Status LEDs
v Predictive diagnostics analysis through Fabric Watch
v SNMP (including version 3) integration with higher-layer managers
v Vertical cable management finger assemblies to accommodate the horizontal
orientation of the blades
Software features
The Fabric OS allows any Fibre Channel-compliant device to attach to the switches
as long as it conforms to the device login, name service, and related Fibre Channel
standards. Each operating environment requires that a Fibre Channel host bus
adapter (HBA) be available with a standards-compliant driver for correct interface
to the fabric.
Fabric OS consists of a set of embedded applications running on top of an
embedded Linux® operating system kernel. These applications include:
v Name server
v Alias server
v Zone server
v Simple Network Management Protocol (SNMP) agent
v SMI-S compliant API
v Syslog auditing
v RCS (Reliable Commit Service)
v NTP
v Tasks to manage address assignment, routing, link initialization, fabric
initialization, link shutdown, SAN384B shutdown, and the user interface.
v Integrated Routing (optional feature)–This feature allows any port in a SAN384B,
SAN80B-4, and SAN40B-4 to be configured as an EX_port supporting Fibre
Channel (FC) routing. This eliminates the need to add a routing blade or use of
the SAN18B-R for FC routing (FCR) purposes, and this also provides double the
bandwidth for each FC router connection when connected to another 8
Gbps-capable port.
v FICON® Accelerator (optional feature), which is designed to support secure
high-speed data movement between multiple locations
Security
for other switches running Fabric OS 5.2.0 or later.
Table 3. Security features
Security features
Description
DH-CHAP
Login banner
SSHv2 (using AES, 3DES, RSA)
Monitoring of attempted security breaches
(through audit logging)
HTTPS (using AES)
SNPMv3
Monitoring of attempted security breaches
(through Fabric Watch Security Class)
Fibre Channel security policies: DCC and
SCC
8
SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 3. Security features (continued)
Security features
Description
FC-SP
Trusted Switch (FCS) for central security
management
Secure RPC
Management access controls (SNMPv3,
Telnet, FTP, serial port, front panel)
Secure file copy (SCP)
Hardware-enforced zoning by WWN and/or
domain/port ID
Telnet disable
Default zoning
Telnet timeout
RSCN suppression and aggregation
Configurable RSCN suppression by port
NTPv3 (to synchronize timestamps)
IP filters (block listeners)
Secure passwords (centralized control via
RADIUS/CHAP)
Up to 255 multiple user accounts (MUAs).
Role-based access controls (RBACs)
Administrative domains/Virtual fabrics
Boot PROM password reset
Event auditing
Change tracking
Firmware change alerts in Fabric Manager
Persistent port disable
Persistent domain ID
E_port disable
Password hardening policies
Upfront login in Web Tools
Network Manageability
The SAN384B has a single domain and is managed as a single element with the
Data Center Fabric Manager or Web Tools. The SAN384B responds to its own IP
address and appears as a separate entity to the Telnet protocol and SNMP.
All management interfaces, such as Telnet, Web Tools, standards compliant SMI-S,
and Management Server, support a "port N within blade M" naming scheme.
The SAN384B supports SNMPv1 and SNPMv3. When SNMP devices send SNMP
messages to a management console running SAN management software, the
information is stored in a management information base (MIB). Fabric OS v6.2 and
later supports the latest Fibre Alliance Fibre Channel Management (FCMGMT) and
Storage Management Initiative (SMI) MIBs, which allow common information
necessary for management software to provide information to a SAN
administrator.
Note: Refer to the Fabric OS MIB Reference for additional MIB information.
Chapter 1. Introduction
9
Download from Www.Somanuals.com. All Manuals Search And Download.
10 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 2. Installing a SAN384B in a cabinet
The SAN384B is only available for installation in the IBM TotalStorage® 2109 SAN
Switch Cabinet C36. This product is to be installed and serviced only by qualified
IBM service representatives. The SAN384B can be ordered pre-installed in the
cabinet, or it can be added to an existing C36 cabinet. The cabinet is designed to
support a total of three SAN384Bs. Each installation of the SAN384B requires the
port-side exhaust vent kit, which directs the exhaust to the service aisle and also
serves as the rack installation kit. If three SAN384B products are ordered, two will
be pre-installed in the C36 cabinet, and the third will be installed in the cabinet at
the customer site.
This chapter describes how to install a SAN384B into a C36 cabinet, and how to
remove the SAN384B from the cabinet in the event you need to move or replace
the SAN384B. If all SAN384B units are already installed in the cabinet, continue on
requires a minimum of two people for a safe installation.
performing any installation or service procedures.
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It
takes specially trained persons with a lifting device to safely lift
this part or unit. (C011)
55 kg ( 121.2 lbs)
CAUTION:
A fully populated SAN384B weighs approximately 68 kg (150 lb). Before you
install it, verify that the additional weight of the chassis does not exceed the
cabinet's weight limit or unbalance the cabinet. When you calculate the
additional weight, include the weights of all components that can potentially be
added, to avoid overloading in the future.
CAUTION:
For CA residents only: IBM recommends installing this product in a room size
of 62 cubic meters (2190 cubic feet) or larger at 0.4 ACH ventilation rate to
reduce the concentrations of any chemicals emitted by the product.
Ordering the lift tool
Important
The lift tool is required only when you install an additional SAN384B or
when you install or remove the SAN384B from the cabinet. Ensure that the
lift tool will be available on location at the time of the installation.
The ordering procedures for the lift tool vary depending on your location. You
should direct questions about these procedures to your regional representative.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
11
World trade locations
The following ordering procedures are for world trade locations:
v Order the lift tool by using the parts order system, like any other part.
v Use the following part numbers when you order:
– Lift tool: PN 09P2481
– 24–inch load plate: PN 11P4369
v You do not record parts usage.
v Return the lift tool and the 24–inch load plate to the parts center after you
complete the installation or removal of the SAN384B.
United States locations
In the United States, call UPS Logistics at 800–528–6070 to order the lift tool and
the 24–inch load plate.
Note: For the SSR branch and territory, the United States cannot order the lift tool
or 24–inch load plate through the parts order system. UPS Logistics are used
to ship and return the lift tool and 24–inch load plate.
Use the following part numbers when you order:
v Lift tool: PN 09P2481
v 24–inch load plate: PN 11P4369
Attention: When you order the lift tool, you will receive an 18–inch load plate.
Do not use the 18–inch load plate. You must order and use a 24–inch load plate
when you install the SAN384B to be able to safely install this product. The 24-inch
load plate includes a platform with a middle section that can slide out to extend
across the gap between the lift tool and the mounting position inside the C36
cabinet.
You must provide the following information when you order the lift tool. This
information is necessary to ensure that the lift tool is delivered when you need it.
Failure to provide this information might delay the completion of the order request
and the shipping request. It might also result in a time and date to return the tool
that is different from what you need.
v Phone number and customer contact
v Account code: 98577
v Time and date of delivery
v Accurate destination address with zip code
v Time and date of return pickup
You must return the lift tool at the time that was scheduled with UPS Logistics. If
you need to change the scheduled return time or date, contact UPS Logistics.
You are responsible for ensuring that all of the paperwork and components are
packed and restored in the arbocrate (shipping container) of the lift tool. Ensure
that the lift tool is functioning properly before you release the tool to UPS Logistics
for return. You are accountable for the lift tool until UPS Logistics picks up the lift
tool for return delivery to their parts storage facility.
Contact your branch office tools coordinator or your region specialist if you have
any questions or concerns.
12 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Installation guidelines
Follow these general installation guidelines:
1. Provide a space that is 9 rack units (9U) high, 61.19 cm (24.09 in.) deep, and
43.74 cm (17.22 in.) wide. 1U is equal to 4.45 cm (1.75 in.).
2. Ensure that dedicated electrical branch circuits with the following requirements
are met:
v 200 – 240 VAC, 50–60 Hz (two branch circuits)
v Two cables for the 200 - 240 VAC service
v Power supply standards (“Power specifications”) are met
v Protected by a circuit breaker in accordance with local electrical codes
v Supply circuit, line fusing, and wire size adequate to the electrical rating on
the chassis nameplate
v Location close to the chassis and easily accessible
v Grounded outlets installed by a licensed electrician and compatible with the
power cords
Attention: To maximize fault tolerance, connect each power cord to a
separate power source.
3. To ensure adequate cooling, plan to install the chassis with the port side facing
the aisle where exhaust air is released (usually called the service aisle). This
prevents the fans from pulling in heated exhaust air.
4. Plan for managing the cables before you install the chassis. A fully populated
SAN384B will have a large number of cables that must be carefully routed to
minimize problems with installation and replacement of components, and in
order to maintain the minimum bend radius required for optical cables. Due to
port density and the potentially large number of cables, if cables are not routed
to the sides, then removal and replacement of blades and other components
specific information. You can manage the cables in a variety of ways, such as:
v Routing the cables through the vertical cable management finger assemblies
installed on either side of the chassis
v Routing the cables out to either side of the chassis
v Routing the cables through the cable channels on the sides of the cabinet
v Using patch panels
5. Ensure that the following are available for configuration:
v Workstation with an installed terminal emulator, such as HyperTerminal
v Serial cable (provided)
v Three Ethernet cables (including one spare)
v Access to an FTP server for backing up the switch configuration or collecting
supportsave output data (optional)
v SFPs and compatible cables
6. Ensure that the air intake vents have a minimum of 2 inches of airspace.
7. Ensure that the air temperature on the air intake side is less than 40°C (104°F )
during operation.
Chapter 2. Installing a SAN384B in a cabinet 13
Download from Www.Somanuals.com. All Manuals Search And Download.
Installing a SAN384B in a 2109 C36 cabinet
This section describes how to install the SAN384B in the Model C36 cabinet. These
procedures use parts that are included in the hardware accessory kit and the
port-side exhaust kit, which also functions as a lower supporting shelf. No
rack-mount rail kit is required for this installation.
To safely complete the installation, a minimum of two people are required.
Time required
Allow approximately 3 hours to complete this entire procedure. This total includes
unpacking, assembling, disassembling, and repacking the lift tool. The time
estimate is for the physical installation of the SAN384B only. It does not include
installing Ethernet cables, transceivers, attaching and routing the fiber optic cables,
or completing the initial configuration.
|
The SAN384B and the lift tool should be delivered to a location near to the final
installation, with clear aisles for maneuvering the lift tool loaded with the chassis.
Since the lift tool can be used to move the chassis the short distance from the
delivery location to the installation, it is recommended that you assemble the lift
tool before starting the installation steps.
Note: Brief assembly instructions for the lift tool are attached to the back of the lift
tool. Additional instructions are included below in “Unpacking and
and the tools required for each task.
Table 4. Installation tasks, time, and items required
Installation task
Time estimate
Items required
Unpacking and assembling
the lift tool
15 minutes
No special tools required.
Site preparation and
unpacking the SAN384B
30 minutes
#2 Phillips screwdriver (for
cable management comb)
Pallet jack (if the shipment
has not been positioned near
the installation site)
Installing the port-side
exhaust kit
15 minutes
15 minutes
Torque wrench with #2
Phillips screwdriver tip
Flathead screwdriver
Mounting and securing the
SAN384B in the rack
Torque wrench with #2
Phillips screwdriver tip
Lift tool and load plate
Installing power cables and
powering on the SAN384B
20 minutes
20 minutes
Power cables
Establishing serial
Serial cable (provided in the
accessory kit). Workstation
computer with a serial port
or terminal server port and a
terminal emulator
connection, logging on to the
SAN384B, and configuring IP
addresses.
application (such as
HyperTerminal). Ethernet IP
addresses for the switch.
14 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 4. Installation tasks, time, and items required (continued)
Installation task Time estimate
Items required
Installing an Ethernet cable, 20 minutes
opening a Telnet session, and
configuring the SAN384 B
Ethernet cable for Telnet
access. Refer to the Fabric OS
Administrator’s Guide.
domain ID, date and time,
and additional system
parameters. Verifying and
backing up the configuration.
|
|
|
Installing SFP, SFP+, mSFP,
and XFP (10-Gbps) optical
transceivers as needed
15-30 minutes (depending on Optical transceivers.
port blades installed)
|
|
|
Attaching fiber optic cables, 2-3 hours
cable wraps, and cable
guides
Fiber optic cables and cable
wraps.
Disassembling and packing
the lift tool
20 minutes
No special tools required.
Unpacking and assembling the lift tool
Assembling the lift tool before starting the installation will simplify the installation.
The lift tool consists of several parts, including:
v The fully assembled main vertical section of the lift tool with wheels, wheel lock,
cables and winch attached
v Attachable lift forks, which slide onto the front of the lift tool and are secured in
place by spring-loaded pins and ring pins
v 24-inch load plate with sliding middle section (ordered separately to use in place
of the 18-inch solid single-piece load plate)
v Anti-tip bars
v Retention straps
v Wheel chocks
Assembly instructions are attached to the back of the main vertical section of the
lift tool. The following supplemental information may help with the assembly.
1. With one person at either end, lift the main section of the lift tool out of the
shipping crate.
2. Review the assembly instructions attached to the back of the lift tool, if
necessary.
3. With the lift tool still horizontal, insert the two legs with caster wheels into
the holes in the front of the lift tool.
4. Pull up on the spring-loaded leg lock pins, sliding the legs in until the pins
snap into place through the holes in the legs, securing them in place.
5. Tilt the lift tool upright, resting on all four wheels. Set the wheel brake, if
desired, by stepping down on the brake pedal. (Note the brake release on the
left side of the brake pedal.)
6. Attach the two forks to the lift tool, sliding the two holes in each over the
ends of the two bars. If the winch is in the lowest position, you may need to
raise it to provide enough clearance to slide the forks into position. Secure
each lifting fork in place with two ring-pins.
Chapter 2. Installing a SAN384B in a cabinet 15
Download from Www.Somanuals.com. All Manuals Search And Download.
7. Attach the 24-inch load plate, by slipping the top curved portion under the
horizontal bar, and resting the load plate on the forks.
8. Attach the anti-tip bars (recommended to provide additional stability when
the loaded lift tool is raised more than 45 cm (18 in) high). Install these from
the rear of the lift tool, by sliding them inside the horizontal legs, pulling up
on the leg lock pins to allow the pins to engage the holes in the legs and the
anti-tip bars.
9. Secure the anti-tip brackets to the lift tool with the supplied brackets and
bolts.
10. The lift plate has a middle section that can be extended to the right (when
viewed from the back of the lift tool). This middle section is secured in place
by two spring-loaded pins. Familiarize yourself with releasing the pins and
sliding this section. There are two stops: half-way extended and fully
extended. This middle section will need to be fully extended during the
installation to safely span the gap between the lift tool and the cabinet
mounting position.
11. Move the assembled lift tool and retention straps near the equipment to be
installed.
Figure 4. Assembled lift tool with 24-inch load plate
Unpacking the SAN384B
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It
takes specially trained persons with a lifting device to safely lift
this part or unit. (C011)
55 kg ( 121.2 lbs)
To unpack the SAN384B, follow these steps:
16 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
1. If the product needs to be transported a long distance, or if there are uneven
floors to cross, keep the product in its original packaging, and relocate the
entire shipment close to the installation location, using a pallet jack to lift and
move it.
Note: The standard packaging does not incorporate a wood pallet and pallet
brackets. The chassis sits on top of a plastic shipping tray.
2. Once the shipment is in a location close to the installation, cut the bands that
encircle the packaging.
3. Lift the cardboard box off the chassis. Installation kits are packed within this
outer carton, so you may need to open the top of the box to remove the kits
or to press down on them as you lift the outer carton. Save the packing
materials if you are returning an old chassis.
4. Remove the port side exhaust kit, hardware accessory kit, chassis door, cable
management finger assemblies, and foam from the top of the chassis. Remove
the loose foam blocks from the corners of the chassis. Remove the anti-static
plastic from the chassis.
5. Place the kits and other installation pieces near the installation.
6. Move the lift tool next to the plastic shipping tray at the blower and power
supply end of the chassis. Position the lift tool with its left side next to the
shipping tray (see Figure 5).
Figure 5. Lift tool positioned next to the chassis on the shipping tray
7. Using the lift tool winch mechanism, adjust the height of top of the load plate
to slightly below the bottom surface of the chassis.
8. Set the lift tool brake.
9. Carefully slide the chassis across the foam blocking in the shipping tray and
onto the center of the load plate. Do not use any of the handles on the
blowers or power supplies to move the chassis.
Chapter 2. Installing a SAN384B in a cabinet 17
Download from Www.Somanuals.com. All Manuals Search And Download.
10. Attach the lift tool retention straps to secure the chassis to the load plate. This
is particularly important if you will be moving the chassis across any uneven
floor, or will be raising the chassis more than 45 cm (18 inches).
11. For safety considerations during moving, lower the load platform to its lowest
position.
12. Release the lift tool brake, and carefully move the chassis near the cabinet for
installation.
Installing the port-side exhaust kit
Complete the following instructions to install the port-side exhaust kit in a
2109-C36 cabinet before installing the SAN384B chassis.
Exhaust kit parts list
Table 5. Parts list for port-side exhaust kit for C36 cabinets
Item
A
Description
Top rail
Duct
Quantity
1
B
1
C
Shelf
1
D
10-32 x .5 in. (1.27 cm)
Phillips screw (blue Loctite
on threads)
12
E
F
10-32 x .63 in.(1.60 cm)
Phillips screw with square
cone washer
12
8
10-32 clip nut for cabinets
that have rails with round
holes
G
H
I
10-32 retainer nut for
cabinets that have rails with
square holes
8
Alignment washer for
cabinets that have rails with
square holes
12
2
6-32 x .25 in. (.635 cm)
Phillips screw
18 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
I-3
I-2
I-4
I-5
I-6
I-1
I-7
C
Port Side
(Exhaust)
D
E
F
10-32 Clip Nut
10-32 x .5"
10-32 x .63"
G
H
I
6-32 x .25"
10-32 Retainer Nut
Alignment Washer
Figure 6. Port-side exhaust kit assembly for 27 to 31 in. (68.58 to 78.74 cm) cabinets
Chapter 2. Installing a SAN384B in a cabinet 19
Download from Www.Somanuals.com. All Manuals Search And Download.
Torque requirements
Use the following torque settings when tightening screws that secure the port-side
exhaust kit and SAN384B to the equipment cabinet.
Table 6. Torque requirements for mounting screws
Screw size
Torque
6-32 x .25 in. (.635 cm) Phillips screw
10-32 x .63 in.(1.60 cm) Phillips screw
8.75 in.-lbs (10 cm-kg)
32 in.-lbs (36.86 cm-kg)
Installing the exhaust kit hardware
1. Remove the rear door (exhaust side) from the C36 cabinet. Set the door aside,
away from the installation.
2. The exhaust side of the port side exhaust kit will be installed facing the rear of
the C36 cabinet, and the port side of the SAN384B chassis will also face this
direction.
retainer nuts in the front vertical cabinet rails. Eight clip nuts and retainer nuts
are provided with the exhaust kit, and six are provided with the hardware
accessory kit. Install the lower two nuts at the same relative locations on all
four cabinet vertical rails, to provide a level mounting of the shelf. The fourteen
nuts will secure the eight 10-32 screws that mount the port side exhaust kit
SAN384B chassis to the cabinet (positions 25, 28, and 30 in Figure 7 on page
Note: For rails with round holes, use clip nuts. For rails with square holes, use
positions for these nuts in the cabinet rails to mount the shelf and
chassis. You can mount the shelf and chassis in 9 U of cabinet space
higher or lower in the cabinet than shown.
Note: Screws, clip nuts, and retainer nuts for attaching the SAN384B to the
cabinet are provided in the SAN384B hardware accessory kit.
20 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
clip nut attachment
for round-hole rails
Setup for Rails
with Square Holes
31
30
29
31
30
29
retainer nut
(Item G)
clip or retainer
nut locations
for chassis
Rail
28
27
26
25
24
23
28
27
26
25
24
23
rail
clip or retainer
nut locations
for shelf
Figure 7. Clip and retainer nut locations on exhaust side cabinet rails (example showing
relative positions)
a. The shelf can be adjusted to a length of between 27 and 31 inches (68.58
and 78.74 cm) to match the cabinet size. To lengthen or shorten the shelf,
loosen by approximately 1/2 turn the four 6-32 screws in the four slots on
desired length.
Note: We recommend two people for the installation of the shelf, one at
either end of the cabinet to support and align it correctly while
attaching it to the cabinet.
b. Tilt the shelf at an angle to fit it between the rails, and then position it
horizontally and level with the shelf mounting tabs on the outside of the
cabinet vertical rails, and aligned with the clip nuts you installed earlier.
c. Secure the shelf to the cabinet with eight 10-32 screws with washers (E in
Chapter 2. Installing a SAN384B in a cabinet 21
Download from Www.Somanuals.com. All Manuals Search And Download.
Port Side
(Exhaust)
384b034
Figure 8. Shelf installed in cabinet
d. Tighten the four 6-32 screws on the top of the shelf, which were loosened
to adjust the shelf length.
the duct align and engage with the slots in the shelf, with the open side of the
duct facing towards the center of the cabinet.
384b036
Figure 9. Air duct installed into side slot in shelf
a. The top-rail assembly can be adjusted to a length of between 27 and 31
inches (68.58 to 78.74 cm) to fit on the inside of the cabinet rails. To lengthen
or shorten the top-rail assembly, loosen, by approximately 1/2 turn, the two
22 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
the desired length. The length will be approximately the length of the
adjustable shelf.
b. Insert the top-rail assembly down into the air-duct assembly and then
secure the top-rail assembly to the air-duct assembly with two 6-32 screws,
one screw on each side of the air-duct assembly (I-1 and I-2 in Figure 6 on
7. Secure the top-rail assembly to the cabinet with four 10-32 screws, two screws
on each end of the top-rail assembly (see Figure 10).
384b037
Figure 10. Installing the top rail assembly to the duct assembly and cabinet rails
a. For rails with round holes:
of the top rail assembly. Tighten screws according to specifications under
b. For rails with square holes:
each end of the top rail assembly. Tighten screws according to specifications
step 6a to adjust the top rail length.
Chapter 2. Installing a SAN384B in a cabinet 23
Download from Www.Somanuals.com. All Manuals Search And Download.
Installing the SAN384B into the cabinet
CAUTION:
A fully populated SAN384B weighs approximately 68 kg (150 lb) and
requires a minimum of two people and a lift tool to install it. (C011)
55 kg ( 121.2 lbs)
Now that the port-side exhaust kit is securely installed, the SAN384B chassis can
be safely installed into the C36 cabinet. Perform the following steps to install the
chassis.
Note: The cabinet should already be fully installed, with leveling legs lowered to
prevent it from moving during the chassis installation.
1. Move the lift tool to a position as close as possible to the rear of the cabinet.
Position the lift tool so that the blower assemblies are facing towards the
inside of the cabinet and the port side of the chassis facing away from the
cabinet (see Figure 11).
Figure 11. Lift tool and chassis positioned at rear of cabinet
2. Set the wheel brake by pressing down on the wheel brake pedal.
3. Remove the lift tool retention straps from the chassis and the lift tool.
4. Carefully center the chassis over the middle section of the lift tool load plate.
5. Turn the lift tool winch handle clockwise to raise the load plate and chassis to
approximately 2 cm (3/4 in.) above the height of the port side exhaust kit
shelf.
6. Rotate the winch handle 1/4 turn counter clockwise to lock the winch.
24 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
7. Release the two spring-loaded pins on the under side of the load plate and
slide the middle section as far as possible into the cabinet until it stops. The
chassis should not move with the middle section.
Note: If the chassis is not carefully centered over the middle section, the
weight of the chassis may prevent the middle section from sliding.
Adjust the alignment if needed.
8. Release the spring-loaded pin closest to the cabinet one more time, and slide
the middle section to its full extension. Make sure the spring-loaded pin snaps
back into place. The gap between the end of the load plate middle section and
the port side exhaust kit shelf should be no more than 2.5 cm (1 in.). If the
gap is larger than this, either the lift tool is not positioned close enough to the
cabinet, or the load plate middle section is not fully extended. Adjust as
section of the lift tool load plate extended, and the chassis centered on the
load plate.
Figure 12. Load plate extended inside the cabinet to the exhaust kit shelf
9. Carefully slide the chassis into the cabinet between the shelf and the upper
edge of the exhaust kit duct assembly until the chassis rests securely on the
middle of the load plate fully extended and the chassis pushed approximately
half way into the cabinet. Reposition the nut clips installed earlier if necessary.
Push the chassis all the way into the cabinet until the flanges on the port side
of the chassis are firmly against the cabinet vertical rails.
Note: If necessary, adjust the height of the load plate to allow a smooth
transfer of the chassis from the extended load plate to the top of the
shelf.
Chapter 2. Installing a SAN384B in a cabinet 25
Download from Www.Somanuals.com. All Manuals Search And Download.
Figure 13. Chassis half way into cabinet on load plate
on the rails for securing the 10-32 screws. For rails with square holes,
10. Release the spring-loaded pins under the load plate, and slide the middle
section of the load plate back into load plate.
11. Lower the lift plate to its lowest position, release the wheel brake on the lift
tool, and move the lift tool away from the cabinet.
12. If necessary, adjust the rubber strips on the exhaust kit duct to ensure a good
seal against the chassis.
13. The chassis will be secured to the cabinet with six 10-32 screws with washers
cable management finger assemblies. Do not install the screws until you
determine the position of the cable management fingers.
Note: Screws, clip nuts, and retainer nuts to secure the chassis to the cabinet
are provided in the SAN384B hardware accessory kit.
26 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Install screws
Install screws
Figure 14. Location of screws to attach the chassis to the cabinet rails
14. Attach the two cable management finger assemblies to the cabinet vertical
rails, using two screws each. The two assemblies are identical and can be
installed on either side. The screws will extend through the chassis flange
used to attach the chassis to the cabinet rails, and into the clip nuts you have
installed. Select the holes on the cable management assemblies that match two
of the holes on the chassis flange. You will be able to position the cable
management finger assemblies either towards the top of the chassis or
towards the bottom of the chassis, depending on your requirements for
routing cables. The third screw for each side is used to secure the chassis to
the rails, directly through the chassis flange into the clip nuts. These screws
do not attach the cable management assemblies to the chassis or rack.
Figure 15 on page 28 shows the cable management fingers positioned towards
the top of the chassis.
Chapter 2. Installing a SAN384B in a cabinet 27
Download from Www.Somanuals.com. All Manuals Search And Download.
Figure 15. Attaching the vertical cable management finger assemblies to the cabinet rails
15. Disassemble and pack the lift tool into the shipping crate. Follow the return
instructions provided.
Note: For turning on the power and for the configuration instructions, see
Attention: Do not connect the SAN384B to the network until the IP addresses are
correctly set.
Port numbering
Table 7. Port blades available on the SAN384B
Blade label
FC8-16
IBM blade name
Feature code
3816
16 port 8Gb Switch Blade
32 port 8Gb Switch Blade
48 port 8Gb Switch Blade
64 port 8Gb Switch Blade
10Gb Fibre Channel Blade
FC Routing Blade
FC8-32
3832
FC8-48
3848
|
FC8-64
3864
FC10-6
3870
FR4-18i
3850
28 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 7. Port blades available on the SAN384B (continued)
Blade label
FX8-24
IBM blade name
Feature code
3890
FCIP extension blade
FCoE10-24
Fibre Channel over Ethernet blade
3880
The SAN384B uses the following port numbering for each of the blades that can be
installed in the chassis. See illustrations of the different blades in Appendix D,
with 8 Gbps Directors and Switches, (an IBM Redbook), SG24-6116 for more details
on port numbering and other technical information.
|
|
|
|
Note: Blades are installed in a horizontal orientation in the SAN384B chassis, so
the normal top of the blade is oriented to the left, and the normal bottom of
the blade is oriented to the right when the blades are installed in the chassis.
v FC8-16 port blade - Ports are numbered from 0 through 15 from right to left.
v FC8-32 port blade - Ports are numbered from 0 through 15 from right to left on
the lower row of ports and 16 through 31 from right to left on the upper row of
ports.
v FC8-48 port blade - Ports are numbered from 0 through 23 from right to left on
the lower row of ports and 24 through 47 from right to left on the upper row of
ports.
|
|
|
|
|
v FC8-64 port blade - Ports are numbered from 0 through 31 from right to left on
the lower row of ports and 32 through 63 from right to left on the upper row of
are permitted with up to eight ports per group. Trunking groups are as follows:
0-7, 8-15, 16-23, 24-31, 32-39, 40-47, 48-55, and 56-63.
v FC10-6 port blade - Ports are numbered from 0 through 5 from right to left.
v FR4-18i router blade - The 16 physical Fibre Channel ports are numbered from 0
through 15 from right to left. The two GbE ports, numbered GE0 and GE1, are
located to the right of the Fibre Channel ports. These ports, when fully
configured, enable 16 VE_ports or VEX_ports and appear in the switchShow
command as ports 16 through 31.
v FX8-24 FCIP extension blade - The port numbering scheme is fairly complex for
this blade, but is displayed for reference on the blade itself in a diagram towards
physical ports. Twelve FC ports are located towards the right end of the blade,
with ports 0 through 5 in the lower row, and ports 6 through 11 in the upper
row. Two 10 Gigabit Ethernet (10GbE or XGE) ports are located in the lower row
of ports and are numbered 0 and 1, from right to left. Ten GbE ports are located
towards the left end of the blade, with eight clustered to the far left, and the
remaining two located above the two 10GbE ports. The GbE ports 0 through 3,
numbered from right to left are located in the lower row to the far left side of
the blade. Ports 4 and 5 are located above the two 10GbE ports, and ports 6
through 9 (numbered right to left) are in the top row above ports 0 through 3.
Up to three FC trunking groups. The three groups are defined as:
|
|
|
|
|
– Trunk group 0: FC ports 0, 1
– Trunk group 1: FC ports 6, 7
– Trunk group 2: FC ports 2, 3, 4, 5, 8, 9, 10, 11
–
Chapter 2. Installing a SAN384B in a cabinet 29
Download from Www.Somanuals.com. All Manuals Search And Download.
v FCoE10-24 FC over Ethernet blade - The 24 physical ports are numbered 0
through 11 from right to left on the lower row of ports and 12 through 23 from
right to left on the upper row of ports.
| Chassis slots
|
|
|
|
|
Slots are numbered 1 through 8, from bottom to top of the chassis when facing the
port side of the SAN384B. Control processor blades (CP8) can be installed only in
slots 4 and 5. Core switch blades (CR4S-8) can be installed only in slots 3 and 6.
Port blades can be installed only in slots 1, 2, 7, and 8. Unused slots must be filled
with blade filler panels to maintain adequate cooling.
|
|
|
|
|
|
blades. Also refer to the IBM Redbook, Implementing an IBM/Brocade SAN with 8
Gbps Directors and Switches, SG24-6116, for more comprehensive information on
port numbering and area port numbering, and other technical information. This
publication number.
Cable organization
Two vertical cable management finger assemblies (shown in Figure 32 on page 63)
are attached to the rack vertical rails. They are not attached directly to the
SAN384B chassis. This pair of cable management finger assemblies can be used to
keep the cables from hanging down in front of other blades, and to route them
away from the exhaust vent of the port-side exhaust kit, which is located below
the SAN384B chassis.
|
|
|
Route the cables across in front of the blades, keeping the LEDs visible. Leave at
least one meter of slack for each fiber optic cable to provide room to remove and
replace blades.
|
|
Attention: Do not route the cables in front of the air exhaust vents, located at the
top and bottom of the port side of the chassis.
|
|
|
|
|
|
|
|
|
|
|
The FC8-64 high density port blade cannot use the standard LC cables because the
pitch between optics in the new mSFP transceiver is smaller than in standard SFPs.
Patch cables and panels can be used to attach standard size cabling to the blade if
are used only with the FC8-64 port blade. Narrower OM-3 LC cables are used to
connect the FC8-64. These cables are offered by several major manufacturers.
Contact your IBM representative for options regarding different cable and patch
panel configurations to simplify cable management with higher density FC8-64
port blades.
4
2
3
1
|
|
|
Figure 16. Cable design for the mSFP patch cables for the FC8-64 high density port blade
30 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
ꢀ1ꢁ
ꢀ2ꢁ
mini-SFP connector
Duplex clip (black)
ꢀ3ꢁ
ꢀ4ꢁ
1.6 mm cable
SFP connector
|
|
|
|
|
Note that the duplex clip on the mSFP end of the cable is black for easier
cables for the FC8-64 port blade.
If ISL Trunking is in use, group the cables by trunking group. The ports are
color-coded to indicate which ports can be used in the same ISL Trunking group:
eight ports marked with solid black ovals alternate with eight ports marked with
oval outlines.
|
|
|
|
Optional inter-chassis link cables (ICL) can also be installed between two or three
for instructions on installing these cables.
Chapter 2. Installing a SAN384B in a cabinet 31
Download from Www.Somanuals.com. All Manuals Search And Download.
32 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 3. Starting and configuring the SAN384B
Attention: Refer to the latest Fabric OS Release Notes or Interoperability Matrix
for information regarding Fabric OS compatibility. This is particularly important
for fabrics with 1-Gbps switches using earlier Fabric OS versions. To access the
appropriate matrix:
v Select the SAN384B product link
v On the SAN384B product page, click the Interoperability Matrix link.
The SAN384B must be configured before it is connected to the fabric, and all of the
configuration commands must be entered through the active CP blade. The
SAN384B configuration includes the following parameters:
v IP address and subnet mask for the SAN384B
v IP addresses, host names, subnet masks, and gateway addresses for both CP
blades
v Switch name
v Domain ID (optional)
v WWN (optional)
Note: The SAN384B WWN is initially set by the factory to match the license ID
(which is based on the chassis serial number). The WWN can be changed,
but the license ID cannot be modified.
The configuration information is mirrored to the standby CP blade, which allows
the most current configuration to remain available even if the active CP blade fails.
The configuration information for the SAN384B is stored in the WWN cards and
the flash memory of the CP blades. The configuration can be backed up to a
workstation (uploaded) and then downloaded to the active CP blade if necessary.
Figure 17 on page 34 provides an overview of the sequence of tasks to configure
the SAN384B.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
33
Configuration Tasks
Connect Serial Cable
between Switch and Host
Log In to Serial Console Port
Set IP Address
Log off Serial Console Port
and Disconnect Serial Cable
Connect Ethernet Cable
and Open Telnet Session
Set Domain ID
Set Date and Time
Install SFPs and
Attach Cables
Manage Cables
Verify Operation and
Back Up Configuration
Figure 17. Flow of configuration tasks for the SAN384B
The initial physical hardware installation continues with the following steps:
|
|
The following additional steps are customer responsibilities required for the initial
configuration:
|
|
34 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Providing power to the SAN384B
DANGER
An electrical outlet that is not correctly wired could place hazardous voltage
on the metal parts of the system or the devices that attach to the system. It is
the responsibility of the customer to ensure that the outlet is correctly wired
and grounded to prevent an electrical shock. (D004)
Attention: Use only the supplied power cords.
To provide power to the SAN384B:
1. Connect the two AC power cords to each of the two power supplies.
2. Connect the power cords to a power source with a voltage of 200 to 240 VAC,
47 to 63 Hz..
3. Turn the AC power switches on the power supplies to ON (|). The AC power
switches light green when switched on and power is supplied.
4. The SAN384B performs a power-on self-test (POST) each time it is powered on.
POST takes approximately 10 minutes and is complete when indicator light
activity displays the operational state. For information about LED patterns, see
You can bypass POST by using the fastBoot command. You can also disable
POST for successive reboots on the SAN384B using the diagDisablePost
command.
Attention: To prevent a potential IP address conflict, do not connect the
SAN384B to the network until the IP addresses are configured.
Connecting the SAN384B and host with a serial cable
Follow these steps to connect a serial cable.
1. Verify that the SAN384B is powered on and that POST is complete by
confirming that all power LED indicators on the port, control processor, and
core switch blades display a steady green light.
2. Remove the shipping cap from the CONSOLE port on the active CP. Use the
serial cable provided with the product to connect the CONSOLE port on the
active CP to a computer workstation. The active CP blade is indicated by an
illuminated (blue) LED.
Attention: The CONSOLE port is intended primarily for the initial setting of
the IP address and for service purposes.
3. Access the SAN384B using a terminal emulator application (such as
HyperTerminal in a Windows environment or TIP in a UNIX environment).
4. Disable any serial communication programs running on the workstation (such
as synchronization programs).
Chapter 3. Starting and configuring the SAN384B 35
Download from Www.Somanuals.com. All Manuals Search And Download.
5. Open the terminal emulator application and configure as follows:
v In a Windows environment:
Table 8. Configuration parameters
Parameter
Bits per second
Data bits
Value
9600
8
Parity
None
1
Stop bits
Flow control
None
v In a UNIX® environment, enter the string at the prompt:
term /dev/ttyb -9600
If ttyb is already in use, use ttya instead and enter the following string at the
prompt:
term /dev/ttya -9600
Logging in to the serial console port
To log in to the SAN384B through the serial connection, follow these steps.
1. When the terminal emulator application stops reporting information, press
Enter. You will receive the following login prompt: CP0 Console Login:
2. Log in to the SAN384B as admin. The default password is "password." At the
initial login, you are prompted to change the default passwords. Record the
new passwords and keep this information in a secure location. The example
below shows the login without changing the password.
swDir login: admin
Password:
Please change your passwords now.
Use Control-C to exit or press 'Enter' key to proceed.
Password was not changed. Will prompt again at next login
until password is changed.
swDir:admin>
3. (Optional) Modify passwords. To skip modifying the password, press Ctrl+C
.Passwords can be 8 to 40 characters long. They must begin with an alphabetic
character. They can include numeric characters, the dot (.), and the underscore
(_). Passwords are case-sensitive, and they are not displayed when you enter
them on the command line. For more information on passwords, refer to the
Fabric OS Administrator’s Guide.
Configuring the IP addresses
The SAN384B requires three IP addresses, which are configured using the
ipAddrSet command. IP addresses are required for both CP blades (CP0 and CP1)
and for the single logical switch (shown as SWITCH under the ipAddrShow
command) in the
Note: The default IP addresses and host names for the SAN384B are as follows:
v 10.77.77.75 for CP0 (the CP blade in slot 4 at the time of configuration)
v 10.77.77.74 for CP1 (the CP blade in slot 5 at the time of configuration)
36 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Attention: Resetting an IP address while the SAN384B has active IP traffic such
as Fabric Manager, Fabric Watch, SNMP, or other applications can cause traffic to
be interrupted or stopped. Changing the IP address causes a domain address
format RSCN to be issued.
Follow these steps to configure the IP addresses for both CP blades (from the
active CP blade):
1. Log in to the active CP as admin using the serial cable connection.
2. Set up the SAN384B IP address by entering the ipaddrset -chassis command at
the prompt.
swDir:admin> ipAddrSet -chassis
Enter the information at the prompts. Specify the -chassis IP address. The -sw
0 IP address is no longer valid on this chassis.
Note: The addresses 10.0.0.0 through 10.0.0.255 are reserved and used
internally by the SAN384B. External IPs must not use these addresses.
3. Set up the CP0 blade IP address by entering the ipaddrset -cp 0 command at
the prompt.
swDir:admin> ipAddrSet -cp 0
Enter the requested information at the prompts.
4. Set up the CP1 IP address by entering the ipaddrset -cp 1
command:swDir:admin> ipAddrSet -cp 1
Enter the requested information at the prompts.
The following is a sample IP configuration, for the SAN384B (sw -0) and the
two CP blades (cp0 and cp1):
swDir:admin> ipaddrset -chassis
Ethernet IP Address [0.0.0.0]: 123.123.123.120
Ethernet Subnetmask [0.0.0.0]: 123.123.123.123
Fibre Channel IP Address [0.0.0.0]:
Fibre Channel Subnetmask [0.0.0.0]:
Issuing gratuitous ARP...Done.
Committing configuration...Done.
swDir:admin> ipaddrset -cp 0
Host Name [cp0]:
Ethernet IP Address [10.77.77.75]: 123.123.123.121
Ethernet Subnetmask [0.0.0.0]: 123.123.123.123
Gateway IP Address [0.0.0.0]: 123.123.123.124
IP address is being changed...Done.
Committing configuration...Done.
swDir:admin> ipaddrset -cp 1
Host Name [cp1]:
Ethernet IP Address [10.77.77.74]: 123.123.123.122
Ethernet Subnetmask [0.0.0.0]: 123.123.123.123
Gateway IP Address [0.0.0.0]: 123.123.123.124
IP address of remote CP is being changed...Done.
Committing configuration...Done.
swDir:admin> reboot
5. Enter reboot to reboot the SAN384B.
Logging off the serial console port and disconnecting the
serial cable
You can use the serial port to monitor error messages through the serial
connection, however it is generally used for initial configuration and service
Chapter 3. Starting and configuring the SAN384B 37
Download from Www.Somanuals.com. All Manuals Search And Download.
purposes. If the serial port is no longer required, use the logout command to log
out of the serial console, remove the serial cable, and replace the plug in the serial
port.
Establishing an Ethernet connection
After using a serial connection to configure the IP addresses for the SAN384B, you
can connect the active CP blade to the local area network (LAN).
Note: Connecting the CP blades to a private network/VLAN is recommended.
By establishing an Ethernet connection, you can complete the SAN384B
configuration using a serial session, Telnet , or through a management application
such as Web Tools or DCFM.
To establish an Ethernet connection to the SAN384B, follow these steps:
1. Remove the shipping plug from the Ethernet port on the active CP blade.
2. Insert one end of an Ethernet cable into the Ethernet port.
3. Connect the other end to an Ethernet 10/100/1000 BaseT LAN.
The SAN384B can now be accessed by remote connection using any of the
available management tools, such as Telnet, Web Tools, or DCFM.
4. To complete any additional SAN384B configuration procedures through a
Telnet session, log in to the SAN384B by Telnet, using the admin login. The
default password is password.
Customizing the switch name
|
|
The switch name of the SAN384B can be up to 30 characters long as of Fabric OS
release 6.3.0; can include letters, numbers, and underscore characters; and must
begin with a letter. Fabric OS releases earlier than 6.3.0 require switch names of 15
characters or less.
Note: Changing the name causes a domain address format RSCN to be issued.
To customize the name, follow these steps:
1. Enter the switchName command with the new name in quotes.
swDir:admin> switchName "ModularSwitch5"
Committing configuration...
Done.
ModularSwitch5:admin
2. Record the new name for future reference.
Customizing a chassis name
For Fabric OS 6.2.0 and later, the chassis name of the SAN384B can be up to 15
characters long; can include alpha, numeric, and underscore characters; and must
begin with an alpha character.
1. Enter chassisName followed by the new name in double quotes.
switch:admin> chassisname "SAN384B_chassis_1"
Committing configuration...
Done.
2. 2. Display the new chassis name.
38 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
switch:admin> chassisname SAN384B_chassis_1
3. Record the new name for reference.
Setting the Domain ID
Each switch in the fabric must have a unique Domain ID. The Domain ID can be
set using the configure command or can be automatically set. The default Domain
ID for the SAN384B is "1". Use the fabricShow command to view the already
assigned domain IDs.
To set the Domain ID, follow these steps:
1. Enter the switchDisable command to disable the SAN384B.
2. Enter the configure command.
3. Enter y at the "Fabric parameters" prompt:
Fabric parameters (yes, y, no, n): [no] y
4. Enter a unique Domain ID:
Domain: (1.239) [1] 3
5. Complete the remaining prompts or press Ctrl+D to accept the settings and to
exit.
6. Enter the switchEnable command to re-enable the SAN384B.
Setting the date and time
The date and time settings are used for logging events. Switch operation does not
depend on the date and time; a switch with an incorrect date and time value still
functions properly. However, because the date and time are used for logging, error
detection, and troubleshooting, they should be set correctly.
Setting the date
To set the date, follow these steps.
1. If necessary, log on to the SAN384B by Telnet, using the admin account.
2. Enter the date command, using the following syntax:date "mmddHHMMyy"
Where:
v mm is the month; valid values are 01 through 12.
v dd is the date; valid values are 01 through 31.
v HH is the hour; valid values are 00 through 23
v MM is minutes; valid values are 00 through 59.
v yy is the year; valid values are 00 through 99 (values greater than 69 are
interpreted as 1970 through 1999, and values less than 70 are interpreted as
2000-2069).
switch:admin> date
Fri Sep 26 17:01:48 UTC 2008
switch:admin> date "0926123008"
Fri Sep 26 12:30:00 UTC 2008
switch:admin>
Setting the time zone
To set the time zone, follow these steps.
1. If necessary, log on to the switch by Telnet, using the admin account.
Chapter 3. Starting and configuring the SAN384B 39
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Enter the tsTimeZone command as follows:
switch:admin> tstimezone [--interactive]/ [, timezone_fmt]
Use timezone_fmt to set the time zone by Country/City or by time zone ID,
such as MST.
The following example shows how to change the time zone to US/Mountain.
switch:admin> tstimezone
Time Zone : US/Pacific
switch:admin> tstimezone US/Mountain
switch:admin> tstimezone
Time Zone : US/Mountain
The following procedure describes how to set the current time zone using
interactive mode.
1. Enter the tsTimeZone command as follows:
switch:admin> tstimezone --interactive
You are prompted to select a general location.
Please identify a location so that time zone rules can be set correctly.
2. Enter the appropriate number or Ctrl+D to quit.
3. At the prompt, select a country location.
4. At the prompt, enter the appropriate number to specify the time zone region or
Ctrl+D to quit.
Synchronizing local time
To synchronize the local time of the principal or primary switch with that of an
external NTP server, follow these steps.
1. If necessary, log on to the switch by Telnet, using the admin account.
2. switch:admin> tsclockserver "<ntp1;ntp2>"
where ntp1 is the IP address or DNS name of the first NTP server, which the
switch must be able to access. The variable ntp2 is the second NTP server and
is optional. The operand "<ntp1;ntp2>" is optional; by default, this value is
LOCL, which uses the local clock of the principal or primary switch as the
clock server.
The tsClockServer command accepts multiple server addresses in either IPv4,
IPv6, or DNS name formats. When multiple NTP server addresses are passed,
tsclockserver sets the first obtainable address as the active NTP server. The rest
will be stored as backup servers that can take over if the active NTP server
fails. The principal or primary FCS switch synchronizes its time with the NTP
server every 64 seconds.
switch:admin> tsclockserverLOCL
switch:admin> tsclockserver "132.163.135.131"
switch:admin> tsclockserver
132.163.135.131
switch:admin>
The following example shows how to set up more than one NTP server using a
DNS name:
switch:admin> tsclockserver "10.32.170.1;10.32.170.2;ntp.localdomain.net"
Updating Clock Server configuration...done.
Updated with the NTP servers
Changes to the clock server value on the principal or primary FCS switch are
propagated to all switches in the fabric
40 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
| Verifying the PID mode and connecting to the fabric
|
|
To verify PID mode, connect the system to the fabric and verify status, follow these
steps:
|
|
|
|
|
1. Before connecting the SAN384B to the fabric, verify that the port identifier
(PID) mode on the SAN384B matches the other switches in the fabric. This
parameter must be set identically on all switches in the fabric. This parameter
is set using the configure command. For information on PID mode, refer to the
Fabric OS Administrator's Guide.
|
|
2. Verify the chassis and port status by entering the switchShow command. This
command provides detailed information about the SAN384B.
|
|
3. Verify fabric connectivity by entering the fabricShow command. This command
provides general information about the fabric.
Software licenses
Certain licenses may be factory installed on the SAN384B. To determine which
licenses are currently enabled, use the licenseShow command.
swDir:admin> licenseshow
AAbbccDDeeFFeeGG:
Web license
Zoning license
Extended Fabric license
Fabric Watch license
Performance Monitor license
Trunking license
Security license
In the example above, the license key is AAbbccDDeeFFeeGG. Keep a copy of the
license key for reference.
The 64-bit chassis ID is required to obtain and activate licenses for the SAN384B.
The chassis ID is available through the licenseIdShow command.
The licenseShow and licenseIdShow commands must be entered on the active CP
blade.
Refer to the Fabric OS Administrator's Guide for more information.
| Installing transceivers and attaching cables
|
|
Follow these steps to install SFPs, SFP+s, mSFPs (FC8-64 port blade only), or XFPs
(FC10-6 port blade only) and cables to the blades and chassis.
|
|
|
|
|
Note: For a listing of transceivers compatible with this product:
v Select the SAN384B product link
v On the SAN384B product page, click the Interoperability Matrix link.
v In the Interoperability matrix, click the Transceivers link.
|
|
|
Attention: mSFP transceivers are compatible only with the FC8-64 port blade.
While they will fit in other blades, this configuration is unsupported and will
generate an error.
Chapter 3. Starting and configuring the SAN384B 41
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
|
|
The ports are color-coded to indicate which can be used in the same port group for
trunking (trunking port groups can be up to eight ports). The ports and cables
used in trunking groups must meet specific requirements. Refer to the Fabric OS
Administrator’s Guide for more information.
|
|
|
1. Position one of the optical transceivers so that the key is oriented correctly to
the port. Insert the transceiver into the port until it is firmly seated and the
latching mechanism clicks.
|
|
|
Transceivers are keyed so that they can only be inserted with the correct
orientation. If a transceiver does not slide in easily, ensure that it is correctly
oriented.
|
|
|
2. Position a cable so that the key (the ridge on one side of the cable connector) is
aligned with the slot in the transceiver; then, insert the cable into the
transceiver until the latching mechanism clicks.
|
|
Cables are keyed so that they can only be inserted with the correct orientation.
If a cable does not slide in easily, ensure that it is correctly oriented.
|
3. Repeat steps 1 and 2 for the remaining ports.
|
|
4. Organize the cables as required. For recommendations regarding cable
management, refer to “Managing cables.”
|
|
5. Verify the chassis and port status using the switchShow command.
6. Verify fabric connectivity using the fabricShow command.
| Managing cables
|
|
Attention: The minimum bend radius should be no smaller than 10x the cable
radius.
|
|
|
Note: Contact your IBM representative for options regarding different cable and
patch panel configurations to simplify cable management with higher
density FC8-64 port blades.
|
Cable management recommendations:
|
|
|
|
v Leave at least 1 m (3.28 ft) of slack for each port cable. This provides room to
remove and replace blades in the chassis, allows for inadvertent movement of
the rack, and helps prevent the cables from being bent to less than the minimum
bend radius.
|
|
|
|
v If ISL Trunking is in use, group the cables by trunking group. The ports are
color-coded to indicate which ports can be used in the same ISL Trunking group:
eight ports marked with solid black ovals alternate with eight ports marked with
oval outlines.
|
|
v Use only hook-and-loop fasteners for securing cables. Do not use cable ties. They
can be easily overtightened and can break the optical cables.
|
|
v For easier maintenance, label the fiber optic cables and record the devices to
which they are connected.
|
|
v Use the cable management fingers attached to the rack rails to organize the
cables off to the side of the chassis, and away from the chassis exhaust vents.
|
v Keep LEDs visible by routing port cables and other cables away from the LEDs.
|
|
For the procedure to install the ICL cables see “Removing and installing
42 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Verifying correct operation and backing up the configuration
To verify correct operation and to back up the system, follow these steps.
1. Check the LEDs to verify that all components are functional. For information
about LED patterns, see Chapter 4, “Monitoring system components,” on page
2. If necessary, log on to the switch by Telnet, using the admin account.
3. Verify the correct operation of the system by entering the switchShow
command from the workstation. This command provides information about
switch and port status.
4. Verify the correct operation of the SAN384B in the fabric by entering the
fabricShow command from the workstation. This command provides general
information about the fabric.
|
5. To back up the configuration, run the following two steps:
|
|
a. Enter the configupload -vf command. This command uploads the system
virtual fabric data.
|
|
b. Enter the configupload command. This command uploads the system
configuration.
|
|
6. Run the following commands to see additional configuration information that
you can then copy to a file to save:
v configShow
v ipAddrShow
v licenseShow
v switchShow
Note: Passwords are not saved in the configuration file, and are not uploaded
during a configUpload. Password information should be saved in hardcopy
in a secure location for reference, subject to your security and password
management policy.
Note: It is recommended that the configuration be backed up on a regular basis to
ensure that a complete configuration is available for downloading to a
replacement device.
Fabric OS firmware updates
To ensure optimum functioning of your system, IBM recommends operating your
system with the latest Fabric OS version and firmware updates. Refer to the latest
Fabric OS Release Notes and Interoperability Matrix for information regarding
Fabric OS compatibility. This is particularly important for fabrics with 1-Gbps
switches using earlier Fabric OS versions. Detailed information on downloading
and installing firmware are provided in the Fabric OS Administrator's Guide.
To access the appropriate matrix:
v Select the SAN384B product link
v On the SAN384B product page, click the Interoperability Matrix link.
Firmware release notes and download files are available through the IBM SAN
Support web pages.
To view release notes and to download firmware:
Chapter 3. Starting and configuring the SAN384B 43
Download from Www.Somanuals.com. All Manuals Search And Download.
v Select System Storage.
v On the next page that is displayed, select Download, and then select Storage
area network (SAN).
v Select your product, then in the Recommended fix section, select the
appropriate firmware version release notes. Review the release notes before
installing the firmware update.
v Select the firmware download version and follow the online prompts.
Downloading and installing firmware
1. The firmware version on both the active and backup CP blade should match,
and should be at the latest level. If High Availability is enabled (haEnable), the
system will automatically update the firmware level on both CP blades.
Attention: Firmware downloads require Ethernet connections to both CP
blades. Procedures for loading downloading and installing firmware are fully
described in the Fabric OS Administrator's Guide.
2. When you have navigated to the appropriate download site, follow the online
instructions on the displayed Fabric OS download pages, referring to the Fabric
OS Administrator's Guide as needed.
3. Enter firmwareDownload -s on your to download the firmware to one of the
CP blades from your server.
Powering off the SAN384B
If you need to power off the SAN384B, follow these steps to avoid loss of data.
1. Shut down the SAN384B using the sysShutdown command.
switch::admin> sysshutdown
This command will shutdown the operating systems on your switch.
You are required to power-cycle the switch in order to restore operation.
Are you sure you want to shutdown the switch [y/n]? y
HA is disabled
Stopping blade 1
Shutting down the blade....
Stopping blade 2
Shutting down the blade....
Stopping blade 8
Shutting down the blade....
Broadcast message from root (pts/1) Tue Aug 23 14:23:06 2008...
The system is going down for system halt NOW !!
2. Power off the chassis by flipping the AC power switches on the power supplies
to "O". The LEDs inside AC power switches should turn off. To maintain the
ground connections, leave the power cords connected to the power supplies
and to the electrical outlets.
44 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 4. Monitoring system components
The SAN384B is engineered for reliability and requires no routine operational steps
or maintenance. This chapter provides information about determining the status of
the following components using LEDs and CLI commands. Refer to the Fabric OS
Administrator's Guide and the Web Tools Administrator's Guide for more information
on monitoring component status.
Port or application blade status
To determine the status of a port or routing blade:
1. Check the LEDs on the blade. The illustrations show the blades oriented
horizontally, as they are installed in the SAN384B chassis.
|
blade
The LED patterns may temporarily change during POST and other diagnostic
2. Check the blade status by typing slotShow.
recommended actions for those patterns.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
45
1
2
3
4
Figure 18. FC8-16 port blade
ꢀ1ꢁ
ꢀ2ꢁ
Status LED
Power LED
ꢀ3ꢁ
ꢀ4ꢁ
Fibre Channel port
Port Status LED
3
4
1
2
Figure 19. FC8-32 port blade
ꢀ1ꢁ
ꢀ2ꢁ
Status LED
Power LED
ꢀ3ꢁ
ꢀ4ꢁ
Fibre Channel port
Port Status LED
46 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
3
4
1
2
Figure 20. FC8-48 port blade
ꢀ1ꢁ
ꢀ2ꢁ
StatusLED
ꢀ3ꢁ
ꢀ4ꢁ
Fibre Channel port
Port Status LED
Power LED
|
3
4
2
1
|
|
|
Figure 21. FC8-64 port blade
ꢀ1ꢁ
ꢀ2ꢁ
Status LED
Power LED
ꢀ3ꢁ
ꢀ4ꢁ
Fibre Channel port
Port Status LED
|
|
Note: The FC8-64 port blade requires narrower OM-3 LC cables offered by several
major manufacturers
Chapter 4. Monitoring system components 47
Download from Www.Somanuals.com. All Manuals Search And Download.
1
2
3
4
Figure 23. FR4-18i routing blade
ꢀ1ꢁ
ꢀ2ꢁ
Status LED
Power LED
ꢀ3ꢁ Fibre Channel Port
ꢀ4ꢁ Port Status LED
1
7
6
3
4
5
2
Figure 24. FX8-24 extension blade
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
Status LED
Power LED
ꢀ5ꢁ FC ports 0-5 (numbered right to left)
ꢀ6ꢁ FC ports 6-11 (numbered right to left)
ꢀ7ꢁ 1 GbE ports 4-9 (numbered right to left)
1 GbE ports 0-3 (numbered right
to left)
ꢀ4ꢁ
10 GbE ports 0-1 (numbered right
to left)
|
1
4
3
2
|
|
|
Figure 25. FCOE10-24 blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
Power LED
Status LED
CEE port 9
ꢀ4ꢁ Status LED for CEE port 9
ꢀ5ꢁ CEE port 19
|
|
ꢀ6ꢁ Status LED for CEE port 19
Chapter 4. Monitoring system components 49
Download from Www.Somanuals.com. All Manuals Search And Download.
|
50 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 9. Port and routing blade LED descriptions
LED purpose
Color
Status
Recommended Action
Power LED
Steady green
No light (LED is off)
Blade is enabled.
Blade is not powered on.
No action required.
Ensure that the blade is firmly
seated and either the
thumbscrew is fully engaged
or the slider is pushed up and
the ejectors are fully engaged.
Chapter 4. Monitoring system components 51
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 9. Port and routing blade LED descriptions (continued)
LED purpose
Color
Status
Recommended Action
Status LED FCPort Status
No light (LED is off)
Blade is either healthy or does Verify that the power LED is
not have power.
Blade is faulty.
on.
Steady amber
Ensure blade is firmly seated
and check the status with the
slotShow command.Blade may
not be compatible with other
blades in the chassis. See
|
|
|
|
|
129 for limitations. If the LED
remains amber, contact IBM.
Slow-flashing amber (on 2
seconds, then off 2 seconds)
Blade is not seated correctly or Pull blade out and reseat it. If
is faulty.
the LED continues to flash,
replace the blade.
Fast-flashing amber (on 1/2
second, then off 1/2 second)
Environmental range exceeded. Check for out-of-bounds
environmental condition and
correct it.
No light (LED is off)
Port has no incoming power,
or there is no light or signal
carrier detected.
Verify that the power LED is
on, check the transceiver and
cable.
Polling is in progress.
Allow 60 seconds for polling to
complete.
Connected device is configured Verify the status of the
in an offline state. connected device.
Steady green
Port is online (connected to an No action required.
external device) but has no
traffic.
Slow-flashing green (on 1
second, then off 1 second)
Port is online but segmented,
indicating a loopback plug or
cable or an incompatible
switch.
Verify that the correct device is
attached to the SAN384B.
Fast-flashing green (on 1/4
second, then off 1/4 second
Port is in internal loopback
(diagnostic).
No action required.
No action required.
Flickering green
Port is online, with traffic
flowing through port.
Steady amber
Port is receiving light or signal Reset the port from the
carrier, but it is not online yet. workstation using the
portEnable or
portCfgPersistentEnable
command.
Slow-flashing amber (on 2
seconds, then off 2 seconds)
Port is disabled due to
diagnostic tests or portDisable workstation using the
Reset the port from the
or portCfgPersistentEnable
portEnable or
command.
portCfgPersistentEnable
command.
Fast-flashing amber (on 1/2
second, then off 1/2 second)
Transceiver or port is faulty.
Port is bypassed
Change the transceiver or reset
the switch from the
workstation.
Alternating green/amber
Reset the port from the
workstation using the
portEnable or
portCfgPersistentEnable
command.
|
|
Green, amber, off (cycle is
about 1 second)
Beaconing initiated on the local No action required. Beaconing
switch.
used to locate/identify port.
|
|
Amber, amber, pause (cycle is
about 1 second)
Beaconing initiated on the
HBA and reflected on the port. used to locate/identify port.
No action required. Beaconing
52 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 9. Port and routing blade LED descriptions (continued)
LED purpose
Color
Status
Recommended Action
GbE Port Status (FX8-24) - both No light (LED is off)
GbE and 10 GbE ports
Port has no incoming power,
or there is no light or signal
carrier detected.
Verify that the power LED is
on, check the transceiver and
cable.
Steady green
Port is online but has no
traffic.
No action required.
No action required.
No action required.
Slow-flashing green (on 1
second, then off 1 second)
Beacon. Used to identify
specific ports.
Flickering green
Port is online, with traffic
flowing through port.
Fast-flashing amber (on 1/4
second, then off 1/4 second)
Transceiver or port is faulty.
Change the transceiver or reset
the switch from the
workstation.
10GbE Port Status (FCOE10-24) No light (LED is off)
Port is offline.
Verify that the power LED is
on, check the transceiver and
cable.
Steady green
Port is online but has no
traffic.
No action required.
Flickering green
Steady amber
Port is online, with traffic
flowing through port.
No action required.
Port is receiving light but it is
not online yet.
Reset the port by doing a
shutdown and no shutdown
sequence from a cmsh session.
Slow-flashing amber (on 2
seconds, then off 2 seconds)
Port is disabled.
Enable the port by using the
no shutdown command from a
cmsh session.
Fast-flashing amber (on 1/4
second, then off 1/4 second)
Transceiver or port is faulty.
Change the transceiver or reset
the port by doing a shutdown
and no shutdown sequence
from a cmsh session.
For more information on the CEE Management Shell (cmsh), see the Fabric OS
Command Reference Manual or the Converged Enhanced Ethernet Command Reference.
Control processor blade (CP8) status
To determine the status of a CP blade:
patterns may temporarily change during POST and other diagnostic tests. For
2. Check port blade status by typing slotShow and haShow.
Figure 26 on page 54 identifies the control processor blade (CP8).
Chapter 4. Monitoring system components 53
Download from Www.Somanuals.com. All Manuals Search And Download.
2
1
3
5
4
6
7
8
Figure 26. Control processor blade (CP8) LEDs
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
ꢀ4ꢁ
Status LED
Power LED
USB LED
USB port
ꢀ5ꢁ
ꢀ6ꢁ
ꢀ7ꢁ
ꢀ8ꢁ
Console port (IOIOI)
Ethernet port (MGMT)
Ethernet port (SERVICE)
Active CP LED
Table 10. CP blade LED descriptions
Recommended
LED purpose
Color
Status
Action
Power
Steady green
CP blade has is on.
No action required.
No light (LED is off) CP blade does not
on.
Ensure that the blade
is firmly seated and
has power.
Status
No light (LED is off) CP blade is either
healthy or does not
Verify that the power
LED is on.
have power.
Steady amber
CP blade is faulty or Ensure that the blade
the switch is still
booting.
is firmly seated and
the switch has
completed booting. If
the LED remains
amber, contact IBM.
Slow-flashing amber CP blade is not
Pull the blade out
(on 2 seconds; then
off 2 seconds)
seated correctly or is and reseat it. If the
faulty.
LED continues to
flash, replace blade.
Fast-flashing amber
Environmental range Check for
(on 1/2 second; then exceeded.
off 1/2 second)
out-of-bounds
environmental
condition and correct
it.
54 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 10. CP blade LED descriptions (continued)
LED purpose Color Status
Recommended
Action
Ethernet Link Status No light (LED is off) Either an Ethernet
Ensure that the blade
has power, the
Ethernet cable is
firmly seated, and
the connected device
is functioning.
link is not detected,
or it does not have
incoming power.
Flickering
Ethernet link is
No action required.
green/amber
healthy and traffic is
flowing through port.
Ethernet Link Speed No light (LED is off) Ethernet link speed is Ensure that the CP
10 Mbps or CP blade has power.
does not have
incoming power.
Note: To force a
persistent Ethernet
link speed, type the
ifModeSet
command.
Steady green
Steady blue
Ethernet link speed is No action required.
100/1000 Mbps.
Active CP
Active CP blade.
No action required.
No action required.
No light (LED is off) Standby CP blade.
Core switch blade (CR4S-8) status
To determine the status of a CR4S-8 core switch blade:
patterns may temporarily change during POST and other diagnostic tests; for
2. Check core switch blade status by entering slotShow and haShow.
Figure 27 shows the CR4S-8 core switch blade and its components.
2
5
3
4
1
Figure 27. Core switch blade (CR4S-8)
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
Status LED
Power LED
LINK LED
ꢀ4ꢁ
ꢀ5ꢁ
ATTN LED
ICL Connector
Chapter 4. Monitoring system components 55
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 11. CR4S-8 blade LED descriptions
Recommended
Action
LED purpose
Color
Status
Power
Steady green
CR4S-8 blade is on.
No action required.
No light (LED is off) CR4S-8 blade is not
on.
Ensure blade is
firmly seated and has
power.
Status
No light (LED is off) CR4S-8 is either
healthy or does not
Verify that the power
LED is on.
have power.
Steady amber
CR4S-8 blade is
faulty or the switch
is still booting.
Ensure that the blade
is firmly seated and
the switch has
completed booting. If
the LED remains
amber, contact IBM..
Slow-flashing amber CR4S-8 blade is not
Pull the blade out
(on 2 seconds; then
off 2 seconds)
seated correctly or is and reset it. If the
faulty.
LED continues to
flash, replace the
blade.
Fast-flashing amber
Environmental range Check for
(on 1/2 second; then exceeded.
off 1/2 second)
out-of-bounds
environmental
condition and correct
it.
LINK LED
ATTN LED
No light (LED is off) No ICL or ICL cable Ensure that the ICL
present, but no
connection.
cable is correctly
installed.
Steady green
ICL connected
No action required.
No action required.
No light (LED is off) ICL is operational
Blinking amber Attention required
Ensure that the ICL
cable is correctly
installed.
Power supply status
To determine the status of a power supply:
LED patterns may temporarily change during POST and other diagnostic tests;
2. Check the power supply status by entering psShow.
The power supply status displays OK, Absent, or Faulty. If a power supply is
absent or faulty, contact IBM.
56 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
1
Figure 28. Power supply
ꢀ1ꢁ Power LED
Table 12. Power supply LED descriptions
Recommended
Action
LED purpose
Color
Status
Power
No light (LED is off) Power supply does
not have incoming
Ensure that the
power supply is
firmly seated, the
SAN384B has
power and is not
providing power to
the SAN384B.
incoming power,
both power cables
are connected, and
AC power switches
are on.
Steady green
Power supply has
incoming power and
is providing power to
the SAN384B.
No action required.
Flashing green
Power supply is
about to fail.
Replace the power
supply.
Blower assembly status
To determine the status of a blower assembly:
The LED patterns may temporarily change during POST and other diagnostic
2. Check the blower assembly status using the fanShow command.
The status for each blower assembly displays OK, Absent, or Faulty. The RPM
of each fan in the assembly is also provided. If a blower assembly is absent or
faulty, contact IBM.
Chapter 4. Monitoring system components 57
Download from Www.Somanuals.com. All Manuals Search And Download.
1
2
Figure 29. Blower assembly LEDs
ꢀ1ꢁ Power LED
ꢀ2ꢁ Fault LED
Table 13. Blower assembly LED descriptions
Recommended
action
LED purpose
Color
Status
Power
No Light (LED is off) Blower assembly
Ensure that the
does not have power. blower assembly is
firmly seated and has
power.
Steady green
Blower assembly has No action required.
power.
Fault
No Light (LED is off) Blower assembly is
either healthy or
Ensure that the
blower assembly has
does not have power. power.
Steady amber
Blower assembly has Replace the blower
a failure (full or
partial).
assembly.
Slow-flashing amber Blower assembly is
Pull the unit out and
reseat it. If the LED
continues to flash,
replace the unit.
(on 2 sec, then off 2
sec)
not seated correctly
or is faulty.
Flashing amber (on
1/2 sec, then off 3.5
sec)
Fan is disabled.
Run fanEnable to
enable the fan.
Fast-flashing amber
Environmental range Check for
(on 1/2 sec, then off exceeded.
1/2 sec)
out-of-bounds
environmental
condition, resolve
any problems, and
reseat the unit. If the
LED continues to
flash, replace the
unit.
58 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
WWN card status
WWN cards are not visible unless the bezel is removed.
To determine the status of the WWN card, enter the chassisShow command to
display information about the WWN card. (WWN units correspond to information
specific to the WWN card.) Error messages that may indicate problems with a
Table 14. Messages that may indicate WWN card failure
Type of Message
Sample error message
WWN unit fails its FRU (field replaceable
unit) header access.
0x24c (fabos): Switch: switchname, error
EM-I2C_TIMEOUT, 2, WWN 1 I2C timed out:
state 0x4
WWN unit is being faulted.
0x24c (fabos): Switch: switchname,
Critical EM-WWN_UNKNOWN, 1, Unknown WWN
#2 is being faulted
WWN unit is not present or is not
accessible.
0x24c (fabos): Switch: switchname, Error
EM-WWN_ABSENT, 2, WWN #1 not present
Writing to the FRU history log
(hilSetFruHistory) has failed.
0x24c (fabos): Switch: switchname, Error
EM-HIL_FAIL, 2, HIL Error:
hilSetFruHistory failed, rc=-3 for SLOT
3
Figure 30 displays the WWN bezel. The WWN bezel must be removed to reveal
the WWN cards and LEDs. See “Removing and installing a WWN bezel and WWN
card” on page 78 for removal instructions.
Figure 30. WWN bezel
Chapter 4. Monitoring system components 59
Download from Www.Somanuals.com. All Manuals Search And Download.
60 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 5. Removing and installing components
The field replaceable units (FRUs) in the SAN384B can be removed and installed
without special tools. The SAN384B can continue operating during many of the
FRU replacements if the conditions specified in the procedures are followed.
The following sections contain FRU removal and installation procedures.
Removing and installing the chassis door
Note: The chassis door must be installed to ensure the SAN384B meets EMI and
other regulatory certifications. Additionally, if ICL cables are not used, EMI
plugs must be inserted in the ICL cable ports to meet certification standards.
Time and items required
The replacement procedure for the chassis door takes less than 5 minutes.
Removing the chassis door
To remove a chassis door:
1. Support the door to prevent it from falling.
2. Pull and remove the door.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
61
384b015
Figure 31. Chassis door
Removing and installing cable management finger assemblies
The SAN384B comes equipped with two vertical cable management finger
assemblies. It can continue to operate during the replacement of the cable
management assemblies. Due to the horizontal orientation of the blades, the cable
management assemblies are attached to the uprights of the mounting rack.
Time and items required
The replacement procedure for the cable management fingers takes less than five
minutes. A #1 Phillips screwdriver is required.
Removing a cable management finger assembly
To remove the cable management finger assembly:
1. Remove the chassis door.
|
2. Remove the cables from the cable management finger assembly and rearrange
the cables around the assembly.
3. Unscrew and save the two screws that attach the cable management assembly
it from falling.
4. Remove the cable management assembly.
5. If necessary, repeat steps 1-3 for the other cable management assembly.
62 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Figure 32. Cable management finger assemblies
Installing a cable management finger assembly
To install a cable management finger assembly:
1. Position the vertical cable management finger assembly along the upright rails
of the rack, aligning the holes on the assembly with the holes in the SAN384B
chassis.
2. Insert and tighten the two screws to secure the cable management assembly to
the rack's vertical rails.
Note: Three screws secure the chassis to the cabinet vertical rails, two of which
are also used to secure the cable management assembly. The holes on the
assembly will only match two of the holes on the chassis at a time. This
will allow the cable management assemblies to be mounted either
towards the top or towards the bottom of the chassis, depending on
cable density and desired cable routing.
3. Arrange the cables through the fingers of the cable management assembly.
4. Repeat steps 1-3 for the other cable management assembly.
5. Replace the chassis door.
|
Chapter 5. Removing and installing components 63
Download from Www.Somanuals.com. All Manuals Search And Download.
Removing and installing port and application blades
This section describes how to remove and install port and application blades.
Attention: A blade should be removed only when being replaced with another
blade or a filler panel. Any slot that is not occupied by a blade should be occupied
by a filler panel to ensure correct cooling of the chassis and protection from dust.
Slots are numbered from 1 through 8, from bottom to top when facing the port
side of the SAN384B. Port, application, and router blades can be installed in slots
1–2 and 7–8.
removal or replacement of any blades.
Time and items required
|
|
The replacement procedure for each blade takes 5 to 25 minutes, depending on the
number of ports, transceivers, and cables involved. The following items are
required for the blade and filler panel replacement:
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Replacement blade or filler panel
v #2 Phillips screwdriver
|
|
v Small form-factor pluggable (SFP, SFP+, or mSFP) or extended form-factor
pluggable (XFP) (FC10-6 blade only) transceivers (as needed)
v Optical cables (as needed)
Removing a blade
To remove a port or router blade, do the following:
removal or replacement of any blade.
2. Check the power LED, status LED, and port status LEDs to identify any
possible problems. A failed port or router blade can be identified by
inspecting the LEDs on the front panel of each blade. See Figure 18 on page 46
3. Establish a Telnet or console session.
Before installing a blade, establish a Telnet or console connection to determine
a failure and verify operation after installation. Use the slotShow command to
view the status of blades.
4. Check for adequate cable slack. Ensure there is plenty of cable slack to remove
a blade without cable obstruction.
5. Ensure that the part number on the unit being installed matches the
replacement part number. The chassisShow command displays information
about the blades, including part numbers, serial numbers, and additional
status.
6. Ensure that traffic is not flowing through the blade (port status LED should be
off) prior to disconnecting cables.
64 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Note: Before removing any cables from a blade, note the cable order (identify
each cable by its physical port). If multiple blades are being installed,
install one blade at a time. Labeling the cables before removal is
recommended.
|
Note: If multiple blades are being replaced, replace one blade at a time.
|
|
|
|
7. Disconnect all cables and the SFP, SFP+, or XFP transceivers from the blade.
For mSFP transceivers(FC8-64 only), it is recommended that you use the pull
tab to remove the transceiver from the blade before removing the cable from
the transceiver.
8. Perform the appropriate action based on the type of blade:
|
|
|
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades: Unscrew the two thumbscrews from the left
and right ejectors on the blade using the Phillips screwdriver. Unscrew the
left thumbscrew until it pops out. This initiates a hot-swap request. Adjust
the ejectors to the open position (Figure 33),
v For FC10-6 port blade and FR4-18i router blades: Turn the blade off by
sliding the slider switch in the left ejector to the right, to the off position.
This initiates a hot-swap request.
Figure 33. Port blade removal and installation (48-port blade shown as example)
9. Wait for the power LED to turn off in response to the hot-swap request before
removing the blade.
10. Perform the appropriate action based on the type of blade:
Chapter 5. Removing and installing components 65
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades Open the ejectors by pulling them toward
the center of the blade face. Pull the blade out of the chassis using the
ejectors (Figure 33 on page 65).
v For FC10-6 port blade and FR4-18i router blades: Unscrew the two
thumbscrews from the left and right ejectors on the blade using the Phillips
screwdriver. Open both ejectors simultaneously to approximately 45 degrees
and pull the blade out of the chassis.
11. If the blade is not being replaced by another blade, install a filler panel. See
Installing a blade
To install a port blade, do the following:
Note: An FA4-18i routing blade and the SAN384B must have the same version of
firmware. To upgrade firmware versions, refer to the Fabric OS
1. Orient the blade so that the ports are at the front of the chassis and the flat side
of the blade is on the bottom.
2. Perform the appropriate following action based on the type of blade:
|
|
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades Adjust the ejectors to the open position, align
the flat side of the blade inside the left and right rail guides in the slot, and
slide the blade into the slot until it is firmly seated.
v For FC10-6 port blade and FR4-18i router blades: Open the ejectors to
approximately 45 degrees, align the flat side of the port blade inside the left
and right rail guides in the slot, and slide the blade into the slot until it is
firmly seated.
3. Perform the appropriate following action based on the type of blade:
|
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades Adjust the ejectors to the closed position by
pulling them away from the center of the blade.
v For FC10-6 port blade and FR4-18i router blades: Close the ejectors by
pushing the handles toward the center of the blade until the ejectors lock.
The levering action of the handles seats the blade in the slot.
4. Perform the appropriate following action based on the type of blade:
|
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades Tighten the left and right thumb screws using
the Phillips screwdriver.
v For FC10-6 port blade and FR4-18i router blades: Tighten the thumb screw
inside each handle using the Phillips screwdriver.
5. Perform the appropriate following action based on the type of blade:
|
|
v For FC8-16, FC8-32, FC8-48, and FC8-64, port blades and the FX8-24 and
FCOE10-24 application blades Skip to step 6.
v For FC10-6 port blade and FR4-18i router blades: Turn the blade on by
sliding the slider switch in the left ejector to the left, covering the thumb
screw.
66 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
6. Verify that the power LED on the blade displays a steady green light (it might
require a few seconds to turn on). If it does not turn on, ensure that the blade
is firmly seated.
|
|
|
7. Install the SFP, SFP+, or XFP (FC10-6 only) transceivers and cables in the port
blade. For mSFP (FC8-64 only) transceivers, it is recommended that you install
the cables in the transceivers before installing the transceivers in the blade.
8. Group and route the cables through the vertical cable management fingers.
9. Install the chassis door.
Removing and installing blade filler panels
This section describes how to remove and install port blade filler panels.
Removing a filler panel
Attention: A filler panel should be removed only when being replaced with a
port blade or new filler panel. Any slot that is not occupied by a blade should be
occupied by a filler panel to ensure correct cooling of the chassis and protection
from dust.
To remove a filler panel, do the following:
2. Unscrew the thumb screws at the right end of the panel using the Phillips
screwdriver.
3. Pull the filler panel out of the chassis, using the handles on the filler panel
Figure 34. Filler panel removal and installation
Installing a filler panel
To install a filler panel, do the following:
Chapter 5. Removing and installing components 67
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Slide the filler panel into the slot until it is firmly seated.
3. Tighten the thumb screws at the right end of the panel.
Removing and installing a CP8 control processor blade
This section describes how to remove and install a control processor (CP8) blade.
Each SAN384B has two CP8 blades located in slot 4 and slot 5.
Note: If the new CP blade does not have the same firmware as the active CP
blade, the new blade must be upgraded to the same firmware version. Refer
Time and items required
The installation procedure for the CP blade takes approximately 30 minutes. The
following items are required for the CP blade installation:
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Serial cable
v IP address of an FTP server for backing up the SAN384B configuration
v #2 Phillips screwdriver
v Replacement CP blade. The SAN384B requires the CP8 blade.
Verifying the need for replacement
Confirm that you need to install the CP blade. The following events might indicate
that a CP blade is faulty:
v The status LED on the CP blade is lit amber, or the power LED is not lit.
v The CP blade does not respond to Fabric OS commands, or the serial console is
not available.
v The slotShow command does not show that the CP blade is enabled.
v The haShow command indicates an error.
v The clock is inaccurate, or the CP blade does not boot up or shut down
normally.
v Any of the following messages display in the error log:
– “Slot unknown” message relating to a CP slot
– CP blade errors or I2C timeouts
– FRU: FRU_FAULTY messages for a CP blade
– Configuration loader messages or “Sys PCI config” messages
– Generic system driver messages (“FABSYS”)
– Platform system driver messages (“Platform”)
– EM messages that indicate a problem with a CP blade
– Function fail messages for the CP master
For more information about error messages, refer to the Fabric OS Message
Reference.
68 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Recording critical SAN384B information
Back up the SAN384B configuration before you replace a CP blade. Refer to the
Fabric OS Administrator’s Guide for backup information.
1. Login to the functioning CP blade as admin, using either a Telnet or a serial
console connection.
2. Enter haShow to determine which CP blade is active:
swDir:admin> haShow
Local CP (Slot 7, CP1) : Active
Remote CP (Slot 6, CP0) : Standby, Healthy
HA Enabled, Heartbeat Up, HA State Synchronized
3. Enter all remaining commands from the serial console for the active CP blade,
unless otherwise indicated. For more information about commands, refer to the
Fabric OS Command Reference.
|
|
4. If one CP blade is faulted, confirm that the other CP blade is now the active CP
blade and log in to the active CP blade and skip to step 7
|
|
5. If both CP blades are healthy and you want to replace the standby CP blade,
log in to the active CP blade and skip to step 7.
|
|
6. If both CP blades are healthy and you want to replace the active CP blade, log
in to the active CP blade and run the following steps:
|
|
|
a. Run the haFailover command to make the standby CP blade the active
blade. The currently active CP blade becomes the standby blade. Wait until
the status LED on the currently active CP blade is no longer lit.
|
|
b. Confirm the completion of the failover by running the hashow command.
c. Log in to the new active CP blade.
|
|
d. Run the firmwareShow command to confirm the firmware version of the
active CP blade.
|
|
e. Run the haDisable command to prevent failover or communication between
the CP blades during the replacement.
|
f. Continue with step 7.
7. Enter firmwareShow to note the firmware version of the active CP blade.
8. EnterhaDisable from the active CP blade to prevent failover or communication
between the CP blades during the replacement.
|
|
9. Logged into the active CP, run the following two steps to upload the system
configuration to a specified FTP server. Enter information at the prompts.
|
|
a. Enter the configupload -vf command. This command uploads the system
virtual fabric data.
|
|
b. Enter the configupload command. This command uploads the system
configuration.
Removing a control processor blade (CP8)
The SAN384B continues to operate while a CP blade is being installed if the
redundant CP blade is active and a failover does not occur. You can prevent
failover by entering the haDisable command.
handling any blades.
Note: The CP8 blade is compatible only with the SAN384B and SAN786B
products.
To remove a CP blade, do the following:
Chapter 5. Removing and installing components 69
Download from Www.Somanuals.com. All Manuals Search And Download.
|
2. Power off the blade you are replacing by sliding the slider switch in the left
ejector to the right, to the off position.
3. Disconnect all cables from the CP blade you are replacing.
4. Unscrew the thumb screws from both ejectors using the Phillips screwdriver.
5. Lever open both ejector handles simultaneously to approximately 45 degrees
and pull the CP blade out of the chassis (see Figure 35).
384b019
Figure 35. Removing the control processor (CP8) blade
Installing a control processor blade (CP8)
whenever handling a blade.
To install a CP blade (slot 4 or 5):
1. Open the ejector handles to approximately 45 degrees. Orient the CP blade so
that the handles are toward you and the flat metal side is on the bottom.
2. Align the flat metal side of the CP blade inside the left and right blade guides
in the slot. Slide the CP blade into the slot until it is firmly seated.
3. Tighten the thumb screws inside each handle using the Phillips screwdriver.
4. Turn the CP blade on by sliding the ON/OFF switch in the left handle to the
left, to cover the thumb screw.
5. Verify that the power LED is green. If not, ensure that the CP blade has power
and is firmly seated and that the ejectors are in the locked position.
6. Connect the cables to the new CP blade.
70 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Verifying operation of the new CP blade
To verify that boot and POST are complete on the new CP blade and that the CP
blade has achieved failover redundancy, complete the following steps.
1. Enter slotShow. The command output shows the new CP blade as “enabled.”
2. Determine the version by entering firmwareShow.
|
|
3. If the firmware versions for both CP blades are the same, skip to step 8 under
|
|
|
|
|
|
|
|
4. If the firmware version on the replacement blade does not match that on the
active CP blade, a warning message appears with the results of the
firmwareShow command. You must bring the replacement blade to the same
firmware level as the active blade using the firmwareDownload -s command to
bring it up to the proper level. If you are using an FTP Server to download the
using a USB device to download the firmware, skip to “Downloading firmware
|
|
Downloading firmware from an FTP server
1. Log out of the active CP blade and log in to the standby CP blade.
|
|
|
|
2. Enter firmwareDownload -s to download the firmware to the standby CP
blade. The -s option also disables the autoreboot, so you will have to
manually issue a reboot after the download finishes to initiate
firmwareCommit. Enter all requested information (use default values).
|
|
|
|
and select your product, then click on the Download tab. Select the
appropriate firmware version and release notes version. Enter all requested
information (use default values):
|
4. Enter firmwareDownloadStatus to verify that the firmware has been updated.
|
|
|
|
5. Ensure that you are still logged in to the standby CP blade (the blade for
which you just changed the firmware level) and type reboot. The reboot of the
standby CP will initiate a firmwarecommit to the secondary partition and log
you out.
|
|
|
6. Log back in to the standby CP blade and type firmwaredDownloadStatus on
the standby CP blade to validate a successful commit. This may take up to 10
minutes.
|
|
7. Log out of the standby CP blade and log in to the active CP blade.
8. Type haEnable to re-enable HA on the active CP blade.
|
|
|
Note: For Fabric OS 6.3.0 and later, haEnable will cause the standby CP blade
to reboot. Wait until the power cycles and the POST completes before
moving to the next step.
|
|
|
9. Type haShow and verify that the command output includes “HA Enabled
Heartbeat Up”. If not, re-enter the command until you have verified that
redundancy is achieved.
|
|
10. Type version or firmwareShow to verify that the firmware version has been
updated.
|
|
11. Pack the faulty CP blade in the packaging provided with the new CP blade for
return to IBM, following local procedures.
|
|
Chapter 5. Removing and installing components 71
Download from Www.Somanuals.com. All Manuals Search And Download.
|
Downloading firmware from a USB drive
|
|
Firmware can be downloaded from a Brocade USB drive. The folder structure on
the USB device must be as follows in order to allow the device to be enabled:
|
|
|
|
|
brocade>
config
firmware
firmwareKey
support
|
|
|
The firmware folder contains the folder for the specific release you are installing.
1. Insert the USB drive into the USB port of the active CP blade.
2. Attach a serial cable from the PC to the active CP blade.
|
|
3. Log in to the active CP blade and enter usbStorage - e to enable the USB
device.
|
|
4. Remove the serial cable from the active CP blade and attach it to the standby
CP blade.
|
|
|
|
|
|
|
|
5. Enter firmwareDownload -s -U vX.X.X (where X.X.X is the firmware version
you are downloading) to download the firmware to the standby CP blade.
The -s option also disables the autoreboot, so you must manually issue a
reboot after the download finishes to initiate firmwarecommit. Enter all
requested information (use default values).
The -U option indicates that the download should come from the USB device.
If you do not use this option, you are prompted with Download from USB [No}:
Enter Y to download from the USB device.
|
|
6. When the download process finishes, type firmwareDownloadStatus to verify
that the firmware has been updated.
|
|
|
|
7. Ensure that you are still logged in to the standby CP blade (the blade for
which you just changed the firmware level) and type reboot. The reboot of the
standby CP will initiate a firmwarecommit to the secondary partition and log
you out.
|
|
|
8. Log back in to the standby CP blade and type firmwareDownloadStatus on
the standby CP blade to validate a successful commit. This may take up to 10
minutes.
|
9. Log out of the standby CP blade and log in to the active CP blade.
|
|
|
10. Type haShow and verify that the command output includes “HA enabled,
Heartbeat Up, HA State synchronized”. If not, re-enter the command until
you have verified that redundancy is achieved.
|
|
11. Type firmwareShow to verify that the firmware version has been updated and
that the versions are the same on the two CP blades.
|
|
12. Pack the faulty CP blade in the packaging provided with the new CP blade
for return to IBM, following local procedures.
|
|
Removing and installing a CR4S-8 core switch blade
This section describes how to remove and install a core switch blade. The
SAN384B has two core switch blades: one in slot 3 and one in slot 6. Note that the
72 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Time and items required
The installation procedure for the core switch blade takes approximately 30
minutes. The following items are required for the core switch blade replacement:
v ESD grounding strap
v #2 Phillips screwdriver
v Replacement CR4S-8 core switch blade.
Verifying the necessity of installation
Confirm that you need to replace the core switch blade before continuing. The
following events might indicate that a core switch blade is faulty:
v The status LED on the core switch blade is lit amber, or the power LED is not
lit.
v The slotShow command does not show that the core switch blade is enabled.
v The haShow command indicates an error.
v Any of the following messages display in the error log:
– “Slot unknown” message relating to a core switch blade slot
– core switch blade errors or I2C timeouts
– FRU: FRU_FAULTY messages for a core switch blade
– Configuration loader messages or “Sys PCI config” messages
– Generic system driver messages (“FABSYS”)
– Platform system driver messages (“Platform”)
– Error messages that indicate a problem with a core switch blade
– Function fail messages for the core switch blade master
For more information about error messages, refer to the Fabric OS Message
Reference.
Removing a CR4S-8 core switch blade
The SAN384B continues to operate while a core switch blade is being replaced.
whenever handling blades.
Note: The CR4S-8 blade is compatible only with the SAN384B.
2. Power off the blade by sliding the slider switch in the left ejector to the right,
to the off position. Do not eject the blade until the power LED has gone off and
you have completed the next two steps.
|
|
3. Disconnect all cables from the faulty core switch blade. If ICL cables are not
used, remove the EMI plugs from the cable sockets.
4. Unscrew the thumbscrews from both ejectors using the Phillips screwdriver.
|
|
5. Open both ejectors simultaneously to approximately 45 degrees and pull the
core switch blade out of the chassis (Figure 36 on page 74).
Chapter 5. Removing and installing components 73
Download from Www.Somanuals.com. All Manuals Search And Download.
384b020
Figure 36. Removing and replacing the core switch blade
Installing a CR4S-8 core switch blade
whenever handling blades.
To install a CR blade (slot 3 or 6), do the following:
1. Open the ejector handles to approximately 45 degrees; then, orient the CR
blade so that the handles are toward you and the flat metal side is on the
bottom.
2. Align the flat metal side of the core switch blade inside the left and right blade
guides in the slot; then, slide the core switch blade into the slot until it is firmly
seated.
|
|
3. Close the ejector handles and then tighten the thumbscrews inside each handle
using the Phillips screwdriver.
4. Turn the core switch blade on by sliding the ON/OFF switch in the left handle
to the left, to cover the thumbscrew.
5. Verify that the power LED is green (this might require a few seconds). If not,
ensure that the core switch blade has power and is firmly seated and that the
ejectors are in the locked position.
6. Connect the cables to the new core switch blade. If ICL cables are not used,
insert EMI plugs into the cable sockets.
8. Pack the faulty core switch blade in the packaging provided with the new core
switch blade for return to IBM, following local procedures.
74 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Removing and installing a power supply
Use this procedure to remove and replace a power supply. The SAN384B can
continue operating during the replacement if the other power supply is operating.
Note: The SAN384B base configuration includes two power supplies for full
redundancy. Operating the system with a single functioning power supply
runs the risk of data loss in the event of a second power supply failure. Both
power supply slots should remain filled to ensure proper air circulation for
system cooling.
Time and items required
The installation procedure for each power supply takes less than 5 minutes. A
power supply unit or filler panel is required for the power supply installation.
Removing a power supply
Figure 37 shows the location of the two power supplies, which are located at the
top of the non-port side of the SAN384B.
1
2
Figure 37. Location of the two power supplies
ꢀ1ꢁ
Power supply 1 (PS1)
ꢀ2ꢁ
Power supply 2 (PS2)
1. Perform the appropriate following action based on whether the SAN384B is
operating:
v If the SAN384B is not operating during the replacement procedure, go to
step 2.
Chapter 5. Removing and installing components 75
Download from Www.Somanuals.com. All Manuals Search And Download.
v If the SAN384B is going to continue operating during the replacement, check
the power LEDs to verify that the remaining power supply is functioning.
The SAN384B requires a minimum of one power supply at all times to
function.
2. Turn off the power switch on the power supply you are replacing.
3. Disconnect the power cord.
4. Loosen the thumbscrew, using a Phillips screwdriver if necessary.
5. Grasp the handle and pull, sliding the power supply from the chassis (see
Figure 38). Support the power supply from beneath as you remove it.
6. If you are not immediately replacing the power supply, insert and attach a
power supply filler panel into the slot.
Note: Two power supplies are required to provide redundancy, protecting
against potential data loss.
Figure 38. Removing and installing a power supply
Installing a power supply
To install a power supply, do the following:
1. Remove any filler panels that were temporarily installed.
2. Insert the power supply into the slot. Verify that the power supply is seated by
gently pulling on the handle. The power supply should resist movement as you
pull.
3. Tighten the thumbscrew.
4. Connect the power cord.
5. Move the power supply switch to the on position.
6. Verify that the power LED on the power supply displays a steady green light.
76 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Removing and installing a blower assembly
This procedure provides instructions for removing and installing a blower
assembly.
Attention: The system can continue operating during the replacement if the
second blower assembly is operating, To ensure continuous adequate cooling,
maintain both blower assemblies except for the brief period during replacement.
Time and items required
The installation procedure for each blower assembly takes less than 5 minutes. The
following items are required for the blower assembly installation:
v Replacement blower assembly
v #2 Phillips screwdriver
Removing a blower assembly
To remove a blower assembly, do the following:
1. Before removing a blower assembly, verify that the other blower assembly is
functioning correctly. The power LEDs should be steady green.
2. Use the screwdriver to loosen the captive screws at the left and right of the
blower assembly.
3. Grasp the handle and pull, sliding the blower assembly from the chassis and
supporting the blower assembly from beneath as you remove it (see Figure 39
Chapter 5. Removing and installing components 77
Download from Www.Somanuals.com. All Manuals Search And Download.
Figure 39. Blower assembly removal and replacement
Installing a blower assembly
To install a blower assembly, do the following:
1. Orient the blower assembly and slide it into the chassis, pushing firmly to
ensure that it is seated.
2. Verify that the power LED displays a green light.
3. Use the screwdriver or your fingers to tighten the captive screws.
Removing and installing a WWN bezel and WWN card
Note: The World Wide Name (WWN) cards contain fully redundant circuits and
normally do not require replacement. Two WWN cards are located beneath
the WWN bezel.
Time and items required
Allow approximately 20 minutes to install a WWN card. The following items are
needed to install a WWN card:
v ESD grounding strap
v #2 Phillips screwdriver (required only for some versions of the WWN card)
78 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
v If a serial console session is used: serial cable and a workstation computer with
a terminal emulator application (such as HyperTerminal for Windows systems or
TIP for UNIX systems)
Verifying necessity of installation
Before installing a WWN card, verify that the installation is necessary. Any of the
following events can indicate that the card requires replacement:
v Status LED on WWN card (beneath the bezel) indicates a problem
Note: Power and status LEDs for the blades are not on the WWN card. Those
LEDs can be viewed directly on the blades themselves.
Determining the status of a WWN card
To determine the status of a WWN card, do the following:
retrieving or modifying this data could indicate a WWN card failure.
Table 15. Commands identifying the WWN card status
Data
Related commands
wwn, chassisShow
chassisShow
WWN values
Data about the chassis and WWN card
Ethernet and Fibre Channel IP address
information for the CP blades
ipAddrShow, ipAddrSet
History log information
Name of switch
historyShow, historyLastShow
switchName
Name of chassis
chassisName
2. Enter the chassisShow command to display information about the WWN card.
WWN units correspond to information specific to the WWN card. An error
Table 16. WWN card related system log messages
Type of message
System message (errshow or errdump)
WWN unit removal was
detected
<timestamp>, [EM-1050], <sequence-number>,, INFO,
<system-name>, FRU WWN # removal detected.
WWN unit insertion was
detected
<timestamp>, [EM-1049], <sequence-number>,, INFO,
<system-name>, FRU WWN # insertion detected.
WWN unit fails to power on <timestamp>, [EM-1004], <sequence-number>,, CRITICAL,
<system-name>, WWN # failed to power on
WWN unit is being faulted <timestamp>, [EM-1034], <sequence-number>,, ERROR,
<system-name>, WWN # set to faulty, rc=<return code>
Removing the WWN bezel and WWN card
whenever handling cards or blades.
1. Open a Telnet session to the SAN384B and log in to the active CP as admin. The
default password is password.
Chapter 5. Removing and installing components 79
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Verify you are logged into the active CP. Run the haShow command to
determine the active CP.
3. Remove the two screws from the WWN bezel . Pull the bezel away from the
are visible.
4. Enter fruReplace wwn from the active CP blade and wait for the phrase, "Do
you wish to continue [y/n]?" to display; then enter y.
5. Wait until the WWN card data is backed up. Do not enter continue until the
mechanical replacement is complete.
switch:admin> frureplace wwn
This is the WWN card hot swap interface.
Continuing from this point will require
the whole process to be completed.
If this process is not complete due to a
power cycle, or CP failover, please follow
the recovery procedure in
Core Switch WWN Card Removal and
Replacement document.
Do you wish to continue [y/n]? y
Backing up WWN card data, please wait about 25 seconds for further instruction.
Please install the new FRU now.
If this session lost for any reason, please re-enter the frureplace command and
follow the instructions to complete the operation.
Please enter the word `continue' after the new WWN card has been installed:
6. Wait until all the LEDs on the WWN bezel turn off.
7. Use a Phillips screwdriver to unscrew the screw that secures the WWN card to
the chassis. Use the pull tab to remove the card.
8. Disconnect the WWN cable by depressing the cable connector latch and pulling
the connector from the WWN module.
9. Set the WWN card on a static-free surface, such as a grounding pad.
Figure 40. WWN bezel and card removal and installation
Installing the WWN bezel and WWN card
To install the WWN bezel and WWN card, do the following:
whenever handling cards or blades.
1. Unpack the new WWN card and save the packaging for returning the faulty
WWN card.
80 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Hold the card by the pull tab and insert the WWN cable onto the WWN
module until it is fully seated. Use the Phillips screwdriver and the two screws
to attach the WWN card to the chassis.
Note: If a serial console session is active, several “removal detected” and
“insertion detected” messages display on the console because of the
replacement.
3. In the CLI session, enter continue to indicate that the replacement has been
completed.
Please enter the word `continue' after the new WWN card has been installed:
continue
Restoring the information to the replacement FRU now, please
wait about 20 seconds to complete
Verifying the replacement FRU now...
WWN card hot swap is now complete.
FRU replacement completed successfully!
|
|
|
4. If the command fails for any reason, do not reboot or power off the system.
Repeat the FRUREPLACE WWN command which will attempt to recover the
WWN card.
5. Verify that the WWN card is correctly connected by checking the LED on the
WWN card.
Note: The LED might take up to 2 minutes after WWN card installation to
begin functioning.
Insert and tighten the two screws.
7. Pack the faulty WWN card in the packaging provided with the new card for
return to IBM, following local procedures.
Removing and installing transceivers
|
Note: For a listing of SFPs, SFP+, mSFPs, and XFPs compatible with this product:
v Select the SAN384B product link
v On the SAN384B product page, click the Interoperability Matrix link.
v In the Interoperability matrix, click the Transceivers link.
|
|
|
Note: The 8-Gbps-capable mSFPs and SFP+s auto-negotiate at 2, 4, and 8 Gbps.
The 4-Gbps SFPs auto-negotiate at 1, 2, and 4 Gbps. The mSFPs are
compatible only with the FC8-64 high density port blade.
|
|
Note: The XFP transceivers are used only with the FC10-6 port card. They should
not be used in any 1 GE port.
Time required
The replacement procedure for a transceiver takes less than five minutes
Items required
v Replacement mSFP, SFP, SFP+, or XFP
v Optical transceiver extraction tool (for SFP, SFP+, and XFP transceivers)
Chapter 5. Removing and installing components 81
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
Removing and replacing an SFP, SFP+, or XFP optical
transceiver
|
|
|
|
|
|
The extraction tool is designed to remove transceivers from blades where the space
is limited. To use the extraction tool, slide the tool on to the bale of the transceiver
and pull it out.
|
|
Figure 41. Optical transceiver (SFP, SFP+, and XFP) extraction tool
|
|
|
Note: This tool is part of the SAN384B ship group and should be kept with the
chassis.
|
|
|
Attention: mSFP optical transceivers should not be inserted into ports intended
for SFP or SFP+ transceivers. They will be faulted on power-up for Fabric OS 6.4.0
and later.
|
|
|
Removing an SFP, SFP+, or XFP optical transceiver
To remove an SFP, SFP+, or XFP (FC6-10 blade only) transceiver, complete the
following steps.
|
|
1. Remove any cables that are inserted into the transceiver. Use the extraction tool
to open the cable latching mechanism.
|
|
|
|
2. Pull the bail (wire handle) ꢀ1ꢁ away from its pivot point and out, sliding the
transceiver out of the port (Figure 42).
!
1
|
|
|
Figure 42. Replacing an optical transceiver
82 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
|
Replacing an SFP, SFP+, or XFP transceiver
|
|
|
|
|
1. Position the optical transceiver so that the key is oriented correctly to the port.
Insert the transceiver into the port until it is firmly seated and the latching
mechanism clicks. Transceivers are keyed so that they can only be inserted with
the correct orientation. If a transceiver does not slide in easily, ensure that it is
correctly oriented.
|
|
|
|
|
2. Position a cable so that the key (the ridge on one side of the cable connector) is
aligned with the slot in the transceiver. Insert the cable into the transceiver
until the latching mechanism clicks. Cables are keyed so that they can be
inserted in only one way. If a cable does not slide in easily, ensure that it is
correctly oriented.
|
Removing and replacing an mSFP optical transceiver
|
|
|
Note: mSFP optical transceivers should not be inserted into ports intended for SFP
or SFP+ transceivers. They will be faulted on power-up For Fabric OS 6.4.0
and later.
|
|
|
To replace an mSFP transceiver, complete the following steps. Note that it is
recommended that the optical cable should be either removed from or inserted into
the mSFP while the transceiver is out of the switch or blade.
|
Removing an mSFP transceiver
|
|
|
|
|
Note: The mSFP transceivers are used only with the FC8-64 port blade. Narrower
OM-3 LC cables are used to connect the FC8-64. These cables are offered by
several major manufacturers. Contact your IBM representative for options
regarding different cable and patch panel configurations to simplify cable
management with higher density FC8-64 port blades.
|
|
|
|
Attention: The pull tabs are not designed to be bent. Doing so may result in
damage to the pull tab.
1
2
|
|
|
Figure 43. Optical mSFP transceiver
|
|
ꢀ1ꢁ
Pull tab
ꢀ2ꢁ
mSFP transceiver
|
|
|
1. Grasp the pull tab ꢀ1ꢁ firmly and pull the unit out of the port.
2. Remove the cable from the transceiver.
|
|
Replacing an mSFP transceiver
1. Insert the cable into the new transceiver until the latching mechanism clicks.
|
|
|
|
|
|
2. Position the optical transceiver so that the key is oriented correctly to the port.
Insert the transceiver into the port until it is firmly seated and the latching
mechanism clicks.
Transceivers are keyed so that they can only be inserted with the correct
orientation. If a transceiver does not slide in easily, ensure that it is correctly
oriented.
Chapter 5. Removing and installing components 83
Download from Www.Somanuals.com. All Manuals Search And Download.
Removing and installing inter-chassis link (ICL) cables
Note: ICL ports can be used only with an ICL license. After the addition or
removal of a license, the license enforcement is performed on the ICL ports
only when the portDisable and portEnable commands are issued on the
ports. An ICL license must be installed on all systems forming the ICL
connection. The systems can be any combination of up to three SAN384B
and SAN768B chassis.
Attention: If ICL cables are not in use, the ports must have EMI plugs installed to
meet EMI and other regulatory certifications.
actions for those patterns.
Table 17. ICL connector port LEDs
Recommended
LED purpose
Color
Status
action
LINK LED
No light (LED is off) No ICL, or ICL cable Ensure that the ICL
present but no
connection.
cable is correctly
installed.
Steady green
ICL connected.
No action required.
No action required.
ATTN LED
No light (LED is off) ICL operational.
Blinking amber Attention required.
Ensure that the ICL
cable is correctly
installed.
Follow this procedure to remove and install the ICL cables. Refer to the Fabric OS
Administrator’s Guide for the configuration procedure and requirements.
Figure 44 on page 85 shows the two ends of an ICL cable. The ICL cables (2 meters
long) and the ICL connectors are color-coded and labeled for ease of installation.
The cables can connect ICL connector ports on the SAN384B core switch blades
(CR4S-8) or SAN768B core switch blades (CR8).
84 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
ICL 1
ICL 0
Figure 44. ICL cable
Time and items required
The replacement procedure for an ICL cable takes less than five minutes. A
replacement ICL cable is the only item needed.
Removing an ICL cable
Attention: To prevent the latch mechanism from wear, use the color-coded
(green) latch-release tab for cable removal. Pull the tab to disengage the retention
latch before cable removal.
2. If you are replacing an ICL cable, note the cable routing, paying attention to
which cable end plug into which socket. Replace only one ICL cable at a time
to minimize errors.
3. Using the latch release tabs, pull each plug on the cable from its respective
socket on the SAN384B core switch blades (CR4S-8) or SAN768B core switch
blades (CR8).
4. Repeat for each cable that requires replacement.
5. If you are not replacing the ICL cables, insert the EMI plugs into each ICL
socket.
Installing an ICL cable
1. Align the color-coded and labeled (ICL 1 and ICL 0) plugs on either end of the
ICL cable with their respective connectors on the core switch blades (CR4S-8 or
CR8).
2. Push each plug in until the latch mechanism clicks into place.
3. Repeat for each cable that you are installing.
If you are installing ICL cables for the first time, pay particular attention to the
configuration in which the cables must be installed.
Chapter 5. Removing and installing components 85
Download from Www.Somanuals.com. All Manuals Search And Download.
Attention: Since the blades in the SAN384B are installed horizontally, the
familiar top-to-bottom orientation for other products becomes a left-to-right
orientation. Connect the cables from the left (top) connectors (ICL 1) of the
CR4S-8 blades in the first chassis to the right (bottom) connectors (ICL 0) of the
CR4S-8 blades in the second chassis. Similarly, connect the cables from the right
(bottom) connectors (ICL 0) of the CR4S-8 blades in the first chassis to the left
(top) connectors (ICL 1) of the CR4S-8 blades in the second chassis. Figure 45
configurations for the ICL feature between two SAN384B chassis and between a
SAN384B and a SAN768B, respectively. The first drawing for two SAN384B
systems shows the cables attached between the blades in slot 3 on one chassis
and slot 6 on the second chassis. It is also acceptable to attach the cables from
slot 3 on one chassis to slot 3 on the second chassis (or slot 6 to slot 6) as long
Figure 48 on page 90 show the arrangement of cables in a 3-way configuration
of backbone chassis. Note the relationship of the horizontal SAN384B layout to
the vertical layout of the SAN768B in each figure.
Note: The same general configuration applies regardless of which chassis are
used. The illustrations for 3-way ICL cable connections are used to show
the ICL cable connections between the different chassis. They are not
meant to illustrate installation of multiple chassis in a single cabinet.
Because of cabinet installation limits, the chassis for some configurations
will be installed in adjacent cabinets.
5. Once all the cables are attached, see the Fabric OS Administrator’s Guide for the
configuration procedure.
86 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
1
2
4
3
6
5
7
8
Figure 45. ICL cable connections between two SAN384B chassis
ꢀ1ꢁ Chassis 1
ꢀ2ꢁCore switch blades (CR4S-8)
ꢀ3ꢁ Control processor blades (CP8)
ꢀ4ꢁ Port blades
ꢀ5ꢁ ICL connector (ICL 1)
ꢀ6ꢁ ICL connector (ICL 0)
ꢀ7ꢁ ICL cables
ꢀ8ꢁ Chassis 2
Chapter 5. Removing and installing components 87
Download from Www.Somanuals.com. All Manuals Search And Download.
1
2
4
3
6
5
7
8
Figure 46. ICL cable connections between a SAN384B chassis and a SAN768B chassis.
ꢀ1ꢁ Chassis 1 (SAN384B)
ꢀ2ꢁ Core switch blades (CR4S-8)
ꢀ3ꢁ Control processor blades (CP8)
ꢀ4ꢁ Port blades
ꢀ5ꢁ ICL connector (ICL 1)
ꢀ6ꢁ ICL connector (ICL 0)
ꢀ7ꢁ ICL cables
ꢀ8ꢁ Chassis 2 (SAN768B)
88 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
2
5
6
4
1
6
2
5
5
6
3
2
Figure 47. 3-way ICL cable connections between a SAN384B chassis and two SAN768B
chassis.
ꢀ1ꢁ Chassis 1 (SAN384B)
ꢀ2ꢁ Core switch blades (CR4S-8)
ꢀ3ꢁ Chassis 2 (SAN768B)
ꢀ4ꢁ Chassis 3 (SAN768B)
ꢀ5ꢁ ICL connector (ICL 1)
Chapter 5. Removing and installing components 89
Download from Www.Somanuals.com. All Manuals Search And Download.
ꢀ6ꢁ ICL connector (ICL 0)
1
2
6
5
5
6
2
3
6
2
4
5
Figure 48. 3-way ICL cable connections between a SAN768B chassis and two SAN384B
chassis.
ꢀ1ꢁ Chassis 1 (SAN384B)
ꢀ2ꢁ Core switch blades (CR4S-8)
ꢀ3ꢁ Chassis 2 (SAN768B)
ꢀ4ꢁ Chassis 3 (SAN384B)
ꢀ5ꢁ ICL connector (ICL 1)
ꢀ6ꢁ ICL connector (ICL 0)
90 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
|
6
2
1
6
5
2
3
6
5
2
4
5
|
|
Figure 49. 3-way ICL cable connections between three SAN384B chassis.
|
|
|
|
|
|
|
ꢀ1ꢁ Chassis 1 (SAN384B)
ꢀ2ꢁ Core switch blades (CR4S-8)
ꢀ3ꢁ Chassis 2 (SAN384B)
ꢀ4ꢁ Chassis 3 (SAN384B)
ꢀ5ꢁ ICL connector (ICL 1)
ꢀ6ꢁ ICL connector (ICL 0)
Note: For clarity, the two sets of cables are drawn differently (solid and dashed) in
to only the blades in the "low order" slots (slot 3 in the SAN384B and slot 5
in the SAN768B) and the other set is connected to the blades in the "high
order" slots (slot 5 in the SAN384B and slot 8 in the SAN768B). Keeping the
sets apart in this manner minimizes the cable confusion.
|
Removing and replacing a SAN384B chassis
This section describes how to remove and replace the SAN384B chassis (with its
backplane). The basic steps are:
Chapter 5. Removing and installing components 91
Download from Www.Somanuals.com. All Manuals Search And Download.
Note: The SAN384B must be removed from the fabric and powered off to perform
this procedure. Contact IBM Support if you have any questions about
whether the chassis requires replacement.
Time required
The chassis replacement takes approximately 3 hours.
Items required
The following items are required for the chassis replacement:
v ESD grounding strap
v ESD grounding pads for protecting all blades and WWN cards
v Serial cable and workstation computer with a terminal emulator application
(such as HyperTerminal for Windows systems or TIP for UNIX systems),
required only if serial console session used
140 cm (55 in.) and carries a minimum of 113 kg (250 lb)
v A surface to place the old chassis on, such as a second lift or the pallet originally
provided with the old chassis
v #2 Phillips screwdriver
Verifying need for replacement
Verify that replacement of the chassis is necessary. Ensure that the components are
firmly seated when troubleshooting, and contact IBM support with any questions
about whether the chassis should be replaced. Any of the following events might
indicate the need to replace the chassis:
v Visible mechanical damage to the chassis, including damage to sheet metal or
card guides that prevents correct installation of a blade.
v Bent or damaged connectors on the backplane (the surface inside the chassis to
which the blades connect).
v One or more components (such as a power supply, blower assembly, port blade,
control processor blade (CP8), core switch blade (CR4S-8), or WWN card) do not
function properly even after the component was replaced.
v The psShow or fanShow commands continue to show a faulty component even
though the component was replaced.
v The slotShow command continues to show a faulty control processor (CP8), core
switch (CR4S-8), or port blade even though the blade was replaced.
Recording critical SAN384B and SAN information
All commands must be entered from a CLI session (Telnet or serial) to the active
CP blade unless otherwise indicated.
92 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
94 and more. The customer should record the location of the .txt files, which
are created by the customer and are not called out in the supportShow
results.
|
|
|
For detailed information about Fabric OS commands, refer to the Fabric OS
information is recorded.
Chapter 5. Removing and installing components 93
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Table 18. Critical information checklist example
Checked? Data
Configuration information
Location of "config-switch.txt" file:
Notes
Location of "config-miscinfo.txt" file:
IP address, subnet mask:
WWN for SAN384B:
SAN profile
Location of "SANbefor.txt" file:
Notes regarding nsShow output:
Notes regarding nsAllShow output:
Notes regarding switchShow output:
Notes regarding fabricShow output:
Output from supportShow command
Location of "spptshow.txt" file:
Notes regarding supportShow output:
Information about the new chassis
New factory serial number:
|
|
New serial number (if available):
1. Open a Telnet session and log in to the SAN384B as admin. The default
password is password. Enable the logging function on your Telnet or serial
console connection.
2. Back up the current configuration.
Note: If you are using the virtual fabric feature, run configUpload -vf before
running the configUpload command in order to save the logical switch
configuration.
Enter configUpload -all; then enter the requested information at the prompts.
This command uploads the configuration to the customer-defined FTP server,
making it available for downloading. For more information about this
command, refer to the Fabric OS Command Reference Manual.
switch:admin> configupload -all
Protocol (scp or ftp) [ftp]: ftp
Server Name or IP Address [host]: 123.123.123.123
User Name [user]: Admin24
File Name [config.txt]: config-switch0.txt
Password: xxxxxxxx
Upload complete
switch:admin>
|
Alternatively, you can save the configuration file to a Brocade USB drive.
3. Record the SAN384B values on a workstation (steps 4 through 9)
4. Record the WWN value: Enter wwn; then, copy the command output into a file
named “config-miscinfo.txt”.
switch:admin> wwn
10:00:00:60:69:00:00:0a
5. Record the IP address information.
94 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Enter ipAddrShow -sw; then copy the command output into the
“config-miscinfo.txt” file.
|
switch:admin> ipaddrshow -sw
SWITCH
Ethernet IP Address: 10.32.50.12
Ethernet Subnetmask: 255.55.0.0
Fibre Channel IP Address: 1.2.3.4
Fibre Channel Subnetmask: 255.255.255.0
CP0
Ethernet IP Address: 10.32.50.10
Ethernet Subnetmask: 255.55.0.0
HostName : cp0
Gateway Address: 10.32.40.1
CP1
Ethernet IP Address: 10.32.50.11
Ethernet Subnetmask: 255.55.0.0
HostName : cp1
Gateway Address: 10.32.40.1
Backplane IP address of CP0 : 10.0.0.4
Backplane IP address of CP1 : 10.0.0.5
switch:admin>switch:admin>
6. Display and record the manufacturer serial numbers.
Enter chassisShow; then copy the command output into the
“config-miscinfo.txt” file.
“Factory Serial Num” and “Serial Num” are listed under “Chassis/WWN Unit
1.” If the current WWN cards are the original cards, the factory serial number
listed is the same as the chassis serial number.
switch:admin> chassisshow
Chassis Backplane Revision: 1F
SW BLADE Slot: 1
Header Version:
2
Power Consume Factor: -50
Factory Part Num:
Factory Serial Num:
60-0001532-03
KP000000195
Manufacture:
Update: Day:
Time Alive:
Time Awake:
Day: 1 Month: 1 Year: 2007
14 Month: 3 Year: 2012
187 days
3 days
<output truncated>
CHASSIS/WWN Unit: 1 (in same assembly as WWN Unit: 2)
Header Version:
Power Consume Factor: -3
2
Factory Part Num:
Factory Serial Num:
60-0001501-07
FT02X805BE2
Manufacture:
Update:
Time Alive:
Time Awake:
Day: 26 Month: 3 Year: 2007
Day: 14 Month: 3 Year: 2009, 2010
207 days
3 days
<output truncated>
switch:admin>
7. Create a SAN “profile” by entering and recording the information provided by
the following commands:
v nsShow
Chapter 5. Removing and installing components 95
Download from Www.Somanuals.com. All Manuals Search And Download.
v nsAllShow
v switchShow
v fabricShow
Copy the command output into a text file named “SANbefor.txt”. After the
SAN384B is restored to the fabric, this information can be used to verify that no
unintentional changes have occurred to the fabric.
switch:admin> nsshow
Enter Pid COS PortName NodeName TTL
<output truncated>
switch:admin> nsallshow
12 Nx_Ports in the Fabric
<output truncated>
switch:admin> switchshow
switchName: switch
<output truncated>
switch:admin> fabricshow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
<output truncated>
8. Enter supportShow; then copy the command output into a text file named
“spptshow.txt”.
Note: The supportShow command has a very long output and time for
completion. It may last 20 minutes or longer depending on the size of
the SAN.
This file provides a backup of all the information that might be required by
Technical Support. The information can be used after the SAN384B is restored
to the fabric, to verify that no unintentional changes have occurred to the
fabric.
switch:admin> supportshow
version: 6.4.0
<output truncated>
switch:admin>
9. Record the cable connections between the SAN384B and the target device and
sample template.
Disconnecting from the network and fabric
1. Shut down the SAN384B using the sysShutdown command.
switch:admin> sysshutdown
This command will shutdown the operating systems on your switch.
You are required to power-cycle the switch in order to restore operation.
Are you sure you want to shutdown the switch [y/n]? y
HA is disabled
Stopping blade 1
Shutting down the blade....
Stopping blade 2
Shutting down the blade....
Stopping blade 8
Shutting down the blade....
Broadcast message from root (pts/1) Tue Jul 18 14:23:06 2008...
The system is going down for system halt NOW !!
2. Power off the chassis by flipping all AC power switches to O. (The power
supply status LED should turn off.)
96 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
DANGER
Multiple power cords. The product is equipped with multiple
power cords. To remove all hazardous voltages, disconnect all
power cords. (L003)
3. Remove the power cords from the power supplies and the power outlets.
|
|
|
6. Disconnect the cables from the port blades and set them aside. Remove each
mSFP transceiver and cable as a unit. The SFP, SFP+, or XFP transceivers can be
left in the blades or removed.
7. Disconnect all cables from the CP8 and CR4S-8 blades.
Removing components from the chassis
handling components.
Note: If the chassis being removed was factory installed, additional shipping
braces were added for stability during shipment. These consist of
L-brackets and flat mounting plates. The mounting plates are attached on
either side at the blower end of the chassis. The L-brackets secure the
mounting plates to the cabinet vertical rails. Detach the L-brackets from
the mounting plates and the cabinet rails before removing the chassis
from the cabinet. If you anticipate that the cabinet with an installed
chassis may be shipped to another location in the future, it is
recommended that you attach these shipping brackets to any
replacement chassis. Take note of how the brackets are assembled and
attached when you remove them from the old chassis.
Chapter 5. Removing and installing components 97
Download from Www.Somanuals.com. All Manuals Search And Download.
Removing a SAN384B from the cabinet
These instructions describe how to use the lift tool (PN 09P2481) and the 24–inch
load plate (PN 11P4369) to remove a SAN384B from the cabinet. These instructions
are only for the actual physical removal of a chassis from a 2109-C36 cabinet. These
instructions assume that the SAN384B you are removing is fully shut down and
not connected to the fabric. The instructions can be used for moving a SAN384B to
a new location, or when replacing a defective chassis. See “Removing and
replacing a SAN384B chassis” on page 91 for complete steps required for shutting
down the system and removing components before removing the chassis from the
cabinet. If you are only relocating the chassis, you can skip the steps for removing
components.
1. Assemble the lift tool if it is not assembled. The assembly and disassembly
instructions are included with the lift tool. Additional instructions are also in
2. Remove the two screws holding each vertical cable management finger
assembly from the cabinet vertical rails, and remove the additional screw
securing the chassis to the cabinet rails.
3. Remove the chassis door from the chassis by grasping the door on both edges
and pulling straight out.
4. If any cables remain attached to the chassis, disconnect them.
5. If the chassis was factory installed in the cabinet, there may be additional
shipping brackets attached to the non-port (blower assembly) side of the
chassis, connecting the chassis to the cabinet rails. Remove the screws
attaching the L-brackets to the cabinet rails, and the screws attaching the
L-brackets to flat mounting plates that are connected to the sides of the
chassis.
6. Disconnect both power cords from the SAN384B if they are still attached.
7. Move the lift tool to a position near the rear of the cabinet.
8. Turn the winch crank clockwise to raise the load plate to a height slightly
below the exhaust kit shelf.
9. Turn the winch crank counterclockwise 1/4 turn to set the winch brake.
10. Set the lift tool wheel brake.
CAUTION:
A fully populated SAN384B weighs approximately 68 kg (150 lb) and
requires a minimum of two people and a lift tool to install it. (C011)
55 kg ( 121.2 lbs)
11. Release the spring-loaded pins under the load plate, and pull the middle
section of the load plate to the full extension. You may need to release the pin
closest to the cabinet to allow the middle section to fully extend. Make sure
the spring-loaded pin snaps back into place. The gap between the end of the
load plate middle section and the port side exhaust kit shelf should be no
more than 2.5 cm (1 in.). If the gap is larger than this, either the lift tool is not
positioned close enough to the cabinet, or the load plate middle section is not
fully extended. Adjust as needed.
12. Carefully slide the chassis from the cabinet onto the 24–inch load plate. Center
the chassis on the platform.
13. Release the spring-loaded pins under the load plate, and pull the middle
section of the load plate back into the load plate.
14. Install the retention straps to secure the chassis to the lift tool.
98 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
15. Release the lift tool wheel brake, and move the lift tool away from the cabinet.
16. Lower the load platform to its lowest position.
17. Use the lift tool to relocate the chassis to the desired location.
Installing the replacement chassis
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It takes
specially trained persons, a lifting device, or both to safely lift this
part or unit. (C011)
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
The following instructions require that the port-side exhaust kit is already installed.
If the rack does not have this shelf and exhaust duct installed, refer to “Installing
the port-side exhaust kit” on page 18 for complete instructions.
replacement chassis.
complete the installation of the replacement chassis. You can either install the
components into the new chassis”) before completing the chassis installation.
Note: If you anticipate that the replacement chassis may be shipped to a new
location while installed in the cabinet, it is recommended that you attach
the shipping brackets to any replacement chassis. These shipping
brackets consist of flat mounting plates that are attached to the sides of
the chassis at the blower assembly end, and L-brackets that attach to the
mounting plates and the cabinet vertical rails.
Installing components into the new chassis
handling components.
6. If ICL cables are not used, insert EMI plugs in the ICL sockets in the core
switch blades (CR4S-8).
Chapter 5. Removing and installing components 99
Download from Www.Somanuals.com. All Manuals Search And Download.
10. Connect the power cords to the power supplies and the power outlets.
The system performs a power-on self-test (POST). The POST takes a minimum
of three minutes and is complete when LED activity returns to standard state.
13. Verify that the SAN384B is powered on and POST is complete (all power LED
indicators on the port, control processor, and core switch blades should be a
steady green).
14. Verify that all components are functioning correctly by checking their LEDs. If
the LEDs do not indicate correct operation, try reinstalling the corresponding
component.
Downloading the configuration
Once the chassis and its various components have been reassembled and powered
back on, use the configDownload command to restore the original configuration.
The configDownload command can be entered through a Telnet or serial session,
but the SAN384B must have an Ethernet connection to the server name or IP of the
host for the download process to complete. For more information, refer to the help
configdownload command or the Fabric OS Command Reference Manual.
1. Log in to the SAN384B as admin:
switch:admin> login
login: admin
password: xxxxxxxx
switch:admin>
Note: If you are using the virtual fabric feature, you should run
configdownload -vf before running the configdownload command in
order to restore the logical switch configuration.
2. Enter configDownload -all command.
switch:admin> configdownload -all
Server Name or IP Address [host]: 123.123.123.123
User Name [None]: Admin24
File Name [config.txt]: config-switch.txt
Password: xxxxxxxx
download complete
switch:admin>
3. Reboot the SAN384B.
Verifying correct operation of system
1. Log in to the SAN384B as admin:
switch:admin> login
login: admin
password: xxxxxxxx
switch:admin>
2. Enter the slotShow -m command and verify that all the installed cards are
detected and that their status is operational (enabled).
switch:admin> slotShow -m
Slot Blade Type ID Model Name Status
--------------------------------------------
1
2
3
4
5
SW BLADE
UNKNOWN
CORE BLADE 46 CR4S-8
CP BLADE
CP BLADE
51 FC8-48
VACANT
ENABLED
ENABLED
ENABLED
ENABLED
50 CP8
50 CP8
100 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
6
7
8
CORE BLADE 46 CR4S-8
ENABLED
ENABLED
ENABLED
AP BLADE
SW BLADE
75 FX8-24
51 FC8-48
switch:admin>
3. Verify that the system is functioning correctly by entering switchShow or
switchStatusShow. The switchShow command displays the SAN384B and port
status information.
switch:admin> switchshow
switchName: switch
switchType: 62.1
switchState: Online
switchMode: Native
switchRole: Subordinate
switchDomain: 11
switchId: fffc0b
switchWwn: 10:00:00:05:1e:39:59:67
zoning: OFF
switchBeacon: OFF
blade3 Beacon: OFF
blade5 Beacon: OFF
blade8 Beacon: OFF
blade10Beacon: OFF
Index Slot Port Address Media Speed State
Proto
===========================================================
32
33
34
35
36
3
3
3
3
3
0
1
2
3
4
0b2000 id N4 Online L-Port 5 public
0b2100 __ N8 No_Module
0b2200 __ N8 No_Module
0b2300 __ N8 No_Module
0b2400 id N4 Online F-Port
10:00:00:00:c9:51:00:2d
37 0b2500 __ N8 No_Module
3
5
switch:admin>
4. Verify that all the IP address information is correct by entering ipAddrShow
and checking the results against the IP information recorded in the
“config-miscinfo.txt” file.
switch:admin> ipaddrshow
SWITCH
Ethernet IP Address: 10.32.50.12
Ethernet Subnetmask: 255.55.0.0
Fibre Channel IP Address: 1.2.3.4
Fibre Channel Subnetmask: 255.255.255.0
CP0
Ethernet IP Address: 10.32.50.10
Ethernet Subnetmask: 255.55.0.0
HostName : cp0
Gateway Address: 10.32.40.1
CP1
Ethernet IP Address: 10.32.50.11
Ethernet Subnetmask: 255.55.0.0
HostName : cp1
Gateway Address: 10.32.40.1
Backplane IP address of CP0 : 10.0.0.4
Backplane IP address of CP1 : 10.0.0.5
switch:admin>switch:admin>
Chapter 5. Removing and installing components 101
Download from Www.Somanuals.com. All Manuals Search And Download.
Reconnecting the system to the network and fabric
See the cable routing and port connection information recorded previously in
1. Connect the CP blades to the local area network:
a. Connect the appropriate Ethernet cables into each Ethernet port.
b. Connect the other ends to an Ethernet 10/100 Base-T LAN, if not already
connected.
Note: The SAN384B can be accessed by remote connection using any of the
available management tools, such as Telnet or Web Tools. Ensure that
the system is not modified using other connections during the rest of
this procedure.
2. Reconnect the transceivers and cables to the port blades:
Note: The ports and cables used in trunking groups must meet specific
requirements. For a list of these requirements, refer to the Fabric OS
Administrator’s Guide.
a. Position one of the transceivers so that the key is oriented correctly to the
port and insert the transceiver into the port until it is firmly seated and the
latching mechanism clicks.
b. Select the cable that corresponds to the port and position it so that the key
(the ridge on one side of the cable connector) is aligned with the slot in the
transceiver; then, insert the cable into the transceiver until the latching
mechanism clicks.
c. Repeat steps a and b for the remaining ports.
Attention: Do not route cables in front of the air exhaust vent (located on
the upper and lower port side of the chassis).
Verifying correct configuration of the fabric
Copying the command outputs from this section into a file is recommended.
1. Create an “after” SAN profile by entering the following commands and
copying the output to a text file named “SANafter.txt”:
v nsShow
v nsAllShow
v switchShow
v fabricShow
switch:admin> nsshow
Type Pid COS PortName NodeName TTL(sec)
N 020f00; 3;10:00:00:01:73:00:29:46;10:00:00:01:73:00:29:46; na
Fabric Port Name: 20:0f:00:60:69:90:03:f0
<output truncated>
switch:admin> nsallshow
{020f00 021fda 021fdc 021fe0 021fe15 Nx_Ports in the Fabric}
<output truncated>
switch:admin> switchshow
switchName: rsl8-st03-dcx-01
<output truncated>
switch:admin> fabricshow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
<output truncated>
102 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
switch:admin> lscfg --show
Created switches: 128(ds) 1 2(bs)
Port
----------------------------------------------------------------
FID 128 | 128 | 128 | 128 | 128 |
0
1
2
3
4
5
6
7
8
9
1
|
1
|
1
|
1
|
1
|
<output truncated>
switch:admin>
2. Determine any differences between the information in the “SANafter.txt” file
and the information in the “SANbefor.txt” file created earlier. In particular, look
for differences in the following:
v Device types
v Number of devices
v ISL and port states
v Number of switches in the fabric
3. Resolve any issues or unintentional changes to the SAN384B or fabric.
v If there are any mechanical problems, try reseating the associated component.
v If the configuration information is not correct for the system, modify as
required.
v If other issues exist, contact IBM Support
Chapter 5. Removing and installing components 103
Download from Www.Somanuals.com. All Manuals Search And Download.
Cable routing table template
|
|
table as needed, for the number of ports in the chassis.
Table 19. Cable routing table for SAN384B (64 ports shown)
|
|
Slot/Port
Slot
Cable labels
Switch end
Connected
device
Slot/Port of
device
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Port
0
Device end
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
104 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
|
Table 19. Cable routing table for SAN384B (64 ports shown) (continued)
|
|
Slot/Port
Slot
Cable labels
Switch end
Connected
device
Slot/Port of
device
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Port
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
Device end
|
|
Removing the battery
Local regulations may require removal of the battery before recycling or disposing
of the product. Follow these steps to remove the battery from the product:
1. Remove any installed modules.
2. Remove any installed power supplies.
3. Unscrew fasteners and remove any fan trays or fan assemblies.
4. Unscrew fasteners, unplug all connectors and remove any Printed Circuit Board
Assembly (PCBA) from the fan trays or fan assemblies.
Chapter 5. Removing and installing components 105
Download from Www.Somanuals.com. All Manuals Search And Download.
5. In the two control processor blade (CP8) assemblies, locate the central processor
PCBAs.
6. Go to the following locations and remove the two BR1225 batteries from each
a. XB1
b. XB
J1
J2
U1
U3
U11
U17
U19
U15
U23
TP6
GND
U21
U31
C12
C13
C14
C15
C16
C17
C18
C19
R74
R75
R76
R77
R78
R79
R80
R81
R82
R83
R84
R85
R86
R87
R88
R89
U6
U8
U9
TP2
GND
GND
TP4
U20
U22
U24
TP1
GND
U16
U4
U10
U7
U13
U30
U12
R65
R66
C7
U18
U57
U59
U62
U14
R67
R68
R69
R70
C8
C9
2
U38
C10
C1
R71
R72
R73
R137
U36
U65
1
1
3
J6
Q1
Q13
C20
U34
J15
C23
C24
R138
R139
R140
R141
J5
1
U40
1
2
C25
R142
R143
TP3
4
CP_SYNC
TP7
15
16
RN1
RN2
RN3
RN4
U42
R106
GND
U41
CO_PROC_DEBUG_SYNC
TP19
R170
R171
R172
R173
R174
R175
R176
R177
R178
R95
P/N
S/N
COO
U39
1
R96
U35
U37
J4
2
U63
U64
R126 R131
R152
U61
U60
U66
U58
U33
R158
R159
R160
100
U44
76
R161
R162
TP21
R102
R103
R100
R101
R252
TP9
U68
U71
J13
C21
R168
75
U43
1
2
U49
U107
R823 C22
U112
R104
R105
Q2
Q3
Q4
Q5
Q6
Q7
Q9
Q10
R2116
R363
R365
U67
R169
R343
R344
R345
R346
R347
R348
R349
R350
R351
R352
R362
R353
R354
R355
R356
R357
U52
U110
U114
GND
R317
R318
R319
R323
R366
R367
R368
TP25
U80
U81
TP26
R253
R263
R818
R819
R812
R369
U115
U116
L5
15
16
R227
U51
R370
R371
R372
25
26
U11
1
U200
R254
R81
1
U50
R330
TP15
C51
U53
R822 C62
C31
C32
C33
C34
R255
50
C48
R373
L6
R384
R385
R386
R387
R388
GND
PLD_CONN
26
U70
U73
R374
R375
R256
R324
1
C59
2
R257
P1V1_SENSE
TP28
CR1
CR2
R376
R377
R331
R
2
2
5
R
2
2
9
J3
C
7
2
C
7
3
R266
R298
R299
R300
R301
R302
R820
R821
TP27
C58
U118
C63
R325
R326
U119
R364
76
100
R378
R379
R380
R381
R258
R261
C52
J14
2
75
C66
C67
C68
C69
L7
R358
R359
9
1
C30
R262
C37
10
R264
C49
R382
R383
R360
R361
U137
U79
R329
R194
R265
R195
C38
9
0
1
J7
R231
R232
R196
R197
L3
C39
C40
R198
R199
R233
U72
25
26
U
1
3
9
U
1
3
3
U134
R234
R235
U78
TP13
R200
R201
R236
R238
R239
R240
26
50
GND
L1
C41
U74
U75
TP8
IN0_CONN
J22
R205
L2
U117
GND
1
2
C42
R241
R242
J21
U45
R202
C43
L9
1
2
RP1
R243
R244
R424
R425
U88
R41
1
J17
C80
U92
C86
C87
C81
C82
C83
R408
L8
R426
R428
R432
R433
R434
R435
U148
U93
9
10
13
14
C88
C89
TP36
D4
U48
R410
U145
U146
R436
C95
C90
R404
R405
C96
Y1
C1258
U47
R406
TP12
GND
R407
U87
USB_TP4
R
1
4
8
C
5
0
TP29
TP30
U84
U149
U89
USB_TP1
USB_TP3
D7
U82
U83
J20
TP33
TP34
R1991
R149
R150
R564
TP31
TP32
USB_TP2
U86
U150
J16
2
10
TP35
D5
U97
R391
R403
TP1
1
D1
Q8
Q18
1
9
U108
GND
C104
U95
U124
C61
TP14
GND
R626
R627
R570
TP75
J26
R568
C46
U125
TP40
TP18
GND
C119
R571
J24
GND
C100
U
1
4
0
U
1
3
6
C101
U104
R621
TP17
52
R569
GND
U141
U135
TP37
TP38
U153
U106
R573 C111
C112
U99
C97
TP10
R611
U100
L10
GND
R2466_1
J30
C121
J23
C115
4
R
5
7
4
R
5
7
5
1
C107
C108
C109
C110
C117
C118
Q21
C116
R572
U105
R592
R2467_1
1
1
C113
3
U103
TP39
R576
R2138
R578
R579
C120
9
0
1
Q28
Q19
Q20
R577
GND
C114
J39
R2212
J12
J25
C124
CR3
TP76
J27
D2
U175
1
4
TP16
U109
U176
GND
CR6
CR15
U181
A
C
E
C
1
Figure 50. Battery locations on the SAN384B
7. Recycle the four batteries as appropriate.
Refer to the Environmental Notices and User Guide shipped with the product for
more information on battery recycling and disposal.
106 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Chapter 6. Installing new features
any service or installation procedures.
The SAN384B can be upgraded with any of the following hot-pluggable features
while the SAN384B is operational. Refer to the individual feature installation
instructions for any possible exceptions.
Use this chapter as a starting point when installing new features on an existing
SAN384B. Specific installation procedures are linked from each feature code
installation on this page to the appropriate sections in the Chapter 5, “Removing
|
FC3816, FC3832, FC3848 - Installing a 8-Gb port blade (16, 32, or 48
ports)
These features can be installed while the SAN384B is operational.
Attention: Follow these precautions for all procedures in this section to avoid
damaging the port blades or chassis:
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
v Do not force the port blade installation. If the port blade does not slide in easily,
ensure that it is correctly aligned inside the rail guides before continuing.
Installing a port blade with incorrect alignment damages both the chassis and
the replacement part.
v Hold the port blade by the edges of the metal pan. Do not use the ejectors to
hold a port blade.
v Disassembling any part of a port blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the port blade.
These instructions cover installing a new FC3816, FC3832, or FC3848 in the
SAN384B chassis.
Time required
10 minutes or less per port blade
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Port blade
© Copyright IBM Corp. 2009, 2010
107
Download from Www.Somanuals.com. All Manuals Search And Download.
v Phillips screwdriver
v Small form factor pluggable (SFP) transceivers (as needed)
v Optical cables (as needed)
Procedures
Follow the links in the steps below to complete this installation:
1. Verify that the port blade is the correct part: 21R9996 for the 16-port blade,
21R9997 for the 32-port blade, and 21R9998 for the 48-port blade.
2. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs. Port
blades can be installed in any of the slots 1, 2, 7, or 8.
3. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades. If
the firmware is not at the latest level, obtain new code from the code download
website, and install it prior to installing the port blade. See “Fabric OS
firmware updates” on page 43 for instructions.
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
Attention: A filler panel should be removed only when being replaced with a
port blade or new filler panel. Any slot that is not occupied by a port blade
should be occupied by a filler panel to ensure correct cooling of the chassis and
protection from dust.
Because of port density, it may be easier to remove and install the SFPs while
the 32-port or 48-port blade is out of the chassis. However, you must handle
the blade carefully while it is out of the chassis to avoid damaging it.
42 for additional cabling instructions.
Attention: Do not route cables in front of the exhaust vent, which is located at
the top on the port side of the chassis.
8. Verify the installation. For information about how to check the status of
hardware components using the CLI, see the Fabric OS Administrator's Guide,
which is located on the product documentation CD.
108 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
| FC3864 - Installing an 8-Gb 64-port port blade
|
This feature can be installed while the SAN384B is operational.
|
|
Attention: Follow these precautions for all procedures in this section to avoid
damaging the port blades or chassis:
|
v Wear a grounded ESD strap when handling a port blade.
|
|
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
|
|
|
|
v Do not force the port blade installation. If the port blade does not slide in easily,
ensure that it is correctly aligned inside the rail guides before continuing.
Installing a port blade with incorrect alignment damages both the chassis and
the replacement part.
|
|
v Hold the port blade by the edges of the metal pan. Do not use the ejectors to
hold a port blade.
|
|
v Disassembling any part of a port blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the port blade.
|
|
Note: This 8-Gb 64-port blade (FC3864) cannot be installed in the same chassis as a
FCOE10-24 blade (FC3880)
|
These instructions cover installing a new FC3864 in the SAN384B chassis.
|
|
Time required
20 minutes or more per port blade due to port and cable density
|
|
|
|
|
|
|
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Port blade
v #2 Phillips screwdriver
v mSFP transceivers (as needed)
v OM-3 LC optical cables (as needed)
|
|
|
Procedures
Follow the links in the steps below to complete this installation:
1. Verify that the port blade is the correct part (45W7566)
|
|
|
|
|
3. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs. Port
blades can be installed in any of the slots 1, 2, 7, or 8.
|
|
|
|
|
4. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades.
If the firmware is not at the latest level, obtain new code from the code
download website, and install it prior to installing the port blade. See “Fabric
OS firmware updates” on page 43 for instructions.
|
|
|
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
Chapter 6. Installing new features 109
Download from Www.Somanuals.com. All Manuals Search And Download.
|
|
|
|
|
|
Attention: A filler panel should be removed only when being replaced with
a port blade or new filler panel. Any slot that is not occupied by a port blade
should be occupied by a filler panel to ensure correct cooling of the chassis
and protection from dust.
|
|
|
|
|
7. Remove any mSFPs that are pre-installed in the new FC8-64 blade and set
them aside for later installation. See “Removing and replacing an mSFP
optical transceiver” on page 83, paying particular attention to the notices to
avoid damaging the mSFP pull tabs or mSFPs.
|
|
|
|
|
|
|
|
|
|
|
Note: The FC8-64 high density port blade cannot use the standard LC cables
because the pitch between optics in the new mSFP transceiver is
smaller than in standard SFPs. Patch cables and panels can be used to
30 illustrates the mSFP to SFP patch cable. The mSFP transceivers are
used only with the FC8-64 port blade. Narrower OM-3 LC cables are
used to connect the FC8-64. These cables are offered by several major
manufacturers. Contact your IBM representative for options regarding
different cable and patch panel configurations to simplify cable
management with higher density FC8-64 port blades.
|
|
|
|
9. Insert an OM-3 (narrow) cable into an mSFP, and then insert the mSFP/cable
unit into a port. See “Removing and replacing an mSFP optical transceiver” on
page 83, paying particular attention to the notices to avoid damaging the
mSFP pull tabs, mSFPs and cables.
|
|
10. Repeat step 8 for each port in the FC8-64 blade, proceeding in a systematic
manner to avoid tangling the cables.
|
|
additional cabling instructions.
|
|
Attention: Do not route cables in front of the exhaust vent, which is located
at the top on the port side of the chassis.
|
|
|
|
system components,” on page 45). For information about how to check the
status of hardware components using the CLI, see the Fabric OS
Administrator's Guide, which is located on the product documentation CD.
|
|
110 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
FC3850 - Installing an FR4-18i routing blade
This feature can be installed while the SAN384B is operational.
Attention: Follow these precautions for all procedures in this section to avoid
damaging the blades or chassis:
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
v Do not force the blade installation. If the blade does not slide in easily, ensure
that it is correctly aligned inside the rail guides before continuing. Installing a
blade with incorrect alignment can damage both the chassis and the blade.
v Hold the blade by the edges of the metal pan. Do not use the ejectors to hold a
blade.
v Disassembling any part of a blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the blade.
These instructions cover installing a new FC3850 in the SAN384B chassis.
Time required
Approximately 20 minutes per blade
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Router blade
v Phillips screwdriver
v Small form factor pluggable (SFP) transceivers (as needed)
v Optical cables (as needed)
Procedures
Follow the links in the steps below to complete this installation
1. Verify that the routing blade is the correct part: 23R1645.
2. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs.
Routing blades can be installed in any of the slots 1, 2, 7, or 8.
3. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades.
If the firmware is not at the latest level, obtain new code from the code
download website, and install it prior to installing the port blade. See “Fabric
OS firmware updates” on page 43 for instructions.
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
page 67). Store the filler panel in a location for possible future use.
Chapter 6. Installing new features 111
Download from Www.Somanuals.com. All Manuals Search And Download.
Attention: A filler panel should be removed only when being replaced with
a blade or new filler panel. Any slot that is not occupied by a blade should be
occupied by a filler panel to ensure correct cooling of the chassis and
protection from dust.
protective strip from the blade contacts (if any) before installing the blade.
6. Repeat steps 1-5 for the second routing blade, if any.
7. Configure the routing blade. Configuration instructions are provided in the
Fabric OS Administrator's Guide in the "Using the FC-FC Routing Service"
chapter.
the proper operation of the blade.
42 for additional cabling instructions.
Attention: Do not route cables in front of the exhaust vent, which is located
at the top on the port side of the chassis.
10. Verify the installation. For information about how to check the status of
hardware components using the CLI, see the Fabric OS Administrator's Guide,
which is located on the product documentation CD.
FC3870 - Installing an FC10-6 10 Gb blade
This feature can be installed while the SAN384B is operational.
Attention: Follow these precautions for all procedures in this section to avoid
damaging the port blades or chassis:
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
v Do not force the port blade installation. If the port blade does not slide in easily,
ensure that it is correctly aligned inside the rail guides before continuing.
Installing a port blade with incorrect alignment damages both the chassis and
the replacement part.
v Hold the port blade by the edges of the metal pan. Do not use the ejectors to
hold a port blade.
v Disassembling any part of a port blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the port blade.
Time required
Less than 20 minutes.
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Port blade
v Phillips screwdriver
v XFP transceivers (as needed)
v Optical cables (as needed)
112 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Procedures
Follow the links in the steps below to complete this installation.
1. Verify that the port blade is the correct part: 17P9637.
2. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs. Port
blades can be installed in any of the slots 1, 2, 7, or 8.
3. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades. If
the firmware is not at the latest level, obtain new code from the code download
website, and install it prior to installing the port blade. See “Fabric OS
firmware updates” on page 43 for instructions.
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
Attention: A filler panel should be removed only when being replaced with a
port blade or new filler panel. Any slot that is not occupied by a port blade
should be occupied by a filler panel to ensure correct cooling of the chassis and
protection from dust.
strip from the blade contacts (if any) before installing the blade.
6. Repeat steps 1-5 for additional blades, if any.
the proper operation of the blade.
42 for additional cabling instructions.
Attention: Do not route cables in front of the exhaust vent, which is located at
the top on the port side of the chassis.
9. Verify the installation. For information about how to check the status of
hardware components using the CLI, see the Fabric OS Administrator's Guide,
which is located on the product documentation CD.
Chapter 6. Installing new features 113
Download from Www.Somanuals.com. All Manuals Search And Download.
FC3880 - Installing an FCOE10-24 blade
This feature can be installed while the SAN384B is operational.
Attention: Follow these precautions for all procedures in this section to avoid
damaging the port blades or chassis:
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
v Do not force the port blade installation. If the port blade does not slide in easily,
ensure that it is correctly aligned inside the rail guides before continuing.
Installing a port blade with incorrect alignment damages both the chassis and
the replacement part.
v Hold the port blade by the edges of the metal pan. Do not use the ejectors to
hold a port blade.
v Disassembling any part of a port blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the port blade.
Time required
Less than 20 minutes.
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Port blade
v Phillips screwdriver
v SFP+ transceivers (as needed)
v Optical cables (as needed)
Procedures
Follow the links in the steps below to complete this installation.
1. Verify that the blade is the correct part.
2. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs. Port
blades can be installed in any of the slots 1, 2, 7, or 8.
3. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades. If
the firmware is not at the latest level, obtain new code from the code download
website, and install it prior to installing the port blade. See “Fabric OS
firmware updates” on page 43 for instructions.
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
114 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Attention: A filler panel should be removed only when being replaced with a
port blade or new filler panel. Any slot that is not occupied by a port blade
should be occupied by a filler panel to ensure correct cooling of the chassis and
protection from dust.
strip from the blade contacts (if any) before installing the blade.
6. Repeat steps 1-5 for additional blades, if any.
and confirm the proper operation of the blade.
42 for additional cabling instructions.
Attention: Do not route cables in front of the exhaust vent, which is located at
the top on the port side of the chassis.
9. Verify the installation. For information about how to check the status of
hardware components using the CLI, see the Fabric OS Administrator's Guide,
which is located on the product documentation CD.
FC3890 - Installing an FX8-24 extension blade
This feature can be installed while the SAN384B is operational.
Attention: Follow these precautions for all procedures in this section to avoid
damaging the port blades or chassis:
v Carefully remove the protective strip (if any) covering the blade connectors
before installing any blades.
v Do not force the port blade installation. If the port blade does not slide in easily,
ensure that it is correctly aligned inside the rail guides before continuing.
Installing a port blade with incorrect alignment damages both the chassis and
the replacement part.
v Hold the port blade by the edges of the metal pan. Do not use the ejectors to
hold a port blade.
v Disassembling any part of a port blade voids the part warranty and regulatory
certifications. There are no user-serviceable parts inside the port blade.
Time required
Less than 20 minutes.
Items required
v ESD (electrostatic discharge) grounding strap
v Workstation computer
v Port blade
v Phillips screwdriver
v Transceivers (as needed)
v Optical cables (as needed)
Procedures
Follow the links in the steps below to complete this installation.
1. Verify that the blade is the correct part.
Chapter 6. Installing new features 115
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Verify which slot to install the blade. Slots are numbered from one through
eight, from bottom to top, when facing the port side of the SAN384Bs. Port
blades can be installed in any of the slots 1, 2, 7, or 8.
3. We recommend having the latest firmware version on the CP blade. The
firmware version should match on both the active and the backup CP blades. If
the firmware is not at the latest level, obtain new code from the code download
website, and install it prior to installing the port blade. See “Fabric OS
firmware updates” on page 43 for instructions.
Note: Firmware downloads require that Ethernet connections be made to both
CP blades. Procedures for downloading and installing firmware are
described in the Fabric OS Administrator's Guide.
Attention: A filler panel should be removed only when being replaced with a
port blade or new filler panel. Any slot that is not occupied by a port blade
should be occupied by a filler panel to ensure correct cooling of the chassis and
protection from dust.
strip from the blade contacts (if any) before installing the blade.
6. Repeat steps 1-5 for additional blades, if any.
and confirm the proper operation of the blade.
42 for additional cabling instructions.
Attention: Do not route cables in front of the exhaust vent, which is located at
the top on the port side of the chassis.
9. Verify the installation. For information about how to check the status of
hardware components using the CLI, see the Fabric OS Administrator's Guide,
which is located on the product documentation CD.
FC7870 - Installing an inter-chassis cable kit
This feature can be installed while the SAN384B is operational.
Time required
Less than 10 minutes, not including installation of the ICL license or any needed
configuration.
Items required
v Inter-chassis link kit (includes two ICL cables)
v FC 7883 (ICL license) is required for each chassis that you are connecting.
Instructions for installation are included with that license feature.
Procedures
Attention: If ICL cables are not in use, the ports must have EMI plugs installed to
meet EMI and other regulatory certifications.
Follow the links in the steps below to complete this installation.
1. Verify that the inter-chassis link kit is the correct part: 21R9976. The cable PN is
21R9959.
116 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
2. Verify with the customer that the ICL license is installed on each chassis to be
connected. Enter the licenseIdShow command for each chassis. If required,
install the ICL license, following the instructions included with the license.
4. Determine the cable routing and ICL sockets on the core switch blades that you
Figure 46 on page 88 for two possible valid options.
5. Remove the EMI plugs from the ICL sockets that you will be connecting. Save
the EMI plugs for possible future use.
8. Enable the inter-chassis links. See the iclCfg section in the Fabric OS Command
Reference Manual for CLI command options.
Chapter 6. Installing new features 117
Download from Www.Somanuals.com. All Manuals Search And Download.
118 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Appendix A. Product specifications
This appendix provides product specifications for the SAN384B.
General specifications
Table 20. General product specifications
Specification
Description
Configurable port
types
F_Port, FL_Port, E_Port, VEX_Port, VE_Port, EX_Port, and M_Port
System architecture Nonblocking shared memory
System processor
FreeScale 8548, 1.2 GHz
ANSI Fibre
FC-PH (Fibre Channel Physical and Signalling Interface standard)
Channel protocol
Modes of operation Fibre Channel Class 2, Class 3, and Class F
Fabric initialization Complies with FC-SW 5.0
FC-IP (IP over Fibre Complies with FC-IP 2.3 of the FCA profile
Channel)
|
Aggregate I/O
bandwidth
2 Tbps per chassis (fully populated with four FC8-64 blades)
Port to port latency Less than 2 microseconds with no contention (destination port is free)
Routing capacity
A minimum aggregate routing capacity of four million frames per
second (for Class 2, Class 3, and Class F frames in a 64-port switch)
System architecture
Table 21. System architecture
|
Fibre Channel Ports
Up to 256 ports, universal (E_Port, F_Port, FL_port,
Ex_Port, and M_Port)
Control Processor
Scalability
Redundant (active/standby) control processor modules
Full fabric architecture: 239 switches maximum
© Copyright IBM Corp. 2009, 2010
119
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 21. System architecture (continued)
Performance
1.063 Gbps line speed, full duplex
2.125 Gbps line speed, full duplex
4.25 Gbps line speed, full duplex
8.50 Gbps line speed, full duplex
10.51875 Gbps line speed, full duplex (with FC10-6
blade)
Autosensing of 1, 2, 4, and 8 Gbps port speeds
optionally programmable to fixed port speed, speed
matching between 1, 2, 4, and 8 Gbps port speeds. Range
depends on use of 4 Gbps or 8 Gbps SFPs.
ISL Trunking
Can use up to 8 ports in a trunk group to form a 64
Gbps trunk
Aggregate bandwidth
Switch latency
3 Tbps per chassis
FC8-16, FC8-32, FC8-48, FC8-64 blades:
<2.1 msec any port to any port at 8 Gbps, cut-through
routing.
For the FR4-18i blade:
<3.6 msec any port to any port at 4 Gbps, cut-through
routing.
For the FX8-24 blade:
|
|
<2.1 msec any port to any port at 8 Gbps, cut-through
routing.
|
|
|
For the FCOE10-24 blade: CEE to CEE (different ASIC)
and FCoE to FC: <5 msec any port to any port at 10
Gbps, cut-through routing.
Maximum frame size
Frame buffers
2112-byte payload
2048 per ASIC, dynamically allocated.
Class 2, Class 3, Class F (interswitch frames)
Classes of service
120 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 21. System architecture (continued)
Port types
FC8-16 and FC8-32 support these port types:
FL_Port, F_Port, E_Port, and M_Port
FC8-48 supports these port types:
E_Port, F_Port, and M_Port
|
|
FC8-64 supports these port types:
F_Port, FL_Port, E_Port, Ex_Port, and M_Port
FC10-6 supports these port types:
E_Port and M_Port
FR4-18i supports these port types:
FL_Port, F_Port, E_Ports, M_Port, VE_Port, EX_Port, and
VEX_Port
FX8-24 supports these port types:
F_Port, FL_Port, E_Port, and Ex_Port on FC
VE_Port on GbE
FCOE10-24 supports these port types:
VF_Port
Note: Self-discovery is based on switch type (U_Port)
with an optional port type control.
Data traffic types
Media types
Fabric switches supporting unicast, multicast (255
groups), and broadcast
Note: Brocade-branded SFPs are required on this
product.For a listing of SFPs and XFPs compatible with
this product:
v Select the SAN384B product link
v On the SAN384B product page, click the
Interoperability Matrix link.
v In the Interoperability matrix, click the Transceivers
link.
Fabric services
Access Control Lists (ACLs); Advanced Performance
Monitoring; Adaptive Networking (Ingress Rate
Limiting, Traffic Isolation, QoS); auditing; BB credit
recovery; Brocade Advanced Zoning (default zoning,
port/WWN zoning, broadcast zoning); Dynamic Path
Selection (DPS); End-to-End Performance monitoring;
Extended Fabrics; Fabric Watch; FDMI; FICON CUP;
Frame Redirection; FSPF; Integrated Routing (FR4-18i
SAN Extension blade not required for routing); IPFC; ISL
Trunking; Management Server; N_Port Trunking; NPIV;
NTP v3; Port Fencing; RASlog; Registered State Change
Notification (RSCN); Reliable Commit Service (RCS);
Simple Name Server (SNS); syslog; Top Talkers; Virtual
Fabrics (Logical Switch, Logical Fabric); Web Tools
Inter-chassis linking (ICL)
Chassis-to-chassis linkage through connectors on the core
switch blade (CR4S-8)
Appendix A. Product specifications 121
Download from Www.Somanuals.com. All Manuals Search And Download.
System size and weights
The weight of the SAN384B can vary considerably depending on the combination
system with your combination of port and application blades.
Table 22. System sizes and weights
System specification
Width
Size and weight
43.74 cm (17.22 in.)
Height
35.6 cm (14 in., 8U);
40 cm (15.75 in., 9U) with the port-side
exhaust kit
|
Depth (without door)
Depth (with door)
61.29 cm (24.13 in.)
73.20 cm (28.82 in.)
68 kg (150 lb.)
|
|
SAN384B: 256-port configuration with four
FC8-64 port blades
Empty chassis:
v No blades
25.76 kg (56.8 lb.)
v No CPs
v No CRs
v No power supplies
v No fan assemblies
System blade and FRU weights
Table 23. System FRU weights
FRU
Weight
CP blade (CP8)
3.0 kg (6.6 lb)
CR blade (CR4S-8)
FC8-16 port blade
FC8-32 port blade
FC8-48 port blade
FC8-64 port blade
FC10-6 port blade
FR4-18i routing blade
FX8-24 extension blade
FCOE10-24 FCoE blade
Port card filler panel
Power supply
3.27 kg (7.2 lb)
3.0 kg (6.6 lb) without media
3.27 kg (7.2 lb) without media
3.36 kg (7.4 lb) without media
3.36 kg (7.4 lb) without media
3.1 kg (6.8 lb) without media
3.36 kg (7.4 lb) without media
4.2 kg (9.2 lb) without media
3.72 kg (8.2 lb) without media
1.5 kg (3.2 lb)
|
2.45 kg (5.4 lb)
Blower assembly
WWN bezel and cards
5.73 kg (12.6 lb)
0.3 kg (0.6 lb)
Vertical cable management finger assembly
(2)
0.45 kg (1.0 lb.)
Chassis door
2.09 kg (4.6 lb.)
122 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Facility requirements
The facility where the SAN384B is in use must meet the following requirements to
provide for correct operation:
v Adequate supply circuit, line fusing, and wire size, as specified by the electrical
rating on the chassis nameplate
v An air flow of at least 425 cubic meters per hour (250 cubic feet per minute),
available in the immediate vicinity of the SAN384B
v If the SAN384B will be installed in an EIA rack, ensure the following:
– All equipment installed in the rack has a reliable branch circuit ground
connection, and does not rely on a connection to a branch circuit, such as a
power strip.
– The rack is balanced and mechanically secured to provide stability in the
event of an earthquake.
– Additional equipment does not exceed the rack's weight limits.
Environmental requirements
requirements for non-operating conditions are also provided for acceptable storage
and transportation environments.
CAUTION:
For CA residents only: IBM recommends installing this product in a room size
of 2190 cubic feet (62 cubic meters) or larger at 0.4 ACH ventilation rate to
reduce the concentrations of any chemicals emitted by the product.
Table 24. Environmental requirements
Acceptable range during
operation
Acceptable range during
nonoperation
Condition
Ambient temperature
10° to 40° C outside switch
(50° to 104° F)
-40° to +70° C outside switch
(-40° to 158° F)
Humidity
5% to 85% RH
10% to 93% RH
noncondensing, at 70°
Celsius
noncondensing, at 40°
Celsius, with maximum
gradient of 10% per hour
Altitude
Shock
Up to 3 km (10,000 ft.) above 0 to 12 km (40,000 ft.) above
sea level sea level
20G, 6ms duration, half-sine 33G, 11ms duration, half-sine
wave
wave
Vibration
0.5G p-p, 5-500 Hz at 1.0
octave/minute
2.0G p-p, 5-500 Hz at 1.0
octave/minute
Air flow
425 cu m/hr (250 cu ft/min) None required
|
|
Heat dissipation
753 Watts or 2570 BTU/hr
(192 port configuration)
Not applicable.
Note: The 10° to 40° Celsius range applies to the ambient air temperature at the air
intake vents on the nonport side of the SAN384B. The temperature inside
the SAN384B can be up to 75° Celsius during SAN384B operation. If the
Appendix A. Product specifications 123
Download from Www.Somanuals.com. All Manuals Search And Download.
internal temperature range exceeds the operating ranges of the components,
the LEDs, error messages, and Fabric Watch alerts will indicate a problem.
Use the tempShow command or Fabric Watch commands to view
temperature status.
Fibre channel port specifications
The Fibre channel ports in the SAN384B support full duplex link speeds at
10.51875, 8.50, 4.25, 2.125, or 1.0625 Gbps inbound and outbound, automatically
negotiating to the highest common speed of all devices connected to the port.
|
|
|
|
|
The ports are compatible with optical SWL (short wavelength: approximately 850
nm), optical LWL (long wavelength: approximately 1310 nm), and Extended Long
Wavelength (ELWL) laser transmitter SFPs, SFP+, mSFP (FC8-64 only), and XFPs
(FC10-6 only) (approximately 1550 nm). The strength of the signal is determined by
the type of SFP, SFP+, mSFP or XFP in use. mSFPs support only SWL.
The ports are universal and self-configuring, capable of becoming F_Ports (fabric
ports), FL_Ports (fabric loop enabled), or E_Ports (expansion ports).
The ports meet all required safety standards.
Power specifications
DANGER
Multiple power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages,
disconnect all power cords. (L003)
The power subsystem is a redundant +48V DC power distribution system with a
provision for up to two 2000-watt, 48V DC bulk power supplies. Two bulk power
supplies produce the intermediate distribution voltage in the distributed power
system.
with two power supplies, four FC8-64 port blades, two CP8 blades, two CR4S-8
blades, and two blower assemblies. The use of application blades will consume
additional power.
|
Table 25. Power specifications
Specification
Value
Voltage
Range: 85 - 264 VAC Auto-volt, Nominal:
100 to 240 VAC (auto-sensing)
Power supply output (each)
Low line (85- 132 VAC), 1000W; High line
(180 - 264 VAC), 2000W
Input frequency range
AC inrush
Range: 47-63 Hz; Nominal: 50 - 60 Hz
Maximum 20A peak
124 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 25. Power specifications (continued)
Specification
Value
System power consumption
AC power consumption is
configuration-specific. A system with four
FC8-48 port blades (loaded with 1W SFPs),
two CP8 blades, two CR4S-8 blades, and
two blower assemblies consumes 841W.
Data transmission ranges
speeds.
Note: The full range of 1, 2, 4, 8, and 10 Gbps can only be achieved by a
combination of 4 Gbps SFPs (1, 2, and 4 Gbps), 8 Gbps SFP+ (2, 4, and 8
Gbps), and 10 Gbps XFP transceivers.
Table 26. Supported optics, speeds, cables, and distances
Single Mode
Media
Maximum
Distance
Multi-Mode Media Maximum Distance
Transceiver
type
62.5 microns
(OM1)
50 microns
(OM2)
50 microns
(OM3)
Form factor
Speed
1 Gbps
2 Gbps
9 microns
SWL
SFP
300 m (984 ft.) 500 m (1640 ft.) 860 m (2821 ft.) N/A
150 m (492 ft.) 300 m (984 ft.) 500 m (1640 ft.) N/A
|
|
|
mSFP/SFP/
SFP+
mSFP/SFP/
SFP+
4 Gbps
70 m (229 ft.)
150 m (492 ft.) 380 m (1264 ft.) N/A
mSFP/SFP+
XFP
8 Gbps
10 Gbps
2 Gbps
21 m (68 ft.)
N/A
50 m (164 ft.)
N/A
150 m (492 ft.) N/A
300 m (984 ft.) N/A
LWL
SFP
N/A
N/A
N/A
30 km (18.6
mi)
SFP
4 Gbps
N/A
N/A
N/A
30 km (18.6
mi)
SFP+
XFP
XFP
8 Gbps
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
10 Gbps
10 Gbps
10 km (6.2 mi)
ELWL
40 km (24.8
mi)
Greater distances can be achieved with the addition of the optional Extended
Fabrics software.
FR4-18i routing blade port specifications
Fibre Channel port specifications
The Fibre Channel ports in the FR4-18i routing blade are compatible with SWL,
LWL, and ELWL SFP transceivers. The strength of the signal is determined by the
Appendix A. Product specifications 125
Download from Www.Somanuals.com. All Manuals Search And Download.
type of transceiver in use. The ports meet all required safety standards. The ports
are capable of operating at 1-, 2-, or 4-Gbps and are able to auto-negotiate to the
maximum link speed.
GbE port specifications
The GbE ports in the FR4-18i routing blade are compatible with SWL, LWL, and
ELWL SFP transceivers. A copper 1 GbE SFP is also available for this blade. The
strength of the signal is determined by the type of transceiver in use. The GbE
ports are capable of operating at 1 Gbps. The eight virtual FCIP Fibre Channel
links over each physical GbE connection share this bandwidth.
Power cords
Two power cords for connecting between the SAN384B and the power distribution
units on the 2109 C36 cabinet are shipped with the product. See the IBM
TotalStorage SAN Cabinet 2109 Model C36 Installation and Service Guide for
information on connecting the cabinet to the facility power source. If the
stand-alone feature is ordered for the SAN384B, then you must also order the
country-specific power cords.
126 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Appendix B. Application blades
This appendix contains specification information about optional application blades
FR4-18i blade
The FR4-18i blade has 16 physical Fibre Channel SFP ports supporting the Fibre
Channel Routing Services, and two physical Gigabit Ethernet (GbE) SFP ports
supporting the Fibre Channel Over IP (FCIP) feature. It operates with the Fabric
Operating System and can communicate with another FR4-18i or a SAN04B–R for
both Fibre Channel Routing services and FCIP.
The FR4-18i blade is intended as a platform for Fibre Channel Routing Services
and FCIP. Refer to the Fabric OS Administrator’s Guide for information on
configuring these features.
The FR4-18i blade provides the following features:
v 16 Fibre Channel SFP ports supporting the Fibre Channel Routing Services with
link speeds up to 1, 2, or 4 Gbps.
v 2 GbE ports supporting the FCIP and Fibre Channel Routing Services with fixed
link speed at 1 Gbps:
– Each GbE port can support up to eight FCIP tunnels.
– Each FCIP tunnel is represented and managed as a virtual Fibre Channel
E_Port.
– Fibre Channel Routing Services can be used over the FCIP link.
– Fabrics connected through FCIP merge if the ports are configured as
VE_Ports, and do not merge if they are configured as VEX_Ports. If VE_Ports
are used in a Fibre Channel Routing Services backbone fabric configuration,
then the backbone fabric merges, but the EX_Port-attached edge fabrics do
not merge. For more information refer to the Fabric OS Administrator’s Guide.
FX8-24 blade
The FX8-24 blade has 12 external Fibre Channel (FC) SFP ports supporting the
Fibre Channel Routing Services and 10 external 1 Gigabit Ethernet (GbE or GE)
SFP ports supporting the Fibre Channel Over IP (FCIP) feature. There are also 2
licensable external 10 Gigabit Ethernet (10GbE or 10GE) SFP ports supporting FCIP.
It operates with the Fabric Operating System and can communicate with another
FX8-24 or a SAN06B-R for both Fibre Channel Routing Services and FCIP. The GbE
ports on the FX8-24 are not compatible with the GbE ports on the FR4-18i blade or
the SAN04B–R switch.
Note: The port diagram on the front panel of the blade uses the abbreviations GE
for 1 GbE and 10GE for 10 GbE ports.
The FX8-24 operates in one of three modes: 1) ten 1 GbE ports, 2) ten 1GbE ports
and one 10 GbE port, or 3) two 10 GbE ports depending on licensing and
subsequent configuration of GbE port mode. If operating in 10GbE mode the other
end of the circuit must also be an FX8-24 operating in either 10GbE mode or dual
mode with the corresponding VE_ports in 10GbE mode.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
127
The FX8-24 blade is intended as a platform for FCIP and Fibre Channel Routing
Services. Refer to the Fabric OS Administrator’s Guide for information on configuring
these features. The FX8-24 blade provides the following hardware features:
v 12 autosensing FC ports with link speeds of 1, 2, 4 or 8 Gbps
v Ten GbE ports supporting FCIP with fixed link speed at 1 Gbps
v Two 10 GbE ports (licensable) supporting FCIP with fixed link speed at 10 Gbps
The FX8-24 blade also provides the following functionality features:
v FCIP
v Compression (on FC frames before FCIP encapsulation)
v FC Routing (licensable)
v FCIP Trunking (licensable) with network-based failure recovery (failover only)
and load balancing
v Multiple circuits per trunk
– Four per trunk through the GbE ports
– Ten per trunk through the 10 GbE ports
v SO-TCP with reorder resistance
v FastWrite over FCIP
v Tape pipelining over FCIP
v FICON XRC emulation and tape pipelining over FCIP (licensable)
v FICON CUP (licensable)
v Virtual E_ports
v FCIP QoS
v Support for 200 ms RTT (on a limited number of GbE ports)
v Adaptive Rate Limiting (licensable)
v TCP performance graphing in Web Tools
v FCIP Tunnels
– A maximum of 10 FCIP Tunnels for all GbE ports
– Four tunnels maximum per GbE port
– Two 10 GbE ports can support up to ten FCIP tunnels each
– Each FCIP tunnel is represented and managed as a virtual Fibre Channel
E_Port
– Fibre Channel Routing Services can be used over the FCIP link
– Fabrics connected through FCIP merge if the ports are configured as
VE_Ports, and do not merge if they are configured as VEX_Ports. If VE_Ports
are used in a Fibre Channel Routing Services backbone fabric configuration,
then the backbone fabric merges, but the EX_Port-attached edge fabrics do
not merge. For more information refer to the Fabric OS Administrator's Guide.
v Up to three FC trunking groups. The three groups are defined as:
– Trunk group 0: FC ports 0, 1
– Trunk group 1: FC ports 6, 7
– Trunk group 2: FC ports 2, 3, 4, 5, 8, 9, 10, 11
128 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
FCOE10-24 blade
The FCOE10-24 blade has 24 Fibre Channel over Ethernet (FCoE) ports that enable
the transmission of FC frames over an Ethernet network via encapsulation in
standard Ethernet packets. This is enabled by adherence to Converged Enhanced
Ethernet (CEE) standards, a low latency, lossless Ethernet standard. This does not
require dedicated Ethernet lines, but rather can make use of existing Ethernet
infrastructure to reduce costs.
|
|
Attention: This blade cannot be used in the same chassis with an FC8-64 port
blade or the FR4-18i or FX8-24 application blades.
There are no licensing requirements for functionality on this blade. Refer to the
Fabric OS Administrator's Guide for information on configuring these features.
|
The FCOE10-24 blade supports only optical cabling and transceivers (SFP+). The
FCOE10-24 blade provides the following hardware features:
v 24 FCoE ports operating at 10 Gbps
v 32 FC ports operating at 8 Gbps through the backplane
v Hot pluggable
v I2C Management interface through the backplane
v JTAG support
v Blade power and status LEDs
v Link status LEDs per port
The FCOE10-24 blade also provides the following functionality features:
v FCoE switching
v CEE switching
|
|
v Layer 2 Ethernet protocols STP/MSTP/RSTP, 802.1q, and Link Aggregation
(802.1ad)
v Standard Ethernet encapsulation
v End of row deployment
|
|
Refer to the Fabric OS Administrator’s Guide for information on configuring these
features.
Appendix B. Application blades 129
Download from Www.Somanuals.com. All Manuals Search And Download.
130 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Appendix C. Diagnostics and troubleshooting
For information about troubleshooting the entire fabric, refer to the Fabric OS
Troubleshooting and Diagnostics Guide.
The SAN384B includes a number of diagnostic tools to assist with troubleshooting,
including LEDs on the hardware, commands that display current status, diagnostic
tests for hardware and software, and error messages. In addition, a number of
managing and monitoring features are available, such as Fabric Manager, Web
Tools, Fabric Watch, and Advanced Performance Monitoring.
If the SAN384B does not operate as expected, the following steps can be taken to
diagnose the problem:
components,” on page 45) for interpretation and recommended actions.
v Review the error logs (refer to the Fabric OS Messages Reference and the Fabric OS
Administrator's Guide for more information).
v Enter the sensorShow command to determine the status of the hardware
components.
If the problem is still unresolved after these steps, contact technical support. The
information required by technical support in order to provide assistance is listed
This appendix provides the following information:
Obtaining chassis and component status
environmental information about the chassis and its components. These commands
provide information only, and they do not interrupt traffic flow. For more
information about these commands, refer to the Fabric OS Command Reference.
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
131
Table 27. Environmental status and maintenance commands
Command
Information Displayed
sensorShow
Temperature readings for the port blades
Temperature readings for the CP blades
Status and RPM of all operational fans
Status of all operational power supplies
Temperature readings for the port blades
Temperature readings for the CP blades
Status of all operational power supplies
Status and RPM of all operational fans
tempShow
psShow
fanShow
chassisShow
Serial number, time awake, and additional
information about each component
slotShow
Slot occupancy
errShow, errDump
System error log. Refer to the Fabric OS
Message Reference for more information on
the messages in this log.
Interpreting POST and boot results
The SAN384B performs power on self test (POST) by default each time the system
is powered on, rebooted, or reset. The system can be rebooted using the reboot (to
reboot each CP individually), or fastBoot commands. The fastBoot command
reboots the SAN384B without running POST. If the active CP blade is rebooted, it
fails over to the standby CP blade.
POST
To verify that POST has completed without error:
v Verify that all LEDs return to a normal state after POST completes (see
If one or more LEDs do not return to a normal state, and this is not due to the
SAN384B being set to beacon, refer to the relevant LED table to identify and
correct the problem. For port blades, router blades, and CP blades, the slotShow
command can be used to check the status of the slots. For information about
turning beaconing on/off, refer to the Fabric OS Administrator's Guide.
v Verify that the switch prompt displays when POST completes.
If it does not display, POST was not successfully completed. Contact IBM for
support.
v Review the system error log using the errShow or errDump commands.
v Any errors detected during POST are written to the system log, which is
accessible through the errShow command. For information about error
messages, refer to the Fabric OS Message Reference.
POST includes the following steps:
1. Preliminary POST diagnostics are run.
2. Operating system is initialized.
3. Hardware is initialized.
132 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
4. Diagnostic tests are run on several functions, including circuitry, port
functionality, ability to send and receive frames, all aspects of memory, parity,
statistics counters, and serialization.
Boot
In addition to POST, boot includes the following steps after POST is complete:
1. Universal port configuration is performed.
2. Links are initialized.
3. Fabric is analyzed. If any ports are connected to other switches, the SAN384B
participates in a fabric configuration.
4. The SAN384B obtains a domain ID and assigns port addresses.
5. Unicast routing tables are constructed.
6. Normal port operation is enabled.
Diagnostics
Diagnostic tests are automatically run during POST to check the status of the
SAN384B. Any error messages generated during POST are sent to the error logs
and to the serial console, if connected.
Diagnostic tests can also be run manually to test and troubleshoot the hardware
and the firmware, including internal connections and circuitry, transceivers, and
port cables. However, diagnostic tests are generally intended for use by support
personnel.
Note: Error messages do not necessarily indicate that the SAN384B requires
maintenance.
Each diagnostic test can be implemented by entering the related command through
a Telnet or serial session. For a list of diagnostic tests and commands, refer to the
Fabric OS Command Reference Manual and the Fabric OS Administrator's Guide.
All diagnostic tests are run at link speeds of 1, 2, 4, and 8 Gbps. They might
temporarily lock the transmit and receive speeds to a specific speed. Some
diagnostic tests require interconnecting the ports to each other or using loopback
plugs. If ports are interconnected, the media (cables and transceivers) at each end
of the connection must be of the same type. For example, short wavelength media
must be connected to short wavelength media, and likewise with long wavelength
media and copper media.
For more information about diagnostic tests and how to run them, refer to the
Fabric OS Administrator's Guide and the Fabric OS Command Reference Manual. For
information about diagnostic error messages (errShow or errDump), refer to the
Fabric OS Message Reference Manual.
Troubleshooting
Table 28. Troubleshooting
Issue
Possible Cause
Recommended Action
Entire chassis powers off
automatically.
Power supplies are inadequate to
support the installed components.
Add an additional power supply.
Appendix C. Diagnostics and troubleshooting 133
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 28. Troubleshooting (continued)
Several or all components One or both power cables may not Ensure that both power cables are connected to
are not operating.
be connected to a live source.
live outlets.
One or both AC power switches
might be off.
Ensure that both AC power switches are on (AC
switches light up green when on).
Serial connection is faulty Serial cable is not connected
Ensure that the cable is firmly connected to
workstation computer and to the SAN384B.
or serial port logs have
incorrect or missing
information.
correctly.
Terminal emulator application
parameters are not set correctly.
Ensure that the terminal emulator application is
configured as follows: 9600 bits per second, 8
databits, no parity, 1 stop bit, no flow control.
Serial port might be incompatible Ensure that the SAN384B is connected to an
(only RS–232 is supported).
RS–232 port. RS–423 serial ports might experience
difficulties due to corner-case incompatibilities of
the standards.
Pins on the serial cable or serial
port might be damaged.
Remove the cable and inspect the pins on the cable
and in the serial port. Do not reinstall if the pins
on either component have any visible damage, as
this could damage the pins on the other
component. Replace components as required.
CP Ethernet link speed is
There might be a conflict with the Specify the CP Ethernet link speed by entering the
different than expected or CP Ethernet link speed negotiation ifModeSet command.
a link cannot be
established.
set up by the network.
Configuration data is
inaccurate or cannot be
accessed.
Chassis was powered off/on while Install an operational WWN card and power the
the WWN card was uninstalled or system off/on again.
failed.
The SAN384B was rebooted while
the WWN card was uninstalled or
failed.
Initial set up results in IP
address/Domain ID
conflict.
The SAN384B was connected to
Administrator's Guide for configuration information.
LEDs on one or more
The SAN384B might be booting or Verify that boot and POST are complete. The
components are changing running POST.
rapidly or do not indicate
a healthy state.
SAN384B requires a minimum of 3 minutes,
usually, after power-on to complete POST.
Beaconing might be on for the
Determine whether beaconing is on by entering
the switchShow command and determine whether
switch beaconing or blade beaconing is on.
entire SAN384B or for individual
components.
failed.
system components,” on page 45 for interpretation
and recommended actions.
Pins on the components might be Remove the component from the chassis and
damaged.
inspect the pins on the component and inside the
chassis. Do not reinstall if pins on either
component are visibly damaged, as this could
damage pins on other component. Replace the
parts as required.
134 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Table 28. Troubleshooting (continued)
None of the LEDs on an
individual component are correctly.
on.
Component might not be seated
Ensure that the SAN384B has power and
component is firmly seated. If problem continues,
run the sensorShow command to determine
component status. If component is a CP blade or
port blade, enter the slotShow command to
determine the status.
Component might have failed.
CP blades are failing over A third-party application has a
Replace the component as necessary.
Check the application for memory leaks.
frequently.
memory leak.
There is excessive serial port
activity.
Ensure that the serial port activity remains below
the specified amount.
CP blade is attached to an
Ethernet with high traffic loads.
Ensure that Ethernet traffic remains below
specified amount.
Chassis is overheated.
Enter the tempShow and sensorShow commands
to check the internal temperature. If components
are overheating, shut down port blades as
necessary to return the temperature to operating
range.
One or more port or router Blades might be overheated.
blades have either shut
down or failed POST as
Enter the sensorShow command to check the
internal temperature readings. If components are
overheating, shut down port blades as necessary to
return the temperature readings to the operating
ranges.
indicated by the error log.
Blades might be faulty.
Enter the slotShow command to determine status.
For more information, enter the diagDisablePost
command; then, the slotPowerOff [slot number]
and slotPowerOn [slot number] command.
Resolve the source of the problem or replace the
blade as required.
Pins on the blade or the backplane Remove the blade from the chassis and inspect
might be damaged.
pins on the blade and on the backplane inside the
slot. Do not reinstall if pins on either component
are visibly damaged, as this could damage pins on
other component. Replace the components as
required.
An individual component Component may not have power
Ensure component is receiving power (power LED
should be on) and component is firmly seated.
is not operating as
expected.
or may not be firmly seated.
Pins on the component or the
backplane might be damaged.
Remove the component from the chassis and
inspect the pins on the component and inside the
chassis. Do not reinstall if pins on either
component are visibly damaged, as this could
damage pins on other component. Replace parts as
required.
The component might have failed. Enter the tempShow and sensorShow commands
to determine component status. If component is a
CP blade or port blade, enter the slotShow
command to determine the status. Replace the
component as necessary.
Appendix C. Diagnostics and troubleshooting 135
Download from Www.Somanuals.com. All Manuals Search And Download.
136 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Appendix D. Blade port numbering
You can print or copy the illustrations in this appendix and use them to record the
details on the port numbering pattern for the different blades.
|
|
2
3
1
|
|
|
Figure 51. FC8-16 port blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
Power LED
Status LED
ꢀ3ꢁ
FC ports 0-15 (right to left)
|
|
|
2
3
4
1
|
|
|
Figure 52. FC8-32 port blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
Power LED
Status LED
ꢀ3ꢁ
ꢀ4ꢁ
FC ports 16-31 (right to left)
FC ports 0-15 (right to left)
|
|
© Copyright IBM Corp. 2009, 2010
137
Download from Www.Somanuals.com. All Manuals Search And Download.
|
2
3
1
4
|
|
|
Figure 53. FC8-48 port blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
Power LED
Status LED
ꢀ3ꢁ
ꢀ4ꢁ
FC ports 24-47 (right to left)
FC ports 0-23 (right to left)
|
|
|
1
2
5
7
6
8
3
4
|
|
|
Figure 54. FC8-64 port blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
ꢀ4ꢁ
Status LED
Power LED
Port 63
ꢀ5ꢁ
ꢀ6ꢁ
ꢀ7ꢁ
ꢀ8ꢁ
port 61 LED
|
|
port 29 LED
FC ports 32-63 (right to left)
FC ports 0-31 (right to left)
|
|
Port 30
|
|
|
|
|
Figure 55. FC10-6 port blade, ports 0-5 from right to left
2
1
|
|
|
Figure 56. FR4-18i routing blade
|
|
ꢀ1ꢁ
FC ports 0-15 (right to left)
ꢀ2ꢁ GbE ports (GE0 right, GE1 left)
|
138 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
|
1
7
6
2
3
4
5
|
|
|
Figure 57. FX8-24 extension blade
|
|
ꢀ1ꢁ
ꢀ2ꢁ
ꢀ3ꢁ
ꢀ4ꢁ
Status LED
Power LED
ꢀ5ꢁ
ꢀ6ꢁ
ꢀ7ꢁ
FC ports 0-5 (numbered right to left)
FC ports 6-11 (numbered right to left)
1 GbE ports 4-9 (numbered right to left)
|
|
1 GbE ports 0-3 (numbered right to left)
10 GbE ports 0-1 (numbered right to left)
|
|
|
1
4
3
2
Figure 58. FCOE10-24 blade
|
|
|
|
|
ꢀ1ꢁ
ꢀ2ꢁ
Status LED
Power LED
ꢀ3ꢁ
ꢀ4ꢁ
10 GbE FCoE ports 0-11 (numbered right to left)
10 GbE FCoE ports 12-23 (numbered right to left)
|
|
Appendix D. Blade port numbering 139
Download from Www.Somanuals.com. All Manuals Search And Download.
140 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Notices
This information was developed for products and services offered in the USA.
IBM may not offer the products, services, or features discussed in this document in
other countries. Consult your local IBM representative for information on the
products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe on any IBM intellectual property right
may be used instead. However, it is the user's responsibility to evaluate and verify
the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does not give you
any license to these patents. You can send license inquiries, in writing to:
IBM Director of Licensing
IBM Corporation
North Castle Drive
Armonk, N.Y. 10504-1785
U.S.A.
For additional information, visit the web at:
The following paragraph does not apply to the United Kingdom or any other
country where such provisions are inconsistent with local law:
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER
EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or
implied warranties in certain transactions, therefore, this statement may not apply
to you.
This information could include technical inaccuracies or typographical errors.
Changes are periodically made to the information herein; these changes will be
incorporated in new editions of the publication. IBM may make improvements
and/or changes in the product(s) and/or the program(s) described in this
publication at any time without notice.
Any references in this information to non-IBM web sites are provided for
convenience only and do not in any manner serve as an endorsement of those web
sites. The materials at those web sites are not part of the materials for this IBM
product and use of those web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it
believes appropriate without incurring any obligation to you.
Any performance data contained herein was determined in a controlled
environment. Therefore, the results obtained in other operating environments may
vary significantly. Some measurements may have been made on development-level
© Copyright IBM Corp. 2009, 2010
Download from Www.Somanuals.com. All Manuals Search And Download.
141
systems and there is no guarantee that these measurements will be the same on
generally available systems. Furthermore, some measurement may have been
estimated through extrapolation. Actual results may vary. Users of this document
should verify the applicable data for their specific environment.
Information concerning non-IBM products was obtained from the suppliers of
those products, their published announcements or other publicly available sources.
IBM has not tested those products and cannot confirm the accuracy of
performance, compatibility or any other claims related to non-IBM products.
Questions on the capabilities of non-IBM products should be addressed to the
suppliers of those products.
If you are viewing this information in softcopy, the photographs and color
illustrations may not appear.
142 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Trademarks
IBM, the IBM logo, and ibm.com® are trademarks or registered trademarks of
International Business Machines Corporation in the United States, other countries,
or both. A complete and current list of other IBM trademarks is available on the
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered
trademarks or trademarks of Adobe Systems Incorporated in the United States,
and/or other countries.
Java and all Java-based trademarks and logos are trademarks of Sun Microsystems,
Inc. in the United States, other countries, or both.
Linux is a registered trademark of Linus Torvalds in the United States, other
countries, or both.
Microsoft and Windows are trademarks of Microsoft Corporation in the United
States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other
countries.
Other product and service names might be trademarks of IBM or other companies.
Notices 143
Download from Www.Somanuals.com. All Manuals Search And Download.
Electronic emission notices
The following statements apply to this product. The statements for other products
intended for use with this product will appear in their accompanying manuals.
Federal Communications Commission (FCC) Class A
Statement
This equipment has been tested and complies with the limits for a Class A digital
device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated
in a commercial environment. This equipment generates, uses, and can radiate
radio frequency energy and, if not installed and used in accordance with the
instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful
interference, in which case the user will be required to correct the interference at
his own expense.
Properly shielded and grounded cables and connectors must be used in order to
meet FCC emission limits. IBM is not responsible for any radio or television
interference caused by using other than recommended cables and connectors or by
unauthorized changes or modifications to this equipment. Unauthorized changes
or modifications could void the user's authority to operate the equipment.
This device complies with Part 15 of the FCC Rules. Operation is subject to the
following two conditions: (1) this device may not cause harmful interference, and
(2) this device must accept any interference received, including interference that
may cause undesired operation.
Industry Canada Class A Emission Compliance Statement
This Class A digital apparatus complies with Canadian ICES-003.
Avis de conformité à la réglementation d'Industrie Canada
Cet appareil numérique de la classe A est conform à la norme NMB-003 du
Canada.
European Union EMC Directive Conformance Statement
This product is in conformity with the protection requirements of EU Council
Directive 2004/108/EC on the approximation of the laws of the Member States
relating to electromagnetic compatibility. IBM cannot accept responsibility for any
failure to satisfy the protection requirements resulting from a non-recommended
modification of the product, including the fitting of non-IBM option cards.
Attention: This is an EN55022 Class A product. In a domestic environment this
product may cause radio interference in which case the user may be required to
take adequate measures.
Responsible manufacturer:
International Business Machines Corp.
New Orchard Road
Armonk, New York 10504
Tel: 919-499-1900
European community contact:
IBM Technical Regulations, Department M456
144 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
IBM-Allee 1, 71137 Ehningen, Germany
Tel: +49 7032 15-2937
E-mail: tjahn@de.ibm.com
Germany Electromagnetic Compatibility Directive
Deutschsprachiger EU Hinweis:
Hinweis für Geräte der Klasse A EU-Richtlinie zur Elektromagnetischen
Verträglichkeit
Dieses Produkt entspricht den Schutzanforderungen der EU-Richtlinie
2004/108/EG zur Angleichung der Rechtsvorschriften über die elektromagnetische
Verträglichkeit in den EU-Mitgliedsstaaten und hält die Grenzwerte der EN 55022
Klasse A ein.
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu
installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM
empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für
die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung der
IBM verändert bzw. wenn Erweiterungskomponenten von Fremdherstellern ohne
Empfehlung der IBM gesteckt/eingebaut werden.
EN 55022 Klasse A Geräte müssen mit folgendem Warnhinweis versehen werden:
"Warnung: Dieses ist eine Einrichtung der Klasse A. Diese Einrichtung kann im
Wohnbereich Funk-Störungen verursachen; in diesem Fall kann vom Betreiber
verlangt werden, angemessene Maßnahmen zu ergreifen und dafür
aufzukommen."
Deutschland: Einhaltung des Gesetzes über die elektromagnetische
Verträglichkeit von Geräten
Dieses Produkt entspricht dem "Gesetz über die elektromagnetische Verträglichkeit
von Geräten (EMVG)". Dies ist die Umsetzung der EU-Richtlinie 2004/108/EG in
der Bundesrepublik Deutschland.
Zulassungsbescheinigung laut dem Deutschen Gesetz über die
elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC EG
Richtlinie 2004/108/EG) für Geräte der Klasse A
Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das
EG-Konformitätszeichen - CE - zu führen.
Verantwortlich für die Einhaltung der EMV Vorschriften ist der Hersteller:
International Business Machines Corp.
New Orchard Road
Armonk, New York 10504
Tel: 919-499-1900
Der verantwortliche Ansprechpartner des Herstellers in der EU ist:
IBM Deutschland
Technical Regulations, Department M456
IBM-Allee 1, 71137 Ehningen, Germany
Tel: +49 7032 15-2937
E-mail: tjahn@de.ibm.com
Notices 145
Download from Www.Somanuals.com. All Manuals Search And Download.
Generelle Informationen:
Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 Klasse
A.
People's Republic of China Class A Electronic Emission
Statement
Japan VCCI Council Class A Statement
Translation: This is a Class A product based on the standard of the VCCI Council.
If this equipment is used in a domestic environment, radio interference may occur,
in which case, the user may be required to take corrective actions.
Japan Electronics and Information Technology Industries
Association (JEITA) Statement
Japanese Electronics and Information Technology Industries Association (JEITA)
Confirmed Harmonics Guideline (products greater than 20 A per phase).
Korea Communications Commission (KCC) Statement
Please note that this equipment has obtained EMC registration for commercial use.
In the event that it has been mistakenly sold or purchased, please exchange it for
equipment certified for home use.
146 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Russia Electromagnetic Interference (EMI) Class A Statement
Australia and New Zealand Class A Statement
Attention: This is a Class A product. In a domestic environment this product
might cause radio interference in which case the user might be required to take
adequate measures.
Notices 147
Download from Www.Somanuals.com. All Manuals Search And Download.
148 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Index
cables
data transmission
date
Numerics
24–inch load plate
384B
comments
component
components
disconnecting
documents
Domain ID
A
ac power
attaching
attention notice
configuration
download
configuration file
configuring
connection
E
B
backup
blade
blade filler panel
blades
control processor blade
core switch blade
exhaust kit
extension blade
blower assembly
Brocade
CP8 blade
F
CR4S-8 blade
fabric
fabric configuration
CR4S-S blade
critical information
FC10-6 10 Gb blade
C
C36
C8P blade
cabinet
FC3816
cable management finger assembly
D
FC3832
© Copyright IBM Corp. 2009, 2010
149
Download from Www.Somanuals.com. All Manuals Search And Download.
FC3848
FC3850
FC3864
FC3870
FC3880
FC3890
FRU
FX8-24 extension blade
G
inter-chassis cable kit
inter-chassis link (ICL)
H
inter-chassis link (ICL) cable
IP addresses
I
IBM
installation
L
LEDs
FCIP extension blade
features
Fibre cables
Fibre Channel over Ethernet
Fibre Channel over Ethernet blade
local time
login
M
machine checks
150 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
mSFPs
port blade (continued)
port blades
removing (continued)
port groups
port specifications
port-side exhaust kit
power
N
network
notices
power supply
product
requirements
routing blade
notices and labels
S
O
safety inspection
SAN384B
organizing
R
rack
P
parameters
part number
reconnecting
parts
recording
port blade
removing
serial console port
Index 151
Download from Www.Somanuals.com. All Manuals Search And Download.
setting
system components
WWN card
T
X
time
time required
time server
SFP+s
SFPs
XFPs
time zone
transceivers
transmission range
software licenses
standard features
software
trunking
U
starting
unpacking
status
V
verifying
verifying operation
W
weights
switch name
WWN
synchronizing
card
WWN bezel
system component
152 SAN384B Installation, Service, and User Guide
Download from Www.Somanuals.com. All Manuals Search And Download.
Download from Www.Somanuals.com. All Manuals Search And Download.
ꢀꢁꢂꢃ
Part Number: 45W8160
Printed in USA
GC52-1333-02
Download from Www.Somanuals.com. All Manuals Search And Download.
Download from Www.Somanuals.com. All Manuals Search And Download.
|
Haan Iron GS 20 User Manual
Haier Dishwasher DW12 TFE5 User Manual
Hamilton Beach Iron 19801 User Manual
Hasbro Two Way Radio 2148 User Manual
Hasbro Two Way Radio 59859 User Manual
Hoshizaki Ice Maker KM 201BAH User Manual
Hotpoint Oven OS 897D P IX HP User Manual
HP Hewlett Packard Photo Printer 8400 User Manual
Hunter Fan Air Cleaner 30010 User Manual
Hunter Fan Fan Type 7 Models User Manual