Cisco Systems 15327 User Manual 3
Cisco ONS 15327 Troubleshooting Guide
Product and Documentation Release 3.4
April 2003
Corporate Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 526-4100
Customer Order Number: DOC-7815641=
Text Part Number: 78-15641-01
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS M ANUAL ARE SUBJECT TO CHA NGE WITHOUT NO TICE. ALL
STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT
WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSI BILITY FOR THEIR APPLICA TION OF ANY PRODUCT S.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORT H IN THE INFORMATION PACKET T HAT
SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE
OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant
to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause
harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required
to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency ener gy. If it is not
installed in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to
comply with the limits for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable
protection against such interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.
Modifying the equipment without Cisc o’s writ ten author ization m ay resul t in the equi pment no lo nger comp lyi ng with FCC requi rements for Class A or Class B digital
devices. In that event, your right to use the equ ipment may be limit ed by FCC regul ations , and you may be requir ed to correct a ny interference to radio or television
communications at your own expense.
You can determine whether your equipment is causing interference by turning it off. If the interferen ce stops, it was probably caused by the Cis co equipm ent or one of its
peripheral devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:
• Turn the television or radio antenna unt il the int erference st ops.
• Move the equipment to one side or the other of the televisio n or radi o.
• Move the equipment farther away from the te levision or radio.
• Plug the equipment into an outlet that is on a di fferent cir cuit from the televi sion o r radio. (That is, make certain th e equipment and the te levision or radio are on circuit s
controlled by different circuit breaker s or fuses.)
Modifications to this product no t author ized by Cis co Syst ems, Inc. coul d voi d the FCC appro val and ne gate your authorit y to op erate the pr oduct.
The Cisco implementation of TCP head er compressi on is an adap tation of a program developed by the Universi ty of Ca lifornia, Berk eley (UCB) as part of UCB ’s public
domain version of the UNIX operatin g system. All rights reserved . Copyri ght © 1981 , Rege nts of the Uni versity of Calif ornia.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THE SE SUPPLIERS ARE PROVIDED “AS IS” WITH
ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAI M ALL WARRANTIE S, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT
LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NO NINFRINGEM ENT OR ARISING FROM A COURS E OF
DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING ,
WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO
OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE S.
CCIP, CCSP, the Cisco Arrow logo, the Cisco Powered Network mark, Cisco Unity, Follow Me Browsing, FormShare, and StackWise are trademarks of Cisco Systems, Inc.;
Changing the Way We Work, Live, Play, and Learn, and iQuick Study are service marks of Cisco Systems, Inc.; and Aironet, ASIST, BPX, Catalyst, CCDA, CCDP, CCIE, CCNA,
CCNP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, the Cisco IOS logo, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo,
Empowering the Internet Generation, Enterprise/Solver, EtherChannel, EtherSwitch, Fast Step, GigaStack, Internet Quotient, IOS, IP/TV, iQ Expertise, the iQ logo, iQ Net
Readiness Scorecard, LightStream, MGX, MICA, the Networkers logo, Networking Academy, Network Registrar, Packet, PIX, Post-Routing, Pre-Routing, RateMUX, Registrar,
ScriptShare, SlideCast, SMARTnet, StrataView Plus, Stratm, SwitchProbe, TeleRouter, The Fastest Way to Increase Your Internet Quotient, TransPath, and VCO are registered
trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.
All other trademarks mentioned in this document or Website are the property of their respective owners. The use of the word partner does not imply a partnership relationship
between Cisco and any other company. (0401R)
Cisco ONS 15327 Troubleshooting Guide
Copyright © 2003 Cisco Systems, Inc. All rights reserved.
About this Guide xxi
Document Objectives xxi
Audience xxi
Related Documentation xxi
Document Conventions xxii
Where to Find Safety and Warning Information xxiii
Obtaining Documentation xxiii
Cisco.com xxiii
Documentation CD-ROM xxiii
Ordering Documentation xxiv
Documentation Feedback xxiv
Obtaining Technical Assistance xxiv
Cisco.com xxiv
Technical Assistance Center xxv
Cisco TAC Website xxv
Cisco TAC Escalation Center xxvi
CONTENTS
CHAPTER
Obtaining Additional Publications and Information xxvi
1 General Troubleshooting 1-1
1.1 Network Troubleshooting Tests 1-2
1.2 Ident if y Points of Failur e on a DS-N Circuit Path 1-4
1.2.1 Perform a Facility Loopback on a Source XTC Port 1-5
Create the Facility Loopback on the Source XTC Port 1-5
Test the Facilit y Loo pb ack 1-6
Test the DS-N Cab ling 1-6
Test the XTC Ca rd 1-7
Test the MIC Cabl ing 1-7
Test the MIC Card 1-8
1.2.2 Perform a Hairpin on a Source Node XTC Port 1-8
Create the Hairpin on the Source Node Port 1-9
Test the Hairpin Circuit 1-9
Test the Altern ate Source XTC Card 1-10
Retest the Original Source XTC Card 1-11
1.2.3 Perform a Terminal Loopback on a Destination XTC Port 1-11
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
iii
Contents
Create the Terminal Loopback on a Destination XTC Port 1-12
Test the Terminal Loopback Circuit on the Destination XTC Port 1-13
Test the Destination XTC Card 1-14
1.2.4 Per form a Hairpin on a Destination No d e XT C Port 1-14
Create the Hairpin Loopback Circuit on th e Destination Node XTC Card 1-15
Test the Hairpin Circuit 1-16
Test the Altern a te De stination XTC Ca rd 1-16
Retest the Original Destination XTC Card 1-17
1.2.5 Perform a Facility Loopback on a Destination XTC Card 1-18
Create a Facility Loopback Circuit on a Destination XTC Port 1-18
Test the Facilit y Loo pb ack Circuit 1-19
Test the DS-N Cab ling 1-19
Test the XTC Ca rd 1-20
Test the MIC Card 1-20
1.3 Identify Points of Failure on an OC-N Circuit Path 1-21
1.3.1 Perform a Facility Loopback on a Source-N ode OC-N Port 1-21
Create the Facil ity Loopback on the Source OC-N Port 1-22
Test the Facilit y Loo pb ack Circuit 1-22
Test the OC-N Car d 1-23
1.3.2 Perform a Cross-Connect Loopback on the Source OC-N Port 1-23
Test the Cross -C onnect Loopb a ck Circuit 1-24
Test the Standby XTC Card 1-25
Retest the Original XTC Card 1-26
1.3.3 Perform a Terminal Loopback on a Source-Node OC-N Port 1-27
Create the Terminal Loopback on a Source Node OC- N Port 1-27
Test the Terminal Loopback Circuit 1-28
Test the OC-N Car d 1-29
1.3.4 Perform a Facility Loopback on an Interm ediate-Node OC-N Port 1-29
Create the Facility Loopback on an Interm ediate-Node OC-N Port 1-30
Test the Facilit y Loo pb ack Circuit 1-31
Test the OC-N Car d 1-32
1.3.5 Perform a Terminal Loopback on an Intermediate-Node OC-N Port 1-32
Create the Terminal Loopback on an Intermedi ate-Node OC-N Port 1-33
Test the Terminal Loopback Circuit 1-34
Test the OC-N Car d 1-34
1.3.6 Perform a Facility Loopback on a Destination-Node OC-N Port 1-35
Create the Facility Loopback on a Destinati on Node OC-N Port 1-36
Test the Facilit y Loo pb ack Circuit 1-37
Test the OC-N Car d 1-37
1.3.7 Perform a Terminal Loopback on a Destination Node OC-N Port 1-38
iv
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Create the Terminal Loopback on a Destination Node OC-N Port 1-39
Test the Termi na l Lo o pback Circuit 1-40
Test the OC-N Car d 1-40
1.4 Restoring the Database and Default Settings 1-41
1.4.1 Res t ore the Node Data ba se 1-41
Restore the Databa se 1-41
1.4.2 Res t ore the Node to Fact ory Configura ti on 1-43
Use the Reinitialization Tool to Clear t he Database and Upload Software (Windows) 1-43
Use the Reinitiali zation Tool to Clear the Database and Upload Software (UNIX) 1-45
1.5 PC Connectivity Troubleshooting 1-47
1.5.1 Unable to Verify the IP Configuration of Your PC 1-47
Verify the IP Configuration of Your PC 1-47
1.5.2 Browser Login Does Not Launch Java 1-48
Reconfigur e th e PC Operating Sy st em Ja v a Plug-in Contr ol Panel 1-48
Reconfigur e th e B ro w se r 1-48
1.5.3 Unable to Verify the NIC Connection on Your PC 1-49
1.5.4 Verify PC Connection to the ONS 15327 (Ping) 1-50
Ping the ONS 15327 1-50
1.5.5 The IP Address of the Node is Unknown 1-51
Retrieve Unknown Node IP Address 1-51
Contents
1.6 CTC Operation Troubleshooting 1-52
1.6.1 Unable to Launch CTC Help After Removing Netscape 1-52
Set Internet Explorer as the Default Brow ser for CTC 1-52
1.6.2 Unable to Change Node View to Network View 1-52
Reset the CTC_HEAP Environment Variable for Windows 1-53
Reset the CTC_HEAP Environment Variable for Solaris 1-53
1.6.3 Browser Stalls When Downloading CTC JAR Files from XTC 1-54
Disable the VirusScan Download Scan 1-54
1.6.4 CTC D oe s N ot Launch 1-54
Redirect the Netscape Cache to a Valid Directory 1-55
1.6.5 Sluggish CTC Operation or Login Proble ms 1-55
Delete the CTC Cache File Automatically 1-55
Delete the CTC Cache File Manually 1-56
1.6.6 Node Icon is Gray on CTC Network View 1-57
1.6.7 CTC Cannot Launch Due to Applet Security Restrictions 1-57
Manually Edit the ja va .p o lic y Fi le 1-58
1.6.8 Java Runtime Environment Incompatible 1-58
Launch CTC to Correct the Core Version Build 1-59
1.6.9 Different CTC Releases Do Not Recognize Each Other 1-59
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
v
Contents
Launch CTC to Correct the Core Version Build 1-60
1.6.10 Username or Password Does Not Match the XTC Information 1-60
Verify Correc t U se rn a m e an d Pas s w or d 1-61
1.6.11 No IP Connectivity Exists Between Nodes 1-61
1.6.12 DCC Connection Lost 1-61
1.6.13 “Path in Use” Error When Creating a Circuit 1-61
Cancel the Circuit Creation and Start Over 1-62
1.6.14 Calculate and Design IP Subnets 1-62
1.6.15 Et hernet Conne c tio n s 1-62
Verify Ethernet Connections 1-63
1.6.16 VLAN Cannot Connect to Network Device from Untag Port 1-64
Change VLAN Port Tag and Untagged Settings 1-65
1.7 Circu it s an d Tim in g 1-66
1.7.1 Circuit Transitions to Partial State 1-66
View the State of Circuit Nodes 1-67
1.7.2 AIS-V on XTC-28-3 Unused VT Circuits 1-67
Clear AIS-V on XTC-28-3 Unused VT Circuits 1-67
1.7.3 Circuit Creati on Error with VT1.5 Circuit 1-68
1.7.4 DS 3 Ca r d Does Not Report AIS-P From Extern al Equipmen t 1-68
1.7.5 OC-3 and DCC Limitati ons 1-69
1.7.6 ONS 15327 Switches Timing Reference 1-69
1.7.7 Holdover Synchr onization Alarm 1-70
1.7.8 Free-Running Synchronization Mode 1-70
1.7.9 Daisy-Chaine d BITS Not Functioning 1-70
1.7.10 Blinking STAT LED after Installing a Card 1-71
vi
1.8 Fiber and Cabling 1-71
1.8.1 Bit Erro r s Appear for a Traffic Card 1-71
1.8.2 Fau lt y Fiber-Optic Co nn e ct i o ns 1-72
Verify Fiber-O ptic Connections 1-72
1.8.2.1 Crimp Replacement LAN Cables 1-74
1.8.2.2 R ep lace Faulty SFP Co nnectors 1-76
Remove SFP Connectors 1-76
Install SFP Connectors 1-76
1.8.2.3 Optical Card Transmit and Receive Levels 1-77
1.9 Power and LED Tests 1-78
1.9.1 Power Supply Prob lems 1-78
Isolate the Cau s e of Pow e r S up ply Problems 1-79
1.9.2 Power Consumpt ion for Node and Cards 1-79
1.9.3 Lamp Test for Card LEDs 1-80
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Verify Card LED Operation 1-80
Contents
CHAPTER
2 Alarm Troubleshooting 2-1
2.1 Alarm In de x by D ef au lt Sev e rity 2-1
2.1.1 Critical Alarms (CR) 2-1
2.1.2 Maj o r A la rm s (M J) 2-2
2.1.3 Mi no r A la rm s (MN ) 2-2
2.1.4 Conditions (NA or NR) 2-3
2.2 Alarms and Conditions Indexed By Alphabet ical Entry 2-4
2.3 Alarm Index by Alarm Type 2-6
2.3.1 Ala rm Ty p e/ O bject Definit io n 2-13
2.4 Trouble Notifications 2-14
2.4.1 Conditions 2-14
2.4.2 Severities 2-14
2.5 Safety Summary 2-15
2.6 Alarm Procedures 2-15
2.6.1 AIS 2-16
Clear the AIS Condition 2-16
2.6.2 AIS-L 2-16
Clear the AIS-L Condition 2-16
2.6.3 AIS-P 2-17
Clear the AIS-P Cond ition 2-17
2.6.4 AIS-V 2-17
Clear the AIS-V Cond ition 2-17
2.6.5 APSB 2-18
Clear the APSB Alarm 2-18
2.6.6 APSCDFLTK 2-18
Clear the APSCDFLTK Alarm 2-19
2.6.7 APSC-IMP 2-19
Clear the APSC-IMP Alarm 2-20
2.6.8 APSCINCON 2-20
Clear the APSCINCON Alarm 2-20
2.6.9 APSCM 2-21
Clear the APSCM Alarm 2-21
2.6.10 APSCNMIS 2-21
Clear the APSCNMIS Alarm 2-21
2.6.11 APSMM 2-22
Clear the APSMM Alarm 2-22
2.6.12 AS-CMD 2-23
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
vii
Contents
Clear the AS-CMD Condition 2-23
2.6.13 AS-MT 2-23
Clear the AS-MT Condi tion 2-24
2.6.14 AUD-LOG-LOSS 2-24
Clear the AUD-LOG-LOSS Condition 2-24
2.6.15 AUD-LOG-LOW 2-24
2.6.16 AUTORESET 2-25
Clear the AUTORESET Ala rm 2-25
2.6.17 AUTOSW-AIS 2-25
Clear the AUTOSW-AIS Condition 2-25
2.6.18 AUTOSW-LOP (STSMON) 2-26
Clear the AUTOSW-LOP (STSMON) Condition 2-26
2.6.19 AUTOSW-LOP (VTMON) 2-26
Clear the AUTOSW-LOP (VTMON) Alarm 2-26
2.6.20 AUTOSW-PDI 2-26
Clear the AUTOSW-PDI Condition 2-26
2.6.21 AUTOSW-SDBER 2-27
Clear the AUTOSW-SDBER Con dition 2-27
2.6.22 AUTOSW-SFBER 2-27
Clear the AUTOSW-SFBER Condition 2-27
2.6.23 AUTOSW-UNEQ (STSMON) 2-27
Clear the AUTOSW-UNEQ (STSMON) Condition 2-27
2.6.24 AUTOSW-UNEQ (VTMON) 2-28
Clear the AUTOSW-UNEQ (VTMON) Al arm 2-28
2.6.25 BAT-A-HGH-VLT 2-28
Clear the BAT-A-HGH-VLT Condition 2-28
2.6.26 BAT-A-LOW-VLT 2-28
Clear the BAT-A-LOW-VLT Co ndition 2-28
2.6.27 BAT-B-HGH-VLT 2-29
Clear the BAT-B-HGH-VLT Condition 2-29
2.6.28 BAT-B-LOW-VLT 2-29
Clear the BAT-B-LOW-VLT Condition 2-29
2.6.29 BKUPMEMP 2-29
Clear the BKUPMEMP Alarm 2-30
2.6.30 BLSROSYNC 2-30
Clear the BLSROSYNC Alarm 2-30
2.6.31 CA R L O SS (EQPT) 2-31
Clear the CARLOSS (EQPT) Alarm 2-31
2.6.32 C A R L O SS (E Series) 2-32
Clear the CARLOSS (E-Series) Alarm 2-32
viii
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
2.6.33 CA R L O SS (G Se rie s ) 2-33
Clear the CARLOSS (G Serie s) Alarm 2-34
2.6.34 CLDRESTART 2-36
Clear the CLDRESTART Co ndition 2-36
2.6.35 COMIOXC 2-37
Clear the COMIOXC Alarm 2-37
2.6.36 CONTBUS-A-18 2-37
Clear the CONTBUS-A-18 Alarm 2-37
2.6.37 CONTBUS-B-18 2-38
Clear the CONTBUS-B-18 Al arm 2-38
2.6.38 CONTBUS-IO-A 2-38
Clear the CONTBUS-IO-A Alarm 2-39
2.6.39 CONTBUS-IO-B 2-40
Clear the CONTBUS-IO-B Al arm 2-40
2.6.40 CTNEQPT-PBPROT 2-41
Clear the CTNEQPT-PBPROT Alarm 2-42
2.6.41 CTNEQPT-PBWORK 2-43
Clear the CTNEQPT-PBWORK Alarm 2-43
2.6.42 DATAFLT 2-44
Clear the DATAFLT Alarm 2-44
2.6.43 DBOSYNC 2-45
Clear the DBOSYNC Alarm 2-45
2.6.44 DS3-MISM 2-45
Clear the DS3-MISM Condition 2-46
2.6.45 EHIBATVG-A 2-46
Clear the EHIBATVG-A Alar m 2-46
2.6.46 EHIBATVG-B 2-46
Clear the EHIBATVG-B Alarm 2-47
2.6.47 ELWBATVG-A 2-47
Clear the ELWBATVG-A Alarm 2-47
2.6.48 ELWBATVG-B 2-47
Clear the ELWBATVG-B Alarm 2-47
2.6.49 EOC 2-48
Clear the EOC Alarm 2-48
2.6.50 EQPT 2-50
Clear the EQPT Alarm 2-50
2.6.51 EQPT-MISS 2-51
Clear the EQPT-MISS Alarm 2-51
2.6.52 E-W-MISMATCH 2-51
Clear the E-W-MISMATCH Alarm with a Physical Switch 2-52
Contents
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
ix
Contents
Clear the E-W-MISMATCH Alarm in CT C 2-52
2.6.53 EXCCOL 2-53
Clear the EXCCOL Alarm 2-53
2.6.54 EXERCISE-RING-REQ 2-53
2.6.55 EXERCISE-SPAN-REQ 2-53
2.6.56 EXT 2-54
Clear the EXT Alarm 2-54
2.6.57 EXTRA-TRAF-PREEMPT 2-54
Clear the EXTRA-TRAF-PREEMPT Alarm 2-54
2.6.58 FAILTOSW 2-54
Clear the FAILTOSW Condition 2-55
2.6.59 FAILTOSW-PATH 2-55
Clear the FAILTOSW-PATH Condition in a UPSR Configuration 2-55
2.6.60 FAILTOSWR 2-56
Clear the FAILTOSWR Condition in a BLSR Configuration 2-56
2.6.61 FAILTOSWS 2-58
Clear the FAILTOSWS Condition 2-58
2.6.62 FAN 2-59
Clear the FAN Alarm 2-60
2.6.63 FANDEGRADE 2-60
Clear the FANDEGRADE Alarm 2-60
2.6.64 FE-AIS 2-60
Clear the FE-AIS Condition 2-60
2.6.65 FE-DS1-MULTLOS 2-61
Clear the FE-DS1-MUL TLOS Condition 2-61
2.6.66 FE-DS1-NSA 2-61
Clear the FE-DS1-NSA Condition 2-61
2.6.67 FE-DS1-SA 2-62
Clear the FE-DS1-SA Condition 2-62
2.6.68 FE-DS1-SNGLLOS 2-62
Clear the FE-DS1-SNGLLOS Condition 2-62
2.6.69 FE-DS3-NSA 2-63
Clear the FE-DS3-NSA Condition 2-63
2.6.70 FE-DS3-SA 2-63
Clear the FE-DS3-SA Condition 2-63
2.6.71 FE-EQPT-NSA 2-64
Clear the FE-EQPT-NSA Condition 2-64
2.6.72 FE-EXERCISING-RING 2-64
2.6.73 FE-EXERCISING-SPAN 2-64
2.6.74 FE-FRCDWKSWPR-RING 2-65
Cisco ONS 15327 Troubleshooting Guide, R3.4
x
April 2003
Clear the FE-FRCDWKSWPR-RING Condition 2-65
2.6.75 FE-FRCDWKSWPR-SPAN 2-65
Clear the FE-FRCDWKSWPR-SPAN Condition 2-65
2.6.76 FE-IDLE 2-66
Clear the FE-IDLE Co ndition 2-66
2.6.77 FE-LOCKOUTOFPR-SPAN 2-66
Clear the FE-LOCKOUTOFPR-SPAN Condition 2-66
2.6.78 FE-LOF 2-67
Clear the FE-LOF Condition 2-67
2.6.79 FE-LOS 2-67
Clear the FE-LOS Cond ition 2-67
2.6.80 FE-MANWKSWPR-RING 2-68
Clear the FE-MANWKSWPR-RING Condition 2-68
2.6.81 FE-MANWKSWPR-SPAN 2-68
Clear the FE-MANWKSWPR-SPAN Condition 2-68
2.6.82 FEPRLF 2-69
Clear the FEPRLF Alarm on a BLSR 2-69
2.6.83 FORCED-REQ 2-69
Clear the FORCED-REQ Condition 2-69
2.6.84 FORCED-REQ-RING 2-69
Clear the FORCED-REQ-RING Condition 2-70
2.6.85 FORCED-REQ-SPAN 2-70
Clear the FORCED-REQ-SPAN Condition 2-70
2.6.86 FRCDSWTOINT 2-70
2.6.87 FRCDSWTOPRI 2-70
2.6.88 FRCDSWTOSEC 2-71
2.6.89 FRCDSWTOTHIRD 2-71
2.6.90 FRNGSYNC 2-71
Clear the FRNGSYNC Alarm 2-71
2.6.91 FSTSYNC 2-71
2.6.92 FULLPASSTHR-BI 2-72
Clear the FULLPASSTHR-BI Condition 2-72
2.6.93 HITEMP 2-72
Clear the HITEMP Alarm 2-72
2.6.94 HLDOVRSYNC 2-73
Clear the HLDOVRSYNC Alarm 2-73
2.6.95 IMPROPRMVL 2-73
Clear the IMPROPRMVL Alarm 2-74
2.6.96 INC-ISD 2-75
2.6.97 INHSWPR 2-75
Contents
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xi
Contents
Clear the INHSWPR Condition 2-75
2.6.98 INHSWWKG 2-75
Clear the INHSWWKG Condition 2-76
2.6.99 INVMACADR 2-76
2.6.100 KB-PASSTHR 2-76
Clear the KB-PASSTHR Condition 2-76
2.6.101 LKOUTPR-S 2-76
Clear the LKOUTPR-S Co ndition 2-76
2.6.102 LOCKOUT-REQ 2-77
Clear the LOCKOUT-REQ Condition 2-77
2.6.103 LOCKOUT-REQ-RING 2-77
Clear the LOCKOUT-REQ-RING Condition 2-77
2.6.104 LOF (BITS) 2-77
Clear the LOF (BITS) Al arm 2-78
2.6.105 LOF (DS-1) 2-78
Clear the LOF (DS-1) Alarm 2-78
2.6.106 LOF (DS-3) 2-79
Clear the LOF (DS-3) Alarm 2-79
2.6.107 LOF (OC-N) 2-80
Clear the LOF (OC-N) Alarm 2-80
2.6.108 LOP-P 2-80
Clear the LOP-P Alarm 2-81
2.6.109 LOP-V 2-81
Clear the LOP-V Alarm 2-81
2.6.110 LOS (BITS) 2-81
Clear the LOS (BITS) Al arm 2-82
2.6.111 LOS (DS-1) 2-82
Clear the LOS (DS-1) Alarm 2-82
2.6.112 LOS (DS-3) 2-83
Clear the LOS (DS-3) Alarm 2-83
2.6.113 LOS (OC-N) 2-84
Clear the LOS (OC-N) Alar m 2-85
2.6.114 LPBKCRS 2-86
Clear the LBKCRS Condition 2-86
2.6.115 LPBKFACILITY (D S -N ) 2-86
Clear the LPBKFACILITY (DS-N) Condition 2-86
2.6.116 LPBKFACILI TY (O C -N ) 2-87
Clear the LPBKFACILITY (OC-N) Condition 2-87
2.6.117 LPBKTERMIN A L (D S -N , O C- N ) 2-87
Clear the LPBKTERMINAL (DS-N, OC-N) Condition 2-87
xii
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
2.6.118 LPBKTERM IN A L (G-S e ri es ) 2-88
Clear the LPBKTERMINAL (G-Series) Condition 2-88
2.6.119 MAN-REQ 2-88
Clear the MAN-REQ Condition 2-88
2.6.120 MANRESET 2-88
2.6.121 MANSWTOINT 2-89
2.6.122 MANSWTOPRI 2-89
2.6.123 MANSWTOSEC 2-89
2.6.124 MANSWTOTHIRD 2-89
2.6.125 MANUAL-REQ-RING 2-89
Clear the MANUAL-REQ-RING Condition 2-90
2.6.126 MANUAL-REQ-SPAN 2-90
Clear the MANUAL-REQ-SPAN Condition 2-90
2.6.127 MEA (EQPT) 2-90
Clear the MEA (EQPT) Alar m 2-90
2.6.128 MEM-GONE 2-91
2.6.129 MEM-LOW 2-92
2.6.130 MFGMEM 2-92
Clear the MFGMEM (BP, Fan-Tray Assembly) Alarm 2-92
2.6.131 PDI-P 2-93
Clear the PDI-P Condition 2-93
2.6.132 PEER-NORESPONSE 2-94
Clear the PEER-NORESPONSE Alarm 2-94
2.6.133 PLM-P 2-95
Clear the PLM-P Alarm 2-95
2.6.134 PLM-V 2-96
Clear the PLM-V Alarm 2-96
2.6.135 PRC-DUPID 2-96
Clear the PRC-DUPID Alarm 2-96
2.6.136 PROTNA 2-97
Clear the PROTNA Alarm 2-97
2.6.137 PWR-A 2-98
Clear the PWR-A Alarm 2-98
2.6.138 PWR-B 2-99
Clear the PWR-B Alarm 2-99
2.6.139 PWR-REDUN 2-100
Clear the PWR-REDUN Alarm 2-100
2.6.140 RAI 2-100
Clear the RAI Conditi on 2-100
2.6.141 RCVR-MISS 2-100
Contents
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xiii
Contents
Clear the RCVR-MISS Alar m 2-101
2.6.142 RFI-L 2-101
Clear the RFI-L Con dition 2-101
2.6.143 RFI-P 2-102
Clear the RFI-P Con dition 2-102
2.6.144 RFI-V 2-102
Clear the RFI-V Condition 2-103
2.6.145 RING-MISMATCH 2-103
Clear the RING-MISMATCH Alarm 2-103
2.6.146 RING-SW-EAST 2-104
2.6.147 RING-SW-WEST 2-104
2.6.148 SD 2-104
Clear the SD Condition 2-105
2.6.149 SD-L 2-105
Clear the SD-L Conditi on 2-105
2.6.150 SD-P 2-105
Clear the SD-P Condition 2-106
2.6.151 SF 2-106
Clear the SF Condition 2-106
2.6.152 SF-L 2-106
Clear the SF-L Condition 2-107
2.6.153 SF-P 2-107
Clear the SF-P Condition 2-107
2.6.154 SFTWDOWN 2-107
2.6.155 SNTP-HOST 2-108
Clear the SNTP-HOST Alarm 2-108
2.6.156 SPAN-SW-EAST 2-108
2.6.157 SPAN-SW-WEST 2-108
2.6.158 SQUELCH 2-109
Clear the SQUELCH Condition 2-109
2.6.159 SSM-DUS 2-110
2.6.160 SSM-FAIL 2-110
Clear the SSM-FAIL Alarm 2-110
2.6.161 SSM-LNC 2-111
2.6.162 SSM-OFF 2-111
Clear the SSM-OFF Condition 2-111
2.6.163 SSM-PRC 2-111
2.6.164 SSM-PRS 2-111
2.6.165 SSM-RES 2-112
2.6.166 SSM-SMC 2-112
xiv
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
2.6.167 SSM-ST2 2-112
2.6.168 SSM-ST3 2-112
2.6.169 SSM-ST3E 2-112
2.6.170 SSM-ST4 2-113
2.6.171 SSM-STU 2-113
Clear the STU Condition 2-113
2.6.172 SSM-TNC 2-113
2.6.173 SWMTXMOD 2-113
Clear the SWMTXMOD Alarm 2-114
2.6.174 SWTOPRI 2-115
2.6.175 SWTOSEC 2-115
Clear the SWTOSEC Conditi on 2-115
2.6.176 SWTOTHIRD 2-115
Procedure: Clear th e SWTOTHIRD Condition 2-116
2.6.177 SYNC-FREQ 2-116
Clear the SYNC-FREQ Condition 2-116
2.6.178 SYNCPRI 2-117
Clear the SYNCPRI Alarm 2-117
2.6.179 SYNCSEC 2-117
Clear the SYNCSEC Alarm 2-117
2.6.180 SYNCTHIRD 2-118
Clear the SYNCTHIRD Alarm 2-118
2.6.181 SYSBOOT 2-119
2.6.182 TIM-P 2-119
Clear the TIM-P Alarm 2-119
2.6.183 TPTFAIL (G-Series) 2-120
Clear the TPTFAIL (G-Series) Alarm 2-120
2.6.184 TRMT 2-120
Clear the TRMT Alarm 2-121
2.6.185 TRMT-MISS 2-121
Clear the TRMT-MISS Alarm 2-121
2.6.186 UNEQ-P 2-122
Clear the UNEQ-P Alarm 2-122
2.6.187 UNEQ-V 2-123
Clear the UNEQ-V Alarm 2-124
2.6.188 WKSWPR 2-124
Clear the WKSWPR Condition 2-124
2.6.189 WTR 2-124
Contents
April 2003
2.7 XTC Li ne Ala rms 2-124
2.8 Common Procedures in Alarm Troubleshooting 2-125
Cisco ONS 15327 Troubleshooting Guide, R3.4
xv
Contents
Identify a Ring ID or Node ID Number 2-125
Change a Ring ID Number 2-125
Change a Node ID Number 2-126
Verify Node Vi si bility for Other No de s 2-126
Verify or Create Node DCC Terminations 2-126
Lock Out a BLSR Span 2-127
Clear a BLSR Span Lock Out 2-127
Clear a UPSR Lock Out 2-127
Switch Protection Group Traffic with an External Switching Command 2-127
Clear an External Switching Command 2-128
Delete a Circuit 2-128
Clear a Loopback 2-128
Reset the Active XTC Card in CTC 2-129
Reset a Traffic Card in CTC 2-129
Verify BER Threshold Level 2-129
Physically Replace a Card 2-130
Remove and Rei ns e rt (R es e at) a Card 2-130
Remove and Reinsert Fan-Tray Assembly 2-130
CHAPTER
I
NDEX
3 Replace Hardware 3-1
3.1 Replace the Fan-Tray Assembly 3-1
3.2 Remove and Reinsert (Reseat) the Standby XTC 3-3
3.3 Inspect, Clean, and Replace the Reusable Air Filter 3-3
xvi
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Figure 1-1 Facility Loopback Process on an XTC Card 1-2
Figure 1-2 Facility Loopback Process on an OC-N Card 1-2
Figure 1-3 Terminal Loopback Process on an OC-N Card 1-3
Figure 1-4 Terminal Loopback Process on a G1000-2 Card 1-3
Figure 1-5 Hairpin Circuit Process on an OC-N Card 1-3
Figure 1-6 Cross-Connect Loopback Process on an OC-N Port 1-4
Figure 1-7 Facility Loopback on a Source XTC Port 1-5
Figure 1-8 Hairpin Circuit on a Source Node XTC Port 1-9
Figure 1-9 Terminal Loopback on a Destination XTC Port 1-12
Figure 1-10 Hairpin on a Destination Node XTC Card 1-15
Figure 1-11 Facility Loopback on a Destination XTC Card 1-18
Figure 1-12 Facility Loopback on a Circuit Source OC-N Po rt 1-22
Figure 1-13 Cross-Connect Lo opback on a Source OC-N Port 1-24
Figure 1-14 Terminal Loopback on a Source-Node OC-N Port 1-27
Figure 1-15 Facility Loopback on an Intermediate-Node OC-N Port 1-30
FIGURES
Figure 1-16 Terminal Loopback on an Intermediate-Node OC-N Port 1-33
Figure 1-17 Facility Loopback on a Destination Node OC-N Port 1-35
Figure 1-18 Terminal Loopback on a Destination Node OC-N Port 1-38
Figure 1-19 Reinitialization Tool in Windows 1-44
Figure 1-20 Confirm NE Restoration 1-45
Figure 1-21 Reinitialization Tool in UNIX 1-46
Figure 1-22 Deleting the CTC Cache 1-56
Figure 1-23 Ethernet Connectivity Reference 1-63
Figure 1-24 VLAN with Ethernet Ports at Tagged and Untag 1-64
Figure 1-25 Configuring VLAN Membership for Individu al Ethernet Ports 1-65
Figure 1-26 RJ-45 Pin Numbers 1-74
Figure 1-27 LAN Cable Layout 1-74
Figure 1-28 Cross-Over Cable Layout 1-75
Figure 3-1 Removing the Fan-Tray Assembly 3-2
Figure 3-2 Replacing the Fan-Tray Assembly 3-2
Figure 3-3 Removing the Reusable Fan-Tray Air Filter 3-4
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xvii
Figures
Figure 3-4 Replacing the Reusable Fan-Tray Air Filter 3-5
xviii
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Table 1-1 Restore the Node Data base 1-41
Table 1-2 Restore the Node to Factory Configuration 1-43
Table 1-3 Unable to Verify the I P Configuration of Your PC 1-47
Table 1-4 Browser Logi n Do es No t La un c h Ja va 1-48
Table 1-5 Unable to Verify the NI C Connection on Your PC 1-49
Table 1-6 Verify PC Connection to ONS 15327 (Ping) 1-50
Table 1-7 Retrieve the Unknown IP Address of the Node 1-51
Table 1-8 Unable to Launch CTC Help After Removing Netscape 1-52
Table 1-9 Browser Stalls When Downloading Files From XTC 1-53
Table 1-10 Browser Stalls When Downloading JAR File from XTC 1-54
Table 1-11 CTC Does Not Launch 1-54
Table 1-12 Sluggish CTC Operation or Login Problems 1-55
Table 1-13 Node Icon is Gray on CTC Network View 1-57
Table 1-14 CTC Cannot Launch Due to Applet Security Restrictions 1-57
Table 1-15 Java Runtime Environment In co m p at ible 1-58
TABLES
Table 1-16 JRE Compatibility 1-59
Table 1-17 Different CTC Releases Do Not Recognize Each Other 1-60
Table 1-18 Username or Password Does Not Match the XTC Information 1-60
Table 1-19 No IP Connectivity Exists Between Nodes 1-61
Table 1-20 DCC Connection Lost 1-61
Table 1-21 “Path in Use” Error When Creating a Circuit 1-62
Table 1-22 Calculate and Design IP Subnets 1-62
Table 1-23 Ethernet Connections 1-63
Table 1-24 VLAN Cannot Connection to Network Device from Untag Port 1-65
Table 1-25 Circuit in Partial State 1-66
Table 1-26 AIS-V on XTC-28-3 Unused VT Circuits 1-67
Table 1-27 Circuit Creati o n Er ro r w ith VT 1 .5 Circ u i t 1-68
Table 1-28 DS3 Card Does Not Report AIS-P From External Equipment 1-69
Table 1-29 OC-3 and DCC Limitations 1-69
Table 1-30 ONS 15327 Switches Timing Reference 1-69
Table 1-31 Holdover Synchronization Alarm 1-70
April 2003
Cisco ONS 15327 Reference Manual, R3.4
xix
Tables
Table 1-32 Free-Running Synchronization Mode 1-70
Table 1-33 Daisy-Chained BITS Not Functioning 1-70
Table 1-34 Blinking STAT LED on Installed Card 1-71
Table 1-35 Bit Errors Appear for a Line Card 1-71
Table 1-36 Faulty Fiber-O ptic Connections 1-72
Table 1-37 LAN Cable Pinout 1-75
Table 1-38 Cross-Over Cable Pinout 1-75
Table 1-39 Available SFP Conn ectors 1-76
Table 1-40 Optical Card Tran smit and Receive Levels 1-77
Table 1-41 Power Supply Problems 1-78
Table 1-42 Power Consumption for Node and Cards 1-79
Table 1-43 Lamp Test for Card LEDs 1-80
Table 2-1 Critical Alarm Index 2-1
Table 2-2 Major Alarm Index 2-2
Table 2-3 Minor Alarm Index 2-2
Table 2-4 Conditions Index 2-3
Table 2-5 Alphabetical Alarm Index 2-4
Table 2-6 Alarm Index by Alarm Type 2-6
Table 2-7 Alarm Type/ Ob ject Definition 2-13
Table 2-8 DS3-12E Line Alarms 2-125
xx
Cisco ONS 15327 Reference Manual, R3.4
April 2003
About this Guide
This section expla ins the obje ctives, inten ded a ud ienc e, an d o rganiza tio n of th is pu bl icat ion an d
describes the conventions that convey instructions and other information.
This section provides the following information:
• Document Objectives
• Audience
• Related Documentation
• Document Conventions
• Obtaining Documentation
• Where to Find S afe ty a nd Warning Informati on
• Obtaining Technical Assistance
• Obtaining Additional Publications and Information
Document Objectives
The Cisco ONS 15 327 Troubleshooting Guide provides trou blesh ooti ng pr oc ed ures for SON ET a la rms
and error message s and p rovid es sym pt oms and solut ion s f or gene ral tro uble shoo tin g p robl ems wit h
CTC and hardware. T hi s guide al so co nt ain s h ard ware re pla c emen t pr oc ed ures. U se thi s d ocum ent i n
conjunction with the appropriate publications listed in the Related Documentation section.
Audience
To use this publication, you should be familia r with Cisc o or equivalent optical transmi ssion har dware
and cabling, te lec om mu nicat ions ha rdware an d c a bling, e lec tro ni c ci rcu itr y an d w iri ng pra cti ces, a nd
preferably have experience as a tele commu nic ations techn icia n.
Related Documentation
Use this Cisco ONS 15327 Troubleshooting Guide in conjunction with the following referenced
publications:
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xxi
Document Conventions
• Cisco ONS 15327 P rocedure Guide, Release 3.4
Provides installation, turn up, provisioni ng, and ma intainenc e proce dures for Cisco O NS 15327
nodes and networks
• Cisco ONS 15327 Refe rence Manual, Releas e 3.4
Provides reference information including detailed card specifications, feature descriptions, and
topology informatio n
• Cisco ONS 15454 a nd Cisco ON S 15 327 TL1 Comm and G uid e, Re lease 3.4
Provides a comprehensive list of TL1 commands for the ONS 153 27 and ONS 15454
• Release Notes fo r the C i sco O NS 15327 Release 3.4
Provides up-to-date caveats, closed issues, and new feature information
Document Conventions
This publication uses the following conventions:
Convention Application
About this Guide
boldface Commands and keywords in b ody t ext.
italic Command input that is supplied by the user.
[ ] Keywords or arguments that appear within square brackets are optional.
{ x | x | x } A choice of keywords (represented by x) appears in braces separated by
vertical bars. The user must select one.
Ctrl The control key. For example, where Ctrl + D is written, hold down the
Control key while pressing the D key.
screen font Examples of in forma ti on displa yed o n t h e scr e en.
boldface screen font Examples of information that the user must enter.
< > Command paramete rs tha t mu st be r epl ace d by m odu le- spe cific co de s.
Note Means reader take note. Notes contain helpful suggestions or references to material not covered in the
document.
xxii
Caution Means reader be careful. In this situation, the user might do something that could result in equipment
damage or loss of data.
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
About this Guide
Where to Find Safety and Warning Information
Warning
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol means danger. You are in a situation that could cause bodily injury. Before you
work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar
with standard practices for preventing accidents. To see translations of the warnings that appear in
this publication, refer to the translated safety warnings that accompanied this device.
Note: SAVE THESE INSTRUCTIONS
Note: This documentation is to be used in conjunction wit h the specif ic product instal lation guide
that shipped with the product. Please refer to the Installation Guide, Configuration Guide, or other
Where to Find Safety and Warning Inf ormation
For safety and warning information, refer to the Cisco ONS 15327 In stall ation Ha ndbook that
accompanied the product. This publication describes the international agency compliance and safety
information for the Cisco ONS 15327. It also includes translations of the safety warnings that appear in
the ONS 15327 sy stem do cu ment ation .
Obtaining Documentation
Cisco provides several ways to obtain documentation, techn ical assistance , and other tec hnical
resources. These sect ion s expla in h ow to obta in te chni cal infor ma tion fr om Ci sco Sy stem s.
Cisco.com
You can access the most c ur rent C isco doc um entat ion on the World Wide Web at this URL:
http://www.cisco.com/univercd/home/home.htm
You can access the Cisco website at this URL:
http://www.cisco.com
International Cisco websites can be accessed from this URL:
http://www.cisco.com/public/countries_languages.shtml
Documentation CD-ROM
Optical networking-re lated doc umen tation is available in a CD-ROM package that shi ps with yo ur
product. The Optical Networking Product Documentation CD-ROM is updated periodically and may be
more current than printed documentation.
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xxiii
Obtaining Technical As sistance
Ordering Documentation
You can find instructions for or de ring do cu ment atio n a t t his U RL:
http://www.cisco.com/univercd/cc/td/doc/es_inpck/pdi.htm
You can order Cisco documentation in these ways:
• Registered Cisco.com users (Cisco direct customers) can order Cisco product documentation from
the Networking Produ cts Market Pla ce:
http://www.cisco.com/en/US/partner/ordering/index.shtml
• Nonregistered Cisco.co m u ser s can o rd er docum en tati on th rou gh a l oc al ac count r epre sen tative by
calling Cisco Systems Corpo rate Headqu arter s (Califo rnia, U.S.A. ) at 408 526-7208 or, elsewhere
in North America, by calli ng 800 55 3-NE TS (6387).
Documentation Feedback
You can submit comments electronic ally on Cisco.c om . On the C isco Doc ume nta tion home pag e, cli ck
Feedback at the top of the page.
You can e-mail your comments to bug-d oc@cisc o.com.
About this Guide
You can submit comments by using the respon se card (i f present ) behind t he front cover of your
document or by wri ting t o the fo llowing a ddress:
Cisco Systems
Attn: Customer Docume nt Ordering
170 West Tasman Drive
San Jose, CA 95134- 988 3
We appreciate yo ur comm ents .
Obtaining Technical Assistanc e
Cisco provides Cisco.com , w hich incl udes the Ci sco Technical Assistance Cent er ( TAC) website, as a
starting point for all technical assistance. Customers and partners can obtain online documentation,
troubleshooting tips, and sample configurations from the Cisco T AC website. Cisco.com registered users
have complete access to the technical support resources on the Cisco TAC website, including TAC tools
and utilities.
Cisco.com
Cisco.com offers a suite of in tera ct ive, networked serv ices t hat le t y ou acc ess Ci sco in for mat ion,
networking solutions, services, pr ogram s, and re sources at any time, from anywhe re in the world.
xxiv
Cisco.com provides a br oad r ange of fea tur es an d s er vice s to h elp you wi th th ese ta sks:
• Streamline business processes and improve productivity
• Resolve technical issues with online support
• Download and te st so ft war e pa ck ag es
• Order Cisco learning m ateri als and me rcha ndise
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
About this Guide
• Register for online skill assessment, training, and certification programs
To obtain customized information and service, you can self-register on Cisco.com at this URL:
http://tools.cisco.com/RPF/register/register.do
Technical Assistance Center
The Cisco TAC is available to all customers who need technical assistance with a Cisco product,
technology, or solution. Two types of support are available: the Ci sco TAC website and the Cisco TAC
Escalation Center. The type of support that you choose depends on t he priorit y of the proble m and the
conditions stated in service contracts, when applicable.
We categorize Cisco TAC inquiries according to urgency:
• Priority level 4 (P4)—You need information or assistance conc erni n g Cisc o pr odu ct c apa bil ities,
product installation, or basic product configuration. There is little or no impact to yo ur business
operations.
• Priority level 3 (P3)—Operational performance of the network is impaired, but most business
operations remain functional. You and Cisco are willing to commit resou rces during normal bu siness
hours to restore service to satisfactory levels.
Obtaining Technical Assistance
Cisco TAC Website
The Cisco TAC website provides online documents and tools to help troubleshoot and resolve technical
issues with Cisco products and technologies. To access the Cisco TAC website, go to this URL:
http://www.cisco.com/tac
All customers, partners, and resellers who have a valid Cisco service contract have complete access to
the technical support resources on the Cisco TAC website. Some services on the Cisco TAC website
require a Cisco.co m login ID and password. If you have a valid service contract but do not have a login
ID or password, go t o th is URL to register :
http://tools.cisco.com/RPF/register/register.do
If you are a Cisco.com registere d user, and you cannot resol ve your tech ni cal issues by using the Cisco
TAC website, you can open a case online at this URL:
http://www.cisco.com/tac/caseopen
If you have Internet acc ess , we re com mend tha t y ou open P3 and P4 case s onl ine so that y ou ca n fu lly
describe the situation and attach any necessary files.
• Priority level 2 (P2)—Operation of an existing network is severely degraded, or significant aspects
of your business operations are negatively impacted by inadeq ua te pe rform an ce of Cisc o pro duct s.
You and Cisco will c ommit full-time resource s during normal busi ness hours to resolv e the situation.
• Priority level 1 (P1)—An existing network is “down,” or there is a critical impact to your business
operations. You and Cisco will commit all necessary resources around the clock to resolve the
situation.
April 2003
Cisco ONS 15327 Troubleshooting Guide, R3.4
xxv
Obtaining Additiona l Publications and Informatio n
Cisco TAC Escalation Center
The Cisco TAC Escalation Center addresses priority level 1 or priority level 2 issues. These
classifications are assigned when severe network degradation significantly impacts business operations.
When you contact the TAC Escalation Center with a P1 or P2 problem, a Cisco TAC engineer
automatically opens a case.
To obtain a dir ect ory o f t oll-fr ee C isco TAC telephone n umb er s f or yo ur co unt ry, go to this URL:
http://www.cisco.com/warp/public/687/Directory/DirTAC.shtml
Before calling, please check with your network operations center to d etermine the Cisco support services
to which your company is en title d: fo r example, SMARTnet, SMARTnet Onsite, or Netw ork Suppor te d
Accounts (NSA). When you call the center, please have available your service agreement number and
your product seria l nu mb er.
Obtaining Additional Publications and Information
Information about Cisco products, technologies, and network solutions is available from various online
and printed sources.
About this Guide
• The Cisco Product Catalog describes the networking products offered by Cisco Systems, as well as
ordering and custome r support ser vices. Access the Cisco Product Catalog at this URL:
http://www.cisco.com/en/US/products/products_catalog_links_launch.html
• Cisco Press publishes a wid e ran ge of n etworki ng pub l icatio ns. Cisco suggest s the se t itle s for new
and experienced users: Internetworking Terms and Acronyms Dictionary, Internetworking
Technology Handbook, Int ernet wo rkin g Troubleshooting Guide, and the Inter netw ork ing De sign
Guide. For current Cisco Press titles and other information, go to Cisco Press online at this URL:
http://www.ciscopress.com
• Packet magazine is the Cisco quart erly pub licatio n that provides the latest networki ng trend s,
technology breakthrough s, and Cisco products an d solutions t o help ind ustry professi onals ge t the
most from their networking investment. Included are networking depl oyment an d troublesho oting
tips, configuration e xamples, customer case studies, tutorials and train ing, certificatio n information,
and links to numerous in-de pth online resour ces. You can access Packet ma gazine at this U RL:
http://www.cisco.com/go/packet
• iQ Magazine is the Cisco bimonthl y publica tion that de livers the latest informat ion about Int ernet
business strategies for executives. You can access i Q Magazi ne at th is UR L:
http://www.cisco.com/go/iqmagazine
• Internet Protocol Journa l is a quarterly jour nal publ ished by Cisco Systems for engineering
professionals involved in designing, developing, and ope ratin g p ubli c a nd pr ivate internets a nd
intranets. You can access the Internet Protocol Journal at this URL:
http://www.cisco.com/en/US/about/ac123/ac147/about_cisco_the_internet_protocol_journal.html
xxvi
• Training—Cisco offers world-class networking t raining. Curren t offerings in network tra ining are
listed at this URL:
http://www.cisco.com/en/US/learning/le31/learning_recommended_training_list.html
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
CHAPTER
1
General Troubleshooting
This chapter provides proce dures for trouble shooting the most co mmon pro blems enc ounte red when
operating a Cisco ONS 153 27. To troubleshoot specific ONS 15327 alarms, see Chapter 2, “Alarm
Troubleshooting.” If you cann ot find wha t yo u ar e l ookin g f or cont act th e Ci sco Technical Assistance
Center (Cis co TAC).
This chapter includ es the fo llowing sec tions on network pr oble ms:
• 1.1 Network Troubleshoo tin g Tests—Describes loopbac ks and hair pin circui ts, whic h you can use
to test circuit paths through the network or logically isolate faults.
Note For network acceptance tests, refer to the Cisco ONS 15327 Procedure Guide.
• 1.2 Identify Points of Failure on a DS-N Circuit Path—Describes the steps to perform loopback and
hairpin tests, which y ou c an us e t o te st D S-N cir cuit path s t hrough th e n etwork o r l ogic al ly is olate
faults.
• 1.3 Identify Points of Failure on an OC-N Circuit Path—Describes the st eps to perf orm lo opbac k
and hairpin tests, which you can use to test OC-N ci rcuit pa ths through th e network or log ically
isolate faults.
April 2003
The remaining sections describe symptoms, problems, and solutions that are categorized according to
the following topics:
• 1.4 Restoring the Da tabase and D efault Se tting s—P rovides procedu res for re storing soft ware data
and restoring the n ode to t he d efaul t se tup.
• 1.5 PC Conne ctivity Troubleshooting— Provides troubl eshooting pr ocedure s for PC and network
connectivity to the ONS 15327.
• 1.6 CTC Operation Troubleshoot ing—Provide s tro ubles hoot ing pro cedu res f or CTC l ogin o r
operation problems.
• 1.7 Circui ts a nd Timing—Provides tro ubleshoo ting pro cedure s for cir cuit crea tion an d error
reporting as well as timi ng refere nce erro rs and alar ms.
• 1.8 Fiber a nd Cabl ing—Pr ovides tr ouble sho oti ng pro cedu re s f or fiber a nd cab ling c on nectivity
errors.
Cisco ONS 15327 Troubleshooting Guide, R3.4
1-1
Network Troubleshooting Tests
1.1 Network Troubleshooting Tests
Use loopbacks and hairpins to te st ne wly created cir cuits before run ning li ve tra ff ic or to logically loca te
the source of a network failure. All ONS 15327 line (traffic) cards, except Ethernet cards, allow
loopbacks and ha irpins.
Caution On OC-N cards, a facility loopback applies to the entire card and not an individual circuit. Exercise
caution when using loop ba ck s o n an O C-N ca rd c arryi ng live traffic.
A facility loopback tests the line interface unit (LIU) of a card, the mechanical interface card (MIC), and
related cabling. After applyin g a facility loopback on a port, use a test set to run traffi c over the loopb ack.
A successful facility loopback isolates the LI U, th e M IC, o r the cab lin g pla nt as the po tential cause of a
network problem. Figure 1-1 shows a facility loopback on an XTC-14 or XTC-28-3 ca rd.
Figure 1-1 Facility Loopback Process on an XTC Card
XTC
Test Set A
DS-N
MIC OC-N
Chapter1 General Troubleshooting
DS-N
Facility
loopback
76186
To test the LIU on an OC-N card, connect an optical test set to the OC-N port and perform a facility
loopback or use a loopback or hairpin on a card that is farther along the circuit path. Figur e 1-2 shows a
facility loopback on an OC-N card.
Caution Before performing a facilit y loop ba ck on a n OC -N c ard, m ake sur e the car d co ntain s at le ast two da ta
communications channel (DCC) paths to the node where the card is installed. A second DCC provides
a nonlooped path to log into the node after the loopback is applied, thus enabling you to remove the
facility loopback. Ensuring a second DCC is not necessary if you are directly connected to the
ONS 15327 conta ining the l oopback OC-N car d.
Figure 1-2 Facility Loopback Process on an OC-N Card
OC-N OC-NXTC
Test Set
1-2
90642
A terminal loopback tests a circuit path as it passes through t he XTC card and loops back from the card
with the loopback. Figure 1-3 on page 1- 3 shows a terminal loopback on an OC-N card. The test-set
traffic comes in on the MIC card DS-N ports and goes through the XTC card to the OC-N card. The
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Chapter 1 General Troubleshooting
terminal loopback on the OC-N card turns the signal around before it reaches the LIU and sends it back
through the XTC card to the MIC card. This test verifies that the XTC card cross-connect circuit paths
are valid, but does not test the LIU on the OC-N card.
Figure 1-3 Terminal Loopback Process on an OC-N Card
Network Troubleshooting Tests
Terminal loopback
XTC
Test Set A
DS-N
MIC OC-N
DS-N
76191
Figure 1-4 shows a terminal loopback on a G1000-2 card. The test-set traffic comes in on the MIC card
DS-N ports and g oe s t hroug h th e X TC car d to t he G 10 00-2 c a rd. T he te rmi nal loop ba ck on the
G1000-2 card turns the signal around before it r ea ches the LIU and sends it back thr ough the XTC card
to the MIC card. This test verifies that the XTC card cross-connect circuit paths are valid, but does not
test the LIU on the G1000 -2 card.
Figure 1-4 Terminal Loopback Process on a G1000-2 Card
MIC
XTC
G1000-2
Test Set
90641
A hairpin circui t br ings tra ffic in and ou t on a D S-N por t i nste ad o f se nd ing the tra ffic onto the OC -N .
A hairpin loops back only the specific STS or VT circuit and does not cause an entire OC-N port to loop
back, which would drop all traffic on the OC-N port. Th e hairpi n allows you to test a ci rcu it on nodes
running live traffic. Figure 1-5 shows the hairpin circuit proc ess on a OC-N car d.
April 2003
Figure 1-5 Hairpin Circuit Process on an OC-N Card
Hairpin circuit
XTC
Test Set A
DS-N
MIC OC-N
DS-N
76193
Cisco ONS 15327 Troubleshooting Guide, R3.4
1-3
Identify Points of Failure on a DS-N Circuit Path
A cross-connect loopback tests a circuit path as it passes through the cross-connect card and loops back
to the port being tested. Testing and verifying circuit integrity often involves taking down the whole line;
however, a cross-conne ct lo opb ack all ows you to cr ea te a l oo pbac k o n a ny embe dd ed cha nne l a t
supported payloads at the STS-1 granularity and higher. For example, you can loop back a single STS-1,
STS-3c, STS-6c, etc., on an optical facility without interrupting the other STS circuits.
You can create a cross -c onn ect loo pba ck o n a ll worki ng or p rot ect opt ic al ports un less the pr ote ct p ort
is used in a 1+ 1 pro te ctio n g rou p and is in worki ng m ode. If a t e rmi nal or fac ilit y l oop back exi sts on a
port, you cannot use t he c ro ss-con nect lo opbac k. Figu re 1-6 shows a cross-connect loopback on an
OC-N port.
Figure 1-6 Cross-Connect Loopback Process on an OC-N Port
Test Set
OC-Nx
x
XTC
Chapter1 General Troubleshooting
OC-Ny
90645
1.2 Identify Points of Failure on a DS-N Circuit Path
Facility loopbacks, hairpin circuits, an d terminal loopba cks are often used to test a circu it path through
the network or to logically isolate a fault. Performing a loopback test at each point along the circuit path
systematically isolates possib le points of failure.
The example in this section tests an DS-N circuit o n a two-node bidirecti onal line switched ring (BLSR).
Using a series of facility loopback s, hai rpin circu its, and termin al loopb acks, the path of the circui t is
traced and the possible points of failure are tested and eliminated. A logical progression of network test
procedures applies to this scenario:
1. Facility loopback on t he s our ce -n ode X TC p ort
2. Hairpin on the source-nod e XTC port
3. Terminal loopback to the destinat ion-n ode XT C por t
4. Hairpin on the dest inat ion -no de X TC p ort
5. Facility loopback to the destination XTC port
Note The test seque nce for your c irc uits differs ac c ord ing to t he t y pe of c irc uit a nd net work t op ology.
Note All loopback tests require on-si te personne l.
1-4
Note These procedures are perfor med when power connecti ons to the nod e(s) or site (s) ar e assumed t o be
within necessary specificat ions. If the network t ests do not isolat e the pro blems, tro ubleshoo t outward
for power failure.
Cisco ONS 15327 Troubleshooting Guide, R3.4
April 2003
Loading...