Sun Microsystems, Inc.  Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1019516.1
Update Date:2009-08-18
Keywords:

Solution Type  Technical Instruction Sure

Solution  1019516.1 :   How to identify and interpret the LEDs on the Sun[TM] Netra CT900  


Related Items
  • Sun Netra CT900 Server
  •  
  • Sun Netra CP3260 ATCA Blade Server
  •  
  • Sun Netra CP3220 ATCA Blade Server
  •  
  • Sun Netra CP3010 Blade Server
  •  
Related Categories
  • GCS>Sun Microsystems>Boards>NEBS-Certified Servers
  •  
  • GCS>Sun Microsystems>Servers>NEBS-Certified Servers
  •  

PreviouslyPublishedAs
240425


Description
Observation of the LED status indicators can provide essential diagnostic information in the event of a problem occurring. This document will provide an explanation of the definition and function of the LEDs for each of the core FRUs of the Sun[TM] Netra CT 900. These being the Shelf Manager Modules (ShMM), the Switch Node Boards, the Shelf Alarm Panel (SAP), and the Power Entry Modules (PEM)


For the definition of the LEDs on each individual Server Node Board, refer to the relevant service manual in the customer documentation available at http://docs.sun.com

Steps to Follow
Check all of the LEDs for unusual condition. Description of the meaning of
each of the LEDs is given below.
  • Shelf Management Module (ShMM)

For location of the LEDs refer to the attachment ShMM.gif at the bottom of this document


The LEDs on the ShMM fall into 3 categories

  1. Ethernet LEDs

  2. ShMM Status LEDs

  3. Hot Swap LED

Ethernet LEDs

Name

Colour

Description

Ethernet 0 Link Speed

Yellow Green

This LED is normally Yellow to indicate that the connection to the switch is running at 100Mbps. If there is a problem across with the connection, the link may reduce speed to 10Mbps and the LED will turn Green. Ethernet port 0 on the ShMM is connected port 1 of the Base Network. The upper ShMM connect to the switch in slot 7, and the lower ShMM connects to the switch in slot 8.

Ethernet 0 Activity

Green

Any activity in the switch Base Network will cause this green LED to Blink.

Ethernet 1 Link Speed

Yellow Green

By default there is no connection to Ethernet 1 so the normal state of this LED is turned Off. If Jumper E1 on the CP3140 switch is connected between pins 1-2, port 17 on the base network is disconnected from the switch front panel but is instead routed Ethernet 1 on the ShMM across the mid-plane. The LED will then follow the same criteria as Ethernet 0.

Ethernet 1 Activity

Green

As with the Ethernet 1 Link Speed LED, the default for this LED is to be turned Off since there is no connection. If the jumper is made on the switch, this green LED will then Blink when there is network activity


Status LEDs

Name

Colour

Description

Lower Status LED

Green

This LED shows Solid Green to indicate that that the Shelf Management Module is operating as the Active ShMM.

If the ShMM is operating in the backup mode, the LED will Blink.

Upper Status LED

Red

When this LED shows solid RED it indicates "Out of Service" implying that the ShMM is currently not operational. If this occurs immediately after inserting the ShMM sheck whether the Lower status LED is lit, it may be necessary to press the reset button to

Note 1: If both ShMM have a Solid Green LED displayed, sometimes referred to as a 'Racing' condition,  both ShMM are competing for the primary ShMM position.  This has been observed with older firmware, but not since Release 3 of the ShMM firmware. One may attempt to pull one of the ShMMs to allow the other one to become Primary.

Note 2: If both ShMM are displaying Solid Red LEDs, this indicates that both ShMM are in a failed stated and under this condition you will not be able to connect to either of the ShMMs in question.  Normally, one would examine the chassis or replace one of the ShMM to verify that we have actually a faulty ShMM. In this condition, the fan will spin up at full speed.  And if it is not fixed in 15 minutes, the chassis will power itself down even if all other components are still functioning normally.


Hot Swap LED

LED State

ShMM Status

Description

Solid Blue

M1
FRU Inactive

The ShMM is ready to be removed. The bottom latch is open/not fully closed. In this condition you will not be able to make a connection to the ShMM.

Blinking (from solid)

M2
Activation Request

The IPMI micro-controller has requested permission to boot the payload from the shelf management controller. Boot up messages will be displayed via the serial connection.

Off

M3-M4
Active

This should be the state under normal operation. The IPMI micro-controller has received permission to boot the payload, and has done so.

Blinking (from off)

M5-M6
Deactivation Request

Opening the bottom latch activates this state. The IPMI micro-controller has requested permission to shut down the payload.


  • Shelf Alarm Panel

For location of the LEDs refer to the attachment SAP.gif at the bottom of this document


The Shelf Alarm Panel has 6 LEDs which may indicate a problem on the Shelf.

If the LED is lit, the condition is present.

If the LED is Blinking, the Alarm Silence Button has been pushed

If all Six LEDs are lit, there is no active ShMM

Alarm LEDs

LED Name

Colour

Description

Critical
Telco Alarm

Red

An error or event that is detected by the system with a fatal impact to the system. In this case, the system/node can not continue to operate. Check LEDs and message files on all other boards

Major
Telco Alarm

Red

An error or event that is detected by the system and has discernible impact to system operation. In this case, the system/node can continue to operate but in a "degraded" fashion (reduced performance or loss of non-fatal feature reduction). An example could be the loss of one of two mirrored disks. Check LEDs and message files on all other boards

Minor
Telco Alarm

Amber

An error or event that is detected by the system but has little impact to actual system operation. An example would be a correctable ECC error. Check LEDs and message files on all other boards

User 1

Amber

Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem

User 2

Amber

Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem

User 3

Amber

Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem


  • Power Entry Module (and Fan Trays)

Fan Trays and PEMs have the same set of LEDs with similar definition. To simplify this document, only the PEM LEDs are detailed.

For location of the LEDs refer to the attachment PEM.gif at the bottom of this document.


PEM Status LEDs

LED Name

Colour

Description

OK Status

Green

Indicates the Power Entry Module is receiving power.

Failure Status

Red
Amber

Indicates a failure of the PEM. It is safe to remove without pressing the hot swap button providing the other PEM is showing the OK LED.

Early models have a Red LED. Newer model have an Amber LED.

Hot Swap

Blue

When Off, indicates PEM is active. Press the hot swap button to prepare for removal.

When lit Solid Blue , The PEM is inactive, it is safe to remove the PEM after turning off external power.

LED Blinks during transition from OFF to ON, and ON to OFF. If the LED remains flashing, examine the other PEM to determine if it is working properly and has power applied.


  • Netra CP3140 Switch Board

For location of the LEDs refer to the attachment cp3140_front_panel.gif at the bottom of this document.


The LEDs on the Netra CP3140 Switch board fall into 4 categories

  1. Switch status LEDs

  2. Hot swap LED

  3. Port display select LEDs

  4. Port link status and speed LEDs


Netra CP3140 Status LEDs

LED Name

Colour

Normal Operation

Description

OOS*

Red

Off

Out of service. This LED lights on a critical switch error.

Active

Green

On

This LED is lit when the switch OS is booted and switching

Minor*

Amber

Off

Minor Error/User Defined. This LED is software defined.

*The OOS and MINOR LEDs are both lit when the board is powered but not booted.


Netra CP3140 Hot Swap LED

LED State

Hot Swap Status

Description

Solid Blue

M1
FRU Inactive

The IPMI micro-controller is booted, but the switch OS is not. The bottom latch is open/not fully closed. This is the only state where it is safe to remove the board. In this condition you will not be able to make a connection to the Switch.

Blinking
(from Solid)

M2
Activation Request

The IPMI micro-controller has requested permission to boot the switch OS from the ShMM. Boot up messages will be displayed via the serial connection.

Off

M3-M4
Active

This should be the state under normal operation. The IPMI micro-controller has received permission to boot the payload, and has done so.

Blinking
(from Off)

M5-M6
Deactivation Request

The IPMI micro-controller has requested permission to shut down the Switch OS. Opening the bottom latch activates this state.



Netra CP3140 Network Display Select LEDs

Name

Description

3.0

When lit this LED indicates that the Base Network has been selected for display by the Switch Port Link Status LEDs as detailed below

3.1

When lit this LED indicates that the Extended (Fabric) Network has been selected for display by the Switch Port Status LEDs as detailed below

Note: Only one of these LEDs will be lit at any time.

Netra CP3140 Switch Port Link Status LEDs

Colour

Description

Orange

Indicates that the port has an active link running at 1000Mbps.

Green

Indicates that the port has an active link running at 100Mbps.

Yellow

Indicates that the port has an active link running at 10Mbps.

Off

Indicates that the link is not up.

These definitions apply to all 24 ports on the selected Network as shown by the Netra CP3140 Network Display Select LEDs

The shelf slots and switch ports are not directly mapped, instead each slot corresponds to a logical port on the switch.

Netra CP3140 Port Mapping

Switch Port

Slot 7
Base Network
Connection

Slot 7
Extended Network
Connection

Slot 8
Base Network
Connection

Slot 8
Extended Network
Connection

1

Upper ShMM eth0

Switch Slot 8

Lower ShMM eth0

Switch Slot 7

2

Switch Slot 8

Node Slot 6

Switch Slot 7

Node Slot 6

3

Node Slot 6

Node Slot 9

Node Slot 6

Node Slot 9

4

Node Slot 9

Node Slot 5

Node Slot 9

Node Slot 5

5

Node Slot 5

Node Slot 10

Node Slot 5

Node Slot 10

6

Node Slot 10

Node Slot 4

Node Slot 10

Node Slot 4

7

Node Slot 4

Node Slot 11

Node Slot 4

Node Slot 11

8

Node Slot 11

Node Slot 3

Node Slot 11

Node Slot 3

9

Node Slot 3

Node Slot 12

Node Slot 3

Node Slot 12

10

Node Slot 12

Node Slot 2

Node Slot 12

Node Slot 2

11

Node Slot 2

Node Slot 13

Node Slot 2

Node Slot 13

12

Node Slot 13

Node Slot 1

Node Slot 13

Node Slot 1

13

Node Slot 1

Node Slot 14

Node Slot 1

Node Slot 14

14

Node Slot 14

Not Used

Node Slot 14

Not Used

15

Not Used

Not Used

Not Used

Not Used

16

Not Used

Front Panel socket

Not Used

Front Panel socket

17

*Front Panel socket

RTM socket

*Front Panel socket

RTM socket

18

RTM socket

RTM socket

RTM socket

RTM socket

19

RTM socket

RTM socket

RTM socket

RTM socket

20

RTM socket

RTM socket

RTM socket

RTM socket

21

RTM socket

RTM socket

RTM socket

RTM socket

22

RTM socket

RTM socket

RTM socket

RTM socket

23

RTM socket

RTM socket

RTM socket

RTM socket

24

RTM socket

RTM socket

RTM socket

RTM socket

* By Default Port 17 on the Base Network is routed to the Switch Front Panel.
The User may enable Net-connect for ShMM Netconsole redundancy by installing jumper E1 on pins 1-2 of each of the Netra CP3140 Switch Boards. With this jumper installed, port 17 on the Base Network is routed through to ethernet 1 on the ShMM and the front panel socket is disabled. Switch Board 7 routes to the Upper ShMM, and Switch Board 8 routes to the lower ShMM.

  • Reading the LED state through the Shelf Management Module

In many cases it will not be possible to gain physical access to view the status LEDs. In these circumstances the clia getfruledstate command will provide additional scope for determining the status of the various components.  To use this feature requires that you can connect to the ShMM via the network or serial port. If connection to one ShMM is not possible try the other one.


The syntax for using this will change slightly depending whether you wish to collect the information on all the FRUs or one FRU at a time. It may be necessary to run the clia fru command to identify the IPMI address to be used with the clia getfruledstate command.


Example 1: To interrogate the LED status for the Upper ShMM


#clia getfruledstate -v 10


10: FRU # 0, Led # 0 ("BLUE LED"):

    Local Control LED State: LED OFF

    LED's color capabilities:

        Colors supported(0x02): BLUE

        Default LED Color in Local Control State(0x01): BLUE

        Default LED Color in Override State(0x01): BLUE


10: FRU # 0, Led # 4 ("Application Specific LED# 1"):

    Local Control LED State: LED ON, color: GREEN

    LED's color capabilities:

        Colors supported(0x0C): RED GREEN

        Default LED Color in Local Control State(0x03): GREEN

        Default LED Color in Override State(0x03): GREEN


In this condition we observe Blue LED OFF and Green LED ON indicating a normal operational status, and that this is the Active ShMM.


Example 2: To interrogate the LED status for the Shelf Alarm Panel


# clia getfruledstate 20 8


20: FRU # 8, Led # 1 ("LED 1"):

Local Control LED State: LED OFF


20: FRU # 8, Led # 2 ("LED 2"):

Local Control LED State: LED ON


20: FRU # 8, Led # 3 ("LED 3"):

Local Control LED State: LED OFF


This shows the three Telco Alarm LEDs. In this example, the Major Telco Alarm LED is ON therefore further investigation of the other boards in the shelf will be required.




Product
Sun Netra CT 900 Server
Netra CP3010 Board
Netra CP3020 Board
Netra CP3060 Board
Sun Netra CP3140 ATCA Switch Blade
Sun Netra CP3220 ATCA Blade Server
Sun Netra CP3260 ATCA Blade Server
Netra CP3240 Switch

Internal Comments
This document contains normalized content and is managed by the the Domain Lead(s) of the respective domains. To notify content owners of a knowledge gap contained in this document, and/or prior to updating this document, please contact the domain engineers that are managing this document via the "Document Feedback" alias(es) listed below:
Domain Lead: Dencho.Kojucharov@sun.com
Feedback Alias: blade_normalizers@sun.com

normalized, verify, Netra, CT900, CP3010, CP3020, CP3060, CP3140, CP3240, CP3220, CP3250, CP3260, ATCA, LED, ShMM, PEM

Attachments
This solution has no attachment
  Copyright © 2011 Sun Microsystems, Inc.  All rights reserved.
 Feedback