| Document Audience: | INTERNAL |
| Document ID: | A0240-1 |
| Title: | Certain 1Gb PCI Dual FC Network Adapter+ (X6727A HBA) may cause internal disks of Sun Fire V480/V880 to not be recognized on boot or cause the FC loop B (HBA Port 1) to be unstable. |
| Copyright Notice: | Copyright © 2007 Sun Microsystems, Inc. All Rights Reserved |
| Update Date: | Wed Sep 01 00:00:00 MDT 2004 |
___________________________________________________________________
*** Sun Confidential: Internal Use and Authorized VARs Only ***
__________________________________________________________________
This message including any attachments is confidential information
of Sun Microsystems, Inc. Disclosure, copying or distribution is
prohibited without permission of Sun. If you are not the intended
recipient, please reply to the sender and then delete this message.
__________________________________________________________________
FIELD CHANGE ORDER
(For Authorized Distribution by Sun Services)
FCO #: A0240-1
Status: inactive
Synopsis: Certain 1Gb PCI Dual FC Network Adapter+ (X6727A HBA) may cause internal disks of Sun Fire V480/V880 to not be recognized on boot or cause the FC loop B (HBA Port 1) to be unstable.Date: Sep/01/2004
SunAlert: No
Top FIN/FCO Report: No
Products Reference: Sun Fire V480, Sun Fire V880
Product Category: Server / System Component
Product Affected:
Systems Affected:
Mkt_ID Platform Model Description
------ -------- ----- -----------
- A30 - Sun Fire V880
- A37 - Sun Fire V480
X-Options Affected:
Mkt_ID Platform Model Description
------ -------- ----- -----------
X6727A V480/V880 - PCI Dual FC Network Adapter+ (Crystal+)
X9713A V480 - Loop-B FC-AL Cable
X6755A V880 - Internal Loop B cable
Parts Affected:
Part Number Description
--------- -----------
375-3030-01 1GB/Sec PCI Dual FC Network Adapter+ (Crystal+)
530-3018-xx Loop-B FC-AL Cable
530-3056-xx Internal Loop B cable
(SCSI Devices)
Type Vendor Model SerialNumber(Min) SerialNumber(Max) Firmware
---- ------ ------- ----------------- ----------------- --------
N/A
References:
Bug: 5014917
ESC: 550986
PSIM: Crystal+ HBA with internal loop B cable attached in V480
and V880 Systems at:
http://acts.ebay/bulletins/index.cgi?bulletin=236Issue Description:
This issue has two impacts. The first is that internal disks may not be
recognized during bootup and the second possibility is the FC loop that connects
to the V480/V880 internal FC disk drives via loop B cable may become disrupted
and unstable.
Affected Configurations
-----------------------
The specific configurations for this issue are as follows:
- Sun Fire V480 or V880
- with 1Gb PCI Dual FC Network Adapter+
- with the Loop-B cable (specific for V480 or V880)
- and using Crystal+ Port 1 (Port 2 is not affected by this issue)
Each V480/V880 can take more than one Crystal+ card. Only one loop B cable is
needed to connect a Crystal+ to internal disk(s). Each Loop B cable has 2
connectors on each end of the cable, one for transmit and one for receive.
Note: There is no issue with the Crystal+ HBA when no internal loop B cable is
connected.
Symptoms
--------
Symptom 1:
Internal disk drives connected to the Crystal+ port 1 through the loop B cable
are not recognized during bootup. This can be observed using the
"probe-scsi-all" OBP command.
Example 1: Only one of two disks shows up via Loop B (qlc@4). Also, disk WWN
information is missing (all zeros):
{2} ok probe-scsi-all
/pci@9,600000/SUNW,qlc@2
LiD HA LUN --- Port WWN --- ----- Disk description -----
0 0 0 500000e0106d4671 FUJITSU MAP3735F SUN72G 1201
1 1 0 500000e0106d4651 FUJITSU MAP3735F SUN72G 1201
/pci@8,600000/pci@1/SUNW,qlc@5
/pci@8,600000/pci@1/SUNW,qlc@4
LiD HA LUN --- Port WWN --- ----- Disk description -----
70 7e 0 0000000000000000 FUJITSU MAP3735F SUN72G 1201
{2} ok
Example 2: Neither of the two disks show up via Loop B (qlc@4).
{2} ok probe-scsi-all
/pci@9,600000/SUNW,qlc@2
LiD HA LUN --- Port WWN --- ----- Disk description -----
0 0 0 500000e0106df131 FUJITSU MAP3735F SUN72G 1201
1 1 0 500000e0106df0f1 FUJITSU MAP3735F SUN72G 1201
/pci@8,600000/pci@1/SUNW,qlc@5
/pci@8,600000/pci@1/SUNW,qlc@4
{2} ok
Example 3: Both two disks show up via Loop B (qlc@4) but without the WWN
information (all zeros):
{2} ok probe-scsi-all
/pci@9,600000/SUNW,qlc@2
LiD HA LUN --- Port WWN --- ----- Disk description -----
0 0 0 500000e0106d6b81 FUJITSU MAP3735F SUN72G 1201
1 1 0 500000e0106de091 FUJITSU MAP3735F SUN72G 1201
/pci@8,600000/pci@1/SUNW,qlc@5
/pci@8,600000/pci@1/SUNW,qlc@4
LiD HA LUN --- Port WWN --- ----- Disk description -----
70 7e 0 0000000000000000 FUJITSU MAP3735F SUN72G 1201
7e 7e 0 0000000000000000 FUJITSU MAP3735F SUN72G 1201
{2} ok
Symptom 2:
Even if the disks are recognized, Crystal+ Port 1 with the internal loop B cable
attached may become unstable after boot up.
This is observed by persistent OFFLINE/ONLINE messages in /var/adm/messages:
qlc: [ID 686697 kern.info] NOTICE: Qlogic qlc(11): Loop OFFLINE
qlc: [ID 686697 kern.info] NOTICE: Qlogic qlc(11): Loop ONLINE
qlc: [ID 686697 kern.info] NOTICE: Qlogic qlc(11): Loop OFFLINE
qlc: [ID 686697 kern.info] NOTICE: Qlogic qlc(11): Loop ONLINE
Symptom 3:
If it is not possible to use the OBP, then the following can be done
to observe this symptom:
Use the SunVTS disktest installed on the internal FCAL disk devices. De-select
all tests. Select "FCAL-devices(fp0)" and verify that this selects the internal
disk drives connected to Port 1 of Crystal+ HBA, for example, c1t0d0 & c1t1d0.
Start the test.
If the Crystal+ loop B is unstable, error messages displayed by SunVTS would be
as follows:
FATAL c1t0d0: "asynchronous IO error: Error reading block 13825""
Probable_Cause(s):
(1)Media/Cable/Controller error
Recommended_Action(s):
(1)Rectify the media/Cable/Controller
(2)De-Select the AsyncIO Test Method
(3)If the problem persists, call your authorized Sun service provider.
At the same time SunVTS is running, the system console would display:
Jun 3 14:47:01 hba2-66 scsi: WARNING:
/pci@9,600000/pci@1/SUNW,qlc@4/fp@0,0/ssd@w500000e010076d22,0 (ssd6):
Jun 3 14:47:01 hba2-66 SCSI transport failed: reason 'timeout':
retrying command
Jun 3 14:47:01 hba2-66 scsi: WARNING:
/pci@9,600000/pci@1/SUNW,qlc@4/fp@0,0/ssd@w500000e010164782,0 (ssd4):
Jun 3 14:47:01 hba2-66 SCSI transport failed: reason 'timeout':
retrying command.
and the SunVTS error logs would contain:
Warnings "SunVTS5.1ps2: VTSID 4013 disktest.1.WARNING
c1t0d0: "Read Link Status Read Failed -2"
Root Cause
----------
Root cause of this issue has been identified to be with Infineon transceiver's
2nd source PIN TIA component. This results in the transceiver intermittently
sending false signals to the port bypass circuit on Crystal+ HBA, indicating
presence of external Fibre Channel device when no such device is attached.
The port bypass circuit then switches back and forth between "internal FC loop
only" mode and "internal and external FC loop" mode. The internal FC loop that
connects to the V480 or V880 internal FC disk drives via loop B cable thus
becomes disrupted (unstable). The functional specification of this 2nd source
PIN TIA does not support this particular port bypass design. The 1st source PIN
TIA has no such limitation.
The technical fix is to connect a loopback plug or cable (SC connector type with 50
or 62.5 um multimode cable) to the Crystal+ HBA external port 1 (the port further
away from PCI edge connector).
The corrective action was made available by Sun manufacturing via ECO: WO_29320
released June 02, 2004.Implementation:
---
| | MANDATORY (Fully Pro-Active)
---
---
| | CONTROLLED PRO-ACTIVE (per Sun Geo Plan)
---
---
| X | UPON FAILURE
---
Replacement Time Estimate:
0.25 hours
Special Considerations:
Corrective Action:
If the configurations and symptoms are present for this issue, do the following:
- install Loopback Plug 530-3326-01 in Port 1
Note: Do not replace the Crystal+ PCI Dual FC Network Adapter+ (part number
375-3030) for this issue.
Please use the instructions below:
1) Install the loopback plug mentioned above on the external
port (Port 1, the port further away from PCI edge connector).
2) Use "init 0" to bring system down to Open Boot PROM (OBP)
OK prompt level.
3) Issue a "reset-all" command at the OBP OK prompt.
4) Then issue a "probe-scsi-all" command at the OK prompt.
Expect to see 2 paths to all disks, with valid WWN, LoopID and HA fields.
5) Lastly issue a "boot -r" command to bring up the system to the unix level.
Comments:
See the Sun System Handbook reference for this issue mentioned in Sun Fire
V480/V880 Notes:
http://sunsolve.central/handbook_internal/Devices/Fibre_Channel/FIBRE_Dual_FC_AL.html
Existing documentation states that the external port 1 should not be used when
the internal loop B cable is installed, so no functionality is lost by connecting
the loopback plug/cable.
Billing Type:
Warranty: Sun will provide parts at no charge under Warranty
Service. On-Site Labor Rates are based on how the
system was initially installed.
Contract: Sun will provide parts at no charge. On-Site Labor Rates
are based on the type of service contract.
Non Contract: Sun will provide parts at no charge. Installation by
Sun is available based on the On-Site Labor Rates
defined in the Price List.
--------------------------------------------------------------------------Implementation Footnote:
________________________
i) In case of Mandatory FCOs, Sun Services will attempt to contact
all known customers to recommend the part upgrade.
ii) For controlled proactive swap FCOs, Sun Services mission critical
support teams will initiate proactive swap efforts for their respective
accounts, as required.
iii) For Replace upon Failure FCOs, Sun Services partners will implement
the necessary corrective actions as and when they are required.
--------------------------------------------------------------------------
All released FINs and FCOs can be accessed using your favorite network
browser as follows:
SunSolve Internal Access:
_______________________
* Access the SunSolve Online URL at http://sunsolve.Central/
* From there, select the appropriate link to browse the FIN or FCO index.
Internet Access:
_______________
* Access the top level URL of https://spe.sun.com
FIN/FCO Homepage Access:
_________________________
* Access the top level URL of http://sdpsweb.Central/FIN_FCO/index.html
* From there, select the appropriate link to query or browse the FIN and
FCO Homepage collections.
To submit either a FIN or FCO refer to the following URLs for templates
and instructions;
* For FCO: http://pronto.central/fco.html
* For FIN: http://pronto.central/fin.html
--------------------------------------------------------------------------
General:
________
Send questions or comments to finfco-manager@Sun.COM
---------------------------------------------------------------------------