POWER7 information

RIOIP01

Use this procedure to isolate a failure in a RIO/HSL/12X loop using service tools.

If you need additional information for failing part numbers, location codes, or removal and replacement procedures, see Part locations and location codes. Select your machine type and model number to find additional location codes, part numbers, or replacement procedures for your system.

Follow the steps in the Main task and you will be directed to the proper subtasks.

Note: During this procedure, you will be disconnecting and reconnecting cables. If errors concerning missing resources (such as disk units and RIO/HSL/12X failures) occur, ignore them. Missing resources will report in again when the loop reinitializes.

Main task

Were you sent here from a B600 xxxx reference code?
- No: Continue with the next step.
- Yes: Use the serviceable event view and the system service documentation to search for a B700 xxxx reference code with the same last four characters reported at approximately the same time. If you find one, perform service on that reference code first, and when you close that problem, close this one as well. If you do not find one, continue with the next step.
Before powering down any system unit or expansion unit, work with the customer to end all subsystems in all of the partitions using each partition's console.
From the partition control panel, IPL the system or partition to Dedicated Service Tools (DST).
Attention: Do not use function 21.
Are all system and expansion units on the loop powered on?
- Yes: Go to step 6.
- No: Continue with the next step.
Perform the following steps:
1. Power on all system and expansion units on the loop. If a frame cannot be powered on, perform the Cannot power on unit subtask below, and then continue with step 6.
2. Was the RIO/HSL/12X link error cleared up when the frames were powered back on?
  - No: Continue with the next step.
  - Yes: Go to Verify a repair .
    This ends the procedure.
Perform the following steps:
1. Access the Service Action Log (SAL) entry for this error; the field replaceable units (FRUs) should be listed there. Look for part numbers and descriptions for the FRUs containing the RIO/HSL/12X port for two frames. There should also be a FRU for the cable between them. The locations information for the FRUs is the location of the failed ports on the failed link.
2. Record the loop number from the SAL (if it is displayed there in one of the FRU descriptions) or from the first four characters of word 7 of the reference code. Go to Converting the loop number to 12X port location labels to determine which RIO/HSL/12X cables on the system you are working with.
  Is this information in the SAL?
  - Yes: Continue with the next step.
  - No: Perform Manually detecting the failed link below, and then continue with the next step of the main task.
Is the cable connecting the failed ports an optical cable?
- No: Go to step 9.
- Yes: Continue with the next step.
Perform the following steps:
1. Clean the RIO/HSL/12X cable connectors and ports using the fiber optic cleaning kit and the fiber-optic cleaning procedures in "SY27-2604 Fiber Optic Cleaning Procedures".
2. To determine if cleaning the connectors and ports solved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  - No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
  - Yes: Continue with the next step.
There are now three cases to consider. Continue with the appropriate subtask of this procedure:

The ports on both ends of the failed link are in different system units on the loop

There may be failed hardware that will report a different error on the other system units. Perform the following steps:
1. Resolve any other RIO/HSL/12X problems in the serviceable event view on the other system units.
2. Perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  - No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
  - Yes: Continue with the next step.
Is the cable an optical RIO/HSL/12X cable?
- Yes: Go to step 4.
- No: Continue with the next step.
Perform the following steps:
1. Verify that the cables are connected securely. For any cable that was loose, disconnect the cable at that end, wait 30 seconds, and reconnect the cable securely. If there are thumbscrews, you must tighten both thumb screws within 30 seconds of when the cable makes contact with the port.
2. If you disconnected and reconnected the cable at either end, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  - No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
  - Yes: Continue with the next step.
Replace the cable between the two system unit ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Exchange the FRU with the RIO/HSL/12X port in one of the system units. If you are working with a serviceable event view and the RIO/HSL/12X FRUs are listed, exchange the FRU corresponding to the first RIO/HSL/12X cable port listed. Otherwise, exchange the FRU that is quickest and easiest to replace). To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Exchange the remaining FRU with the RIO/HSL/12X port on the other system unit. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Use the procedure HSL_LNK to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
- No: Call your next level of support for further instruction. This ends the procedure.
- Yes: Continue with the next step.
To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Call your next level of support for further instruction. This ends the procedure.

The port on one end of the failed link is in a system unit and the port on the other end is in an I/O unit

Switch the two RIO/HSL/12X cables on the I/O unit with the failed port, so that each cable is connected to the port where the other cable was previously connected. Disconnect both cables at the same time, wait 30 seconds, and then reconnect the cables one at a time.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Refresh the port status for the first failing resource by performing Refresh the port status below. Then continue with the next step.
Is the port on the system unit that was failed now working?
- No: Continue with the next step.
- Yes: Exchange the RIO/HSL/12X bridge FRU in the I/O unit. Go to Verify a repair . This ends the procedure.
Switch the cables back to their original positions by disconnecting both cables at the same time, waiting 30 seconds, and then reconnecting the cables one at a time.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Exchange the cable between the two ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Use the procedure HSL_LNK to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
- No: Call your next level of support for further instruction. This ends the procedure.
- Yes: Continue with the next step.
Exchange the RIO/HSL/12X FRU that contains the failing port in the system unit. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Call your next level of support for further instruction. This ends the procedure.

The ports on both ends of the failed link are in an I/O unit

Switch the two RIO/HSL/12X cables on the first (or "From") cable's I/O unit with the failed port so that each cable is connected to the port where the other cable was previously connected.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Refresh the port status for the first failing resource by performing Refresh the port status below. Then continue with the next step.
Is the port on the I/O unit on which you did not switch the cables now working?
- No: Go to step 5
- Yes: Exchange the RIO/HSL/12X I/O bridge card in the I/O unit where you just switched the cables. The continue with the next step.
To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Switch the cables back to their original positions.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Switch the two RIO/HSL/12X cables on the second (or "To") I/O unit with the failed port so that each cable is connected to the port where the other cable was previously connected.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Refresh the port status for the first failing resource by performing Refresh the port status. Then continue with the next step.
Is the port on the I/O unit on which you did not switch cables now working?
- No: Go to step 10.
- Yes: Exchange the RIO/HSL/12X I/O bridge card in the I/O unit where you just switched the cables. Then continue with the next step.
To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Switch the cables back to their original positions.
Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
Exchange the RIO/HSL/12X cable between the two ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link, then return to this point.
Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Continue with the next step.
Use the procedure HSL_LNK to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
- No: Call your next level of support for further instruction. This ends the procedure.
- Yes: Continue with the next step.
To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
- No: Then the problem is fixed, go to Verify a repair. This ends the procedure.
- Yes: Call your next level of support for further instruction. This ends the procedure.

Cannot power on unit

Work the errors related to powering on the units, and then continue with the next step. If a unit still cannot be powered on, re-cable the RIO/HSL/12X loop without the I/O units and system units that cannot be powered on, allowing the loop to be complete (no disconnected cables).
To determine if re-cabling the loop resolved the problem, perform Manually detecting the failed link below and return to this point.

Manually detecting the failed link

Get the loop number from the reference code if you do not already have it. The loop number is a hexadecimal number in word 7 of the reference code.
- If you are working from the Product Activity Log (PAL), then the loop number is the 4 leftmost characters of the DSA in word 7 (BBBB). The loop number is in hexadecimal. Convert the hexadecimal loop number to decimal format before continuing with this procedure.
- If you are working from the Service Action Log (SAL), the loop number should be displayed in the FRU description area in decimal format.
Sign on to SST or DST (if you have not already done so). Select Start a service tool > Hardware service manager > Logical hardware resources > High-speed link (HSL) resources.
Select Resources associated with loop for the RIO/HSL/12X loop with the failed link. The RIO/HSL/12X bridges will be displayed under the loop.
Select Display detail for the loop with the failed link.
Record the name of the NIC/RIO controller resource you are starting from on the display. You will need to know this name to determine if you have followed the loop around and back to this resource.
If the leading port does not have a status of "failed", select Follow leading port until a leading port with a "failed" status is found, or the display is showing information for the starting NIC/RIO resource you recorded. Did you find a leading port with a status of "failed"?
- No: The loop is functioning properly. Return to the subtask that sent you here.
- Yes: Record the resource name at the leading port with a "failed" status, and the type, model, and serial number for the resource with the failed status. Continue with the next step.
Select Follow leading port one more time and note all the information for the resource name with a failed trailing port.
Select Display system information and note the power controlling system's type, model, and serial number (and name, if available). This info may be needed for FRU replacement at a later time.
Select Cancel twice to return to the previous screen.
Go to each resource name (found above) and select Associated packaging resources. This gives the description of the failing item and the unit ID.
Select Display detail to find the part number and location associated with the possible failing item. Then return to the step that sent you here.

Refresh the port status

Wait one minute, and then sign on to SST or DST (if you have not already done so).
Select Start a service tool > Hardware service manager > Logical hardware resources > High-speed link (HSL) resources.
Move the cursor to the RIO/HSL/12X loop that you want to examine and select Display detail > Include non-reporting resources.
If the display is not already showing the ports for one of the units you are working on, then select Follow leading port. Continue to select Follow leading port until the display is showing the ports for one of the units you are working on. Note the status of the port you were working on. Select Follow leading port until the display is showing the ports for the other unit you are working on, and note the status of the port you were working on.
Select Cancel > Refresh > Display detail for the failing resource you are checking. Note any change in the status for the resource. Then return to the step that sent you here.

Send feedback Rate this page

Last updated: Thu, July 23, 2015