Preparing the 9040-MR9 system to remove and replace an adapter

To prepare the system to remove and replace an adapter in the system, complete the steps in this procedure.

Before you begin

Note: If you are replacing a PCIe3 cable adapter that you use to attach your server to an EMX0 PCIe3 expansion drawer, you must ensure that you have the correct PCIe3 cable adapter and expansion drawer cable to work with the PCIe3 6-slot fanout module that you have in your EMX0 PCIe3 expansion drawer.
  • If you have a CCIN 50CB PCIe3 6-slot fanout module:
    • You must use one of the following PCIe3 cable adapters:
      • FC EJ08 (CCIN 2CE2)
      • FC EJ07 (CCIN 6B52)
      • FC EJ05 (CCIN 2B1C)
    • You must use one of the following expansion drawer cables: FC ECC6, FC ECC7, FC ECC8, FC ECC9, FC ECCR, FC ECCS, FC ECCX, FC ECCY, or FC ECCZ.
  • If you have a CCIN 50CD PCIe3 6-slot fanout module:
    • You must install one of the following PCIe3 cable adapters:
      • FC EJ19 (CCIN 6B53)
      • FC EJ1R (CCIN 58FF)
      • FC EJ20 (CCIN 2CF5)
    • You must use one of the following expansion drawer cables: FC ECCR, FC ECCS, FC ECCX, FC ECCY, or FC ECCZ.

About this task

Procedure

  1. Take appropriate precautions for avoiding electric shock and for handling static-sensitive devices. For more information, see Avoiding electric shock and Handling static-sensitive devices.
  2. If applicable, open the rack door at the rear of the system.
  3. Review the locations of the adapter slots and the service indicators for the adapter that you want to service. The adapters are installed in the rear of the system. Figure 1 shows the locations of the adapters in a 9040-MR9 system and the locations of the light-emitting diodes (LEDs) for the adapter.

    The number of adapter slots that are available in the system depends on the number of system processors in the system. For the adapter placement information for the available slots in this system, see Adapter placement rules and slot priorities for the 9040-MR9.

    The adapter has two LEDs that indicate the status:
    • A power/activity LED (green)
    • An error and identify function LED (amber)
    The status of the LEDs are as follows:
    • (B) Indicates that the adapter is operating correctly. The green power LED (top LED) is lit solid and the amber fault LED (bottom LED) is off.
    • (C) Indicates that the adapter is not operating correctly. The green power LED (top LED) is lit solid and the amber fault LED (bottom LED) is lit solid.
    • (D) Indicates the faulty or failed adapter was selected by using the identify function. The green power LED (top LED) is lit and the amber fault LED (bottom LED) is flashing.
    Attention: If the adapter is operating correctly, then the Activity LED is ON (green) and the Error amber LED is OFF, as shown in (B). Do not attempt to remove a working adapter.
    Figure 1. Adapter slot and LED locations in a 9040-MR9 system
    Adapter slot and LED locations in a 9040-MR9 system.
  4. Choose from the following options:
    • If you want to remove an adapter when the system power is turned off, continue with step 5.
    • If the system power is turned on and if the AIX® operating system controls the slot, continue with step 7.
    • If the system power is turned on and if the Linux® operating system controls the slot, continue with step 8.
  5. To prepare the system to remove an adapter when the system is powered off, complete the following steps:
    1. Turn on the identify LED for the failing adapter.
      For instructions, see Identifying a part.
      Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
    2. Physically verify that the slot you identified is where you want to install the adapter.
      • Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
      • Look for a flashing amber LED, which identifies the unoccupied slot that was selected by using the identify function.
    3. If you have not yet recorded the adapter slot details, record the slot number and location of each adapter that is being removed.
      Note: Adapter slots are numbered on the rear of the system.
    4. Stop the system. For instructions, see Stopping a system.
  6. If you powered the system off, complete the following steps:
    1. If applicable, open the rack door at the rear of the system.
    2. Label and disconnect the power cords from the system unit as shown in the following figure.
      Notes:
      • This system might be equipped with two or more power supplies. If the removing and replacing procedures require the system power to be turned off, ensure that all power sources to the system are disconnected.
      • The power cord (B) is fastened to the system with a hook-and-loop fastener (A). If you are placing the system in a service position after you disconnect the power cords, ensure that you unstrap the fastener.
      Figure 2. Removing the power cords
      Removing the power cords
      (L003)
      L003 label image
      or
      L003 label image
      or
      L003 label image
      or
      L003 label image
      or
      L003 label image
      L003 label image
      L003 label image
      DANGER
      Multiple power cords. The product might be equipped with multiple AC power cords or multiple DC power cables. To remove all hazardous voltages, disconnect all power cords and power cables. (L003)
    3. Continue with step 10.
  7. To prepare to remove an adapter by using the AIX operating system, complete the following steps:
    1. You must take the adapter offline before you remove and replace an adapter when the system power is turned on (hot-plugging). Before you take an adapter offline, the devices that are attached to the adapter must be taken offline as well. This action must be done by a system administrator. Taking the adapter offline prevents a service representative or user from causing an unexpected outage for other users of the system.
    2. Before hot-plugging adapters or storage devices, ensure that the file systems on those devices are unmounted.
    3. Ensure that any processes or applications that might use the adapter are stopped.
    4. To identify the failed adapter, complete the steps in this procedure on the console:
      1. Log in as root user.
      2. At the command line, type diag and then press Enter.
      3. From the Function Selection menu, select Task Selection > Hot Plug Task > PCI Hot Plug Manager > Unconfigure a Device.
      4. Press F4 (or Esc +4) to display the Device Names menu.
      5. Select the adapter that you are removing in the Device Names menu.
      6. Use the Tab key to answer No to Keep Definition. Use the Tab key again to answer Yes to Unconfigure Child Devices, and then press Enter. Press Enter to confirm the operation. The OK message next to the Command field confirms a successful unconfiguration.
      7. Press F3 (or Esc +3) twice to return to the Hot Plug Manager menu.
      8. Select replace/remove PCI Hot Plug adapter and then select the slot that contains the adapter to be removed from the system.
      9. Select remove. The amber LED for the adapter flashes for the slot that is identified.
      10. Physically verify that the slot you identified is where you want to remove the adapter.
        Notes:
        • Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
        • Look for the flashing amber LED, which identifies the slot that was selected by using the identify function.
      11. Press Enter. The adapter is placed in the action state and is ready to be removed from the system.
    5. If necessary to view the identify LEDs or to manage cables at the rear of a rack-mounted system, open the cable management arm by completing the following steps:
      1. Release the mounting bracket from the cable management arm assembly by pressing the indentation (A) on the inner cable management arm tab. The cable management arm releases from the outer mounting bracket in the direction shown.
        Figure 3. Releasing the mounting bracket
        Releasing the mounting bracket
      2. Swing the cable management arm away from the system.

        In the image, the inner cable management arm tab is shown on the left side as you are facing the system from the rear. However, the cable management arm can also be installed so that the inner cable management arm tab is on the right side of the system.

        CAUTION:
        To avoid causing damage to the arm, open the cable management arm just long enough to complete these repairs.
    6. Physically verify that the slot you identified is where you want to remove the adapter.
      • Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
      • Look for a flashing amber LED, which identifies the slot that was selected by using the identify function.
    7. Continue with step 10.
  8. To prepare to remove an adapter by using the Linux operating system, complete the following steps:
    1. Before you hot-plug an adapter, ensure that the server or partition is at the correct level of the Linux operating system.
    2. Verify that the Linux, hot-plug adapter tools are installed.
    3. Ensure that you have the POWER® Linux Service Aids installed on your system. These service aids enable system serviceability, as well to improve system management. If you are using a Linux on POWER distribution with Linux kernel version 2.6 or later, you can install the Service Aids that gives you access to more capabilities, which can help you diagnose problems on your system. This software is available at the Service and productivity tools for Linux on POWER website.
    4. You must take the adapter offline before you remove and replace an adapter when the system power is turned on (hot-plugging). Before you take an adapter offline, the devices that are attached to the adapter must be taken offline as well. This action must be done by a system administrator. Taking the adapter offline prevents a service representative or user from causing an unexpected outage for other users of the system.
    5. Before hot-plugging adapters or storage devices, ensure that the file systems on those devices are unmounted.
    6. Ensure that any processes or applications that might use the adapter are stopped.
    7. Use the service indicator light-emitting diodes (LEDs) to help identify the part. For instructions, see Identifying a part.
    8. Physically verify that the slot you identified is where you want to install the adapter.
      • Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
      • Look for a flashing amber LED, which identifies the unoccupied slot that was selected by using the identify function.
    9. Use the Linux operating system drmgr command to prepare the adapter to be removed when the system power is turned on.
      1. Type the following command:
        drmgr -c pci -r -s locationcode

        Where locationcode is replaced with the location you identified earlier. For example, U7879.001.DQD014E-P1-C3.

        The following screen is displayed.
        
        The visual indicator for the specified PCI slot has been set to the 
        identify state. Press Enter to continue or enter x to exit.
        
        
      2. Physically verify that the slot you identified is where you want to remove the adapter.
        Notes:
        • Use the blue identify LED on the enclosure to locate the system. Ensure that the serial number of the system matches the serial number to be serviced.
        • Look for the flashing amber LED, which identifies the slot that was selected by using the identify function.
      3. Press Enter. The slot is ready to have an adapter removed. Continue to follow these instructions until you are told to remove the adapter.
  9. If applicable, open the rack door at the rear of the system.
  10. At the rear of the system, put the cable management bracket in the service position. See the following figure.
    1. Pull out the quarter-turn fasteners (B) and turn them to disengage them while you lift the cable management bracket (A) to its raised position.
    2. Turn the quarter-turn fasteners (B) to engage and lock the bracket into position.
    Figure 4. Placing the cable management bracket in the raised service position
    Placing the cable management bracket in the service position
  11. Label and disconnect all of the cables or transceivers that are attached to the adapter you plan to remove.
    Use a hook-and-loop fastener to hold the cables in place.
    Important: If you are disconnecting the SAS AZ cable which controls the internal disk bays, use extra care when removing cables from the adapter connectors. Gently pull the blue tab straight back from the system to release the latches that secure the SAS cable to the adapter. To prevent possible tab breakage, do not pull the blue tab to the side; instead, pull the blue tab straight back. While gently pulling the blue tab, unplug and remove the SAS cable from the adapter by pulling on the black SAS cable itself. Do not apply extra pulling force on the blue tab to remove cable.
  12. Attach the electrostatic discharge (ESD) wrist strap.
    The ESD wrist strap must be connected to an unpainted metal surface until the service procedure is completed, and if applicable, until the service access cover is replaced.
    Attention:
    • Attach an electrostatic discharge (ESD) wrist strap to the front ESD jack, to the rear ESD jack, or to an unpainted metal surface of your hardware to prevent the electrostatic discharge from damaging your hardware.
    • When you use an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment.
    • If you do not have an ESD wrist strap, just prior to removing the product from ESD packaging and installing or replacing hardware, touch an unpainted metal surface of the system for a minimum of 5 seconds. If at any point in this service process you move away from the system, it is important to again discharge yourself by touching an unpainted metal surface for at least 5 seconds before you continue with the service process.