General Specifications........................................................................................................................................................................ 7
Pre-Installation Information ................................................................................................................................................................. 8
Parts List ................................................................................................................................................................................................. 8
Tools Required for Installation ............................................................................................................................................................ 8
Before you Begin .................................................................................................................................................................................. 9
Remove Top Cover ............................................................................................................................................................................. 9
SW1 and SW2 ................................................................................................................................................................................. 11
How to Disconnect iPass Cable ................................................................................................................................................. 15
Connect Power Cord / Cable ......................................................................................................................................................... 15
Power ON the unit ............................................................................................................................................................................. 16
Power on the Host Computer .......................................................................................................................................................... 17
Shutting Down ............................................................................................................................................................................... 17
LINKUP 0 LED .................................................................................................................................................................................. 18
Hot Plug LED (next to Hot Plug buttons) .................................................................................................................................... 19
MASTER RST LED & Power LED...................................................................................................................................................... 19
Verify Magma Installation ................................................................................................................................................................. 20
Windows 7, 8 and Windows 10 ................................................................................................................................................... 20
Mac OS X ....................................................................................................................................................................................... 21
RedHat Linux .................................................................................................................................................................................. 24
Mapping Physical Slot locations to port locations using lspci ............................................................................................... 26
Linux Commands to Use to check on Magma device ......................................................................................................... 30
System Should Be Up and Running ................................................................................................................................................. 34
SNMP Features and Configuration .................................................................................................................................................. 34
SNMP Features ............................................................................................................................................................................... 34
Temperature settings .................................................................................................................................................................... 37
Reset to Default Values .................................................................................................................................................................... 39
Configure your SNMP Agent ....................................................................................................................................................... 39
Accessing the various SNMP functions ...................................................................................................................................... 40
Hot-Plug/Swap Procedure for Windows .................................................................................................................................... 43
Hot-Plug/Swap Procedure for Linux ........................................................................................................................................... 45
The Alternate Function DIP Switch .................................................................................................................................................. 46
PCIe Expansion Performance with the EB7-X8G2-RAS ................................................................................................................. 48
High Performance Video Card expansion solutions ............................................................................................................... 48
General Chassis Cleaning ................................................................................................................................................................ 49
Fan replacement ............................................................................................................................................................................... 50
“Hot-Swappable” Power Supply ..................................................................................................................................................... 51
Cleaning the Air Filter ........................................................................................................................................................................ 52
Status Indicators and configuration switches ............................................................................................................................... 53
Status Panel indicators ................................................................................................................................................................. 53
Chassis Signal Detect Indicators ................................................................................................................................................ 53
Chassis Slot Power Indicators ...................................................................................................................................................... 54
Chassis Linkup and Activity Indicators: ...................................................................................................................................... 54
Locating the Problem ....................................................................................................................................................................... 56
My Computer Can’t Find the PCIe Expansion System ............................................................................................................ 57
When Nothing Works .................................................................................................................................................................... 58
Magma
EB7-X8G2 |
4
My PCIe Card Doesn’t Work ....................................................................................................................................................... 59
My system hangs beyond a certain number of add-in cards ............................................................................................... 62
Rackmounting the Chassis ............................................................................................................................................................... 62
Add Screws to Rack Post ............................................................................................................................................................. 63
Attach Slide Rail to Rack ............................................................................................................................................................. 63
Attach Chassis to Slide Rail ......................................................................................................................................................... 63
Chapter 7 How to Get More Help ........................................................................................................ 64
Contacting Technical Support ........................................................................................................................................................ 64
Returning Merchandise to MAGMA ............................................................................................................................................... 66
Appendix A Need More PCIe Slots?..................................................................................................... 67
Multiple PCIe Expansion System Configurations ........................................................................................................................... 67
The Fan-Out Configuration ............................................................................................................................................................... 68
CE .................................................................................................................................................................................................... 78
Magma
EB7-X8G2 | Preface
5
WARNING
Never modify or remove the radio frequency interference shielding from your workstation or
expansion unit. To do so may cause your installation to produce emissions that could
interfere with other electronic equipment in the area of your system.
Preface
Advisories
Five types of advisories are used throughout this manual to provide helpful information, or to alert you to the potential for
hardware damage or personal injury.
Disclaimer: We have attempted to identify most situations that may pose a danger, warning, or caution condition in this
manual. However, Magma does not claim to have covered all situations that might require the use of a Caution,
Warning, or Danger indicator.
Safety Instructions
Always use caution when servicing any electrical component. Before handling the Magma Expansion
chassis, read the following instructions and safety guidelines to prevent damage to the product and to
ensure your own personal safety. Refer to the “Advisories” section for advisory conventions used in this
manual, including the distinction between Danger, Warning, Caution, Important, and Note.
Always use caution when handling/operating the computer. Only qualified, experienced,
authorized electronics personnel should access the interior of the computer and expansion chassis.
Magma
EB7-X8G2 |
6
CAUTION
Do not attempt to service the system yourself except as explained in this manual. Follow
installation instructions closely.
Electrostatic Discharge (ESD) Warning
Electrostatic Discharge (ESD) is the enemy of semiconductor devices. You should always take
precautions to eliminate any electrostatic charge from your body and clothing before touching any
semiconductor device or card by using an electrostatic wrist strap and/or rubber mat.
When Working Inside a Computer
1. Before taking covers off a computer, perform the following steps:
2. Turn off the computer and any peripheral devices.
3. Disconnect the computer and peripheral power cords from their AC outlets or inlets in order to
prevent electric shock or system board damage.
In addition, take note of these safety guidelines when appropriate:
To help avoid possible damage to systems boards, wait five seconds after turning off the computer before
removing a component, removing a system board, or disconnecting a peripheral device from the computer.
When you disconnect a cable, pull on its connector or on its strain-relief loop, not on the cable itself. Some
cables have a connector with locking tabs. If you are disconnecting this type of cable, press in on the locking
tabs before disconnecting the cable. As you pull connectors apart, keep them evenly aligned to avoid
bending any connector pins. Also, before connecting a cable, make sure both connectors are correctly
oriented and aligned.
Protecting Against Electrostatic Discharge
Static electricity can harm system boards. Perform service at an ESD workstation and follow proper ESD procedures to
reduce the risk of damage to components. Magma strongly encourages you to follow proper ESD procedures, which
can include wrist straps and smocks, when servicing equipment.
You can also take the following steps to prevent damage from electrostatic discharge (ESD):
When unpacking a static-sensitive component from its shipping carton, do not remove the component’s anti-
static packaging material until you are ready to install the component in a computer. Just before unwrapping
the anti-static packaging, be sure you are at an ESD workstation or are grounded.
When transporting a sensitive component, first place it in an anti-static container or packaging.
Handle all sensitive components at an ESD workstation. If possible, use anti-static floor pads and workbench
pads.
Handle components and boards with care. Don’t touch the components or contacts on a board. Hold a
board by its edges or by its metal mounting bracket.
Magma
EB7-X8G2 | Chapter 1 Introduction
7
Item
Description
Host Card:
Low Profile PCI Express x8 host card
Backplane:
7 PCIe x8 Hot-Plug-capable slots
Enclosure:
4U Black Rack-mount (All Steel)
Dimensions:
19" W x 7" H x 17.7" D
Weight:
24 lb or 11.804 kg
PCI Express Bus Spec.
Revision 2.0
PCI Local Bus Specification:
Revision 2.3
PCI Bridge Architecture
Spec:
Revision 1.2
Interconnect Bandwidth:
2000 MB/sec or 2 GB/sec or 20 Gbps
Cooling:
One 85.2 CFM fan
One fan in power supply
Power Supply:
Model EB includes an auto-switching 400W supply
MTBF:
53,000 hours
Operating Environment:
Recommended operating temperature up to 50º C
0º to 50º C Operating Temperature
-20º to 60º C Storage Temperature
5% to 85% Relative Humidity, Non-condensing
Operating Systems:
Windows 7/Vista/XP/Server 2003
Mac OS X version 10.4.x + | Linux Kernel 2.6x+
Solaris
Warranty:
1 Year Return to Factory
Available Upgrade
Options:
3-meter cable (PN: SUBCBL3IPX4X8)
Disk Drive Cage for up to seven 3.5” internal disk drives (PN: RDRIVECAGE)
PCIe card hold down kit (PN: RCHD7)
Rack-mount slide kit (PN: RSLIDES-XX) Rack-mount slide (18”|26”|28”)
MPN#: RSLIDES-XX
Chapter 1 Introduction
General Specifications
The Magma 7 Slot PCI Express® to PCI Express® Expansion System (Model EB7) is a general-purpose bus expansion chassis
for the Peripheral Component Interconnect Express (PCIe) local bus. The expansion chassis is fully compliant with the PCI
Express Local Bus Specification. This system consists of a PCI Express host card, a 1–meter iPass cable, a rack-mount
enclosure containing a 7 slot PCIe expansion backplane, a power supply, and cooling fans.
Magma
EB7-X8G2 |
8
Item
Qty
Description
1 1 Half-height PCI Express host card
2 2 1-meter shielded iPass™ x8 cable
3 2 U.S. Standard 115V power cord
4 1 Quick Start Guide
Pre-Installation Information
Before using the Magma expansion chassis you should perform the following steps:
Inventory the shipping carton contents for all of the required parts
Gather all of the necessary tools required for installation
Read this manual
Parts List
Tools Required for Installation
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
9
CAUTION
Hardware installation shall be performed only by qualified service personnel per UL and IEC 60950-1.
Electrostatic Discharge (ESD) Warning
All PCI cards are susceptible to electrostatic discharge. When moving PCI cards, it is best to carry the
cards in anti-static packaging. If you need to set a PCIe card down, be sure to place it inside or on top
of an anti-static surface. For more information, see “Protecting Against Electrostatic Discharge” in the
Preface.
WARNING
High voltages are present inside the expansion chassis when the unit’s power cord is plugged into an
electrical outlet. Disconnect the power cord from the AC outlet before removing the enclosure cover.
Turning the system power off at the power on/off switch does not remove power to components. High
voltage is still present.
CAUTION
Before touching anything inside the enclosure, move to an ESD station and follow proper ESD
procedures. Failure to do so may result in electrostatic discharge, damaging the computer or its
components. For more information, see “Protecting Against Electrostatic Discharge” in the Preface.
Chapter 2 Hardware Installation
The following steps will guide you through the installation of your Magma expansion system
Before you Begin
The system’s ATX power supply is auto-switching. This means that it will automatically switch to match whatever source
power you are using. Since all products ship with a US/Canadian Standard 115V power cord, you will need to use a
locally available power cord for non-US Standard power sources.
Remove Top Cover
Remove the four (4) screws from the back of the expansion chassis. Slide the enclosure cover backward to disengage it
from the guides at the front of the enclosure by firmly grasping the edges of the cover lip and pulling the cover
backward about 1” until it clears the front hold-down, and then lift the cover off.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
10
Check inside the unit, see if the Expansion interface card is installed. If the Expansion interface card is not plugged in,
go to the next step “Install Expansion Interface card”. The pictures below are showing an EB7-X8G2 with Expansion
Interface card installed.
No Expansion Interface card installed in the UPSTREAM SLOT as shown from the pictures below.
Install Expansion interface card (EIF)
” By default an EIF card should already be installed in the Magma expansion chassis.
Prior to installing the card, make sure the Dipswitch SW1 is set to ON position (ON=EXP) and Dipswitch SW2 is set to OFF
position (x8 setting), see pictures below. The expansion system will NOT function if SW1 is set to OFF=HOST.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
11
SW1 and SW2
SW1 dipswitch should be set to “ON-EXP” position. SW2 dispswitches should be set to x8, see picture below.
Once the two dispswitches (SW1 and SW2) are set correctly, plug in the Expansion Interface card into the UPSTREAM slot.
This is the designated slot for the Expansion Interface card only. You can not use other PCIe slots, the unit will not work
properly.
Install Host Interface Cards
Install the Host Interface card. Begin the installation of your PCI Express (PCIe) host card by first powering down your
computer. Use the procedures for shutting down your operating system and shutting off power to your system provided
in your owner’s manual or system documentation. The PCIe host card is a “half-height,” x8-capable PCIe card mounted
to a “full-height” bracket as shown below.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
12
For low profile case applications, you may need to change the mounting bracket to the low profile bracket that shipped
with your system. This is done by removing the screws that hold the card to the bracket. Be sure you are using proper ESD
procedures when completing this action.
Installation of low profile bracket
Detach the standard bracket from the card, and place the low profile bracket and secure it.
Before installing the Host Interface card into PCIe slot, check the DIP switch settings.
Check the red Dipswitch (SW1) on the Host interface card, make sure it is set to OFF= HOST.
Check the SW2 Dipswitch, both toggle switches should be set to OFF position (x8).
Once the dipswitches are set correctly and the host computer is off and all power cords are disconnected from the AC
outlet, insert the PCI Express host card into a vacant x8 (or x16) PCIe slot by gently pushing the card until it is firmly
seated. Then secure the card to the slot with a mounting screw.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
13
STOP
YOU MUST ONLY INSTALL THE PCIe HOST CARD INTO A PCI EXPRESS SLOT.
Only use cards WITH brackets. This will ensure that your PCIe host card can only be inserted into a PCIe
slot. Although PCI Express cards without brackets may fit into conventional PCI slots, you run the risk of
damaging the PCI Express host card if you insert it into a PCI slot. Please ensure that your host computer
has PCI Express slots and install the host card only into a PCI Express slot.
The illustratiob below shows what a PCI Express slots looks like in the computer’s mother-board compared to a standard
PCI slots.
Install PCIe Cards
It is highly recommended to install third party PCIe cards / High Power PCIe cards after you have verified and tested that
the Magma expansion chassis is functional and free of hardware failures. The next step is to connect the Ipass cable.
For PCIe cards installation got to Chapter XX.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
14
Connect iPass Cable
The 1-meter iPass cable included with your Magma expansion chassis features a x8 connector on each side. Connect
the iPass cable to Expansion and Host Interface cards. For the proper way of connecting the iPass cable to Interface
card, see pictures below.
Carefully position the expansion chassis so that the supplied expansion cable will conveniently reach from the host
computer to the connectors on the back of the chassis. Connect one end of the iPass cable to the expansion chassis’
iPass connector. Then connect the other end of the iPass cable to the host card located in the host computer.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
15
How to Disconnect iPass Cable
Pull the green tab while slowly pulling out the cable from the Interface card. Failure to pull the green tab while
disconnecting the iPass cable can break the connector inside the Interface card,
Connect Power Cord / Cable
Connect power cord to electrical outlet. Magma only provides the 110-120V power cord.
It is highly recommend using a power surge. This product is provided with a power supply that automatically adjusts to input voltages between 100 to 240 Vac. A U.S. and Canadian 125 V power supply cord is provided with this product. If
using this product outside of the U.S. or Canada, please use locally available power supply cords.
Connect the AC power cord to the of back of the unit. Ensure that the system’s power supply unit is switched OFF
before connecting the power cord.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
16
When done connecting the power cord, turn the power supply switch to ON position.
Upon turning the power supply to ON, the 3.3V AUX on the board is illuminated.
Power ON the unit
You must apply power to the EB7-X8G2 expansion chassis UUUBEFOREUUU you power up your computer. Press the front power
button. When the unit is powered ON, the front Power LED indicator will illuminate.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
17
STOP
DO NOT TURN OFF THE MAGMA EXPANSION CHASSIS UNTIL YOU HAVE SHUT DOWN
YOUR COMPUTER COMPLETELY! It can cause a system lockup and data loss.
Powering ON the expansion unit before the host, allows the higher numbered PCIe buses in the PCIe bus hierarchy to be
at a stable state when the host system issues its master power-on bus reset. Upon powering ON the expansion unit, the
following LEDs on the board are illuminated.
3.3V, +1.5V , +3.3V Aux, +12v (Green in color)
Master RST LED (Amber in color)
Power LED : D1221 ( Green in color)
If the front Power LED indicator and 3.3V, +1.5V , +3.3V Aux, +12v LEDs are not coming ON, please check the power
supply, make sure the switch is set to ON position and the power cord is firmly attached.
Power on the Host Computer
Before powering ON the computer, make sure the Host Interface card is seated correctly in the PCIe slot and the cable
is firmly connected. During the boot up process or while the computer is starting up, the SLOT LED indicators will come
ON and OFF. In this process we have not installed any PCIe cards, all PCIE slots are empty.
Shutting Down
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
18
Hardware Check
Once the host computer has booted all the way up, next is to check inside the expansion unit and verify that all LEDs are
correctly illuminated. A fully operational expansion chassis will show the following LEDs lit on the backplane, Expansion
Interface cards and the back of the unit.
1. LINKUP 0 LED is lot
2. Slot LEDs: 7 solid orange LEDs when no cards are installed). It should be OFF if slots are populated with cards
3. Expansion interfafe card LED: 5 solid green LEDs
4. Hot Plug LED next to Hot Plug buttons, should be all OFF unless the slots are populated with cards.
5. MASTER RST LED (D1217) and Power LED (D1221) should be OFF once the computer has established link with the
expansion unit.
LINKUP 0 LED
Once your computer started all the way up, you will see LINKUP lights appear on the back of the chassis near the iPass
connector. The LinkUP 0 LED should be ON, solid green. 0 – Connection between host and chassis has been established.
Linkup 0 represents the EIF card connected “uplink” with the host’s HIF. The Linkup LEDs represent only an initial
connection/handshake between the chassis and host PC. A successful linkup doesn’t represent transfer or exchange of
data. .
SLOT LEDS
You should see 7 LEDs that are illuminated as “orange” or “amber” behid the slots. This represents that there no cards
installed in the corresponding slot. As shown from the picture below, all 7 slots are not populated with PCIe cards and
the corresponding LEDs are illuminated as orange / amber.
Magma
EB7-X8G2 | Chapter 2 Hardware Installation
19
Expansion interfafe card LEDs
The Expansion Interface card will show 5 solid green LEDs illuminated. The normal LED indicator on the Expansion
Interface card should display 5 solid green LEDs, this signifies that unit is trained / linked to x8.
Hot Plug LED (next to Hot Plug buttons)
Hot Plug LEDs should be off once the computer has booted all the way up. In this instance there are no PCIe cards, so it
is normal for Hot plug LEDs to be off.
D39, D34, D24, D20, D33, D25, D21>> should be OFF, when all the slots have no PCIe cards installed
D39, D34, D24, D20, D33, D25, D21>> should be ON as green, when all slots are populated with PCIe cards
MASTER RST LED & Power LED
The MASTER RST LED (D1217) and Power LED (D1221)on the expansion board should be OFF once the computer is linked
with expansion unit.
Magma
EB7-X8G2 | Chapter 3 Software Installation
20
STOP
Before installing drivers, you should ensure that you have a current system backup of all of your
important data.
Failure to follow these instructions exactly could result in a system lock-up and potential loss of data.
You must also disable your anti-virus software before continuing.
Chapter 3 Software Installation
Software Driver Installation
Magma Driver is not required for Windows 7, which means no manual installation of Magma driver. Windows 7, Windows
8, Windows 10, Windows Server Operating Systems and a non-Windows OS such as Linux and Unix based Operating
Systems
You should first install your 3rd Party card and connect the system as described earlier in this chapter.
Before attempting to install anything on a Windows system, you should ensure that you have set a Restore Point, that all
data files are closed and that you have a current backup of your data.
Verify Magma Installation
Windows 7, 8 and Windows 10
As your Windows computer starts up, you will see a small message box pop-up in the lower-right corner of the screen to
alert you that Windows has found new hardware.
The system does not require any Magma drivers in order to operate properly with the x8 PCIe Host card.
To verify a successful installation on Windows, find the ‘My Computer’ icon and “right-click” on it. Then select ‘Manage’
from the pop-up menu. Next, click on ‘Device Manager’ in the leftmost Computer Management window. Finally, click
on the View Menu and select View Devices by Connection.
Magma
EB7-X8G2 | Chapter 3 Software Installation
21
Open ACPI (BIOS) Open PCI BusClick the ‘+’ sign several times until your reach a PCI Express Root Port with a PCI
Standard PCI-to-PCI Bridge beneath it.
When installed properly, you will see eight PCI Express standard Switch Ports below the system’s PCIe Root port.
rd
If the verification is successful, you may now proceed to Chapter and install 3P
P
Party PCIe Cards as well as auxiliary
peripherals, such as hard drives into the chassis. If, however, the installation was unsuccessful, you may not see the PCI
to PCI Bridge or PCI Express standard Switch Ports below the PCI Express Root port . In that case precede to Chapter 6
for Troubleshooting installation problems.
Mac OS X
When using Mac OS X no additional software or drivers are needed. The operating system should automatically
recognize the Magma host card and expansion chassis.
In Mac OS X, the Magma expansion device is transparent to the Operating System; it means that there will be no
Magma hardware / device appearing in the Apple System profiler via PCI card. Only the PCIe cards will be recognized /
detected. To verify whether the expansion unit is working or not is by installing a PCIe cards into the available PCIe slot.
If the PCIe cards are recognized / detected, it means that the Magma expansion chassis is working.
Expansion Slot Utility
The following screen may be displayed the first time you turn on your computer with the Magma EB7-X8 installed. This is
applicable to Mac OS 5 to Mac OS 7. Choose OK.
Magma
EB7-X8G2 | Chapter 3 Software Installation
22
Mac Operating System is prompting you to choose a PCI Express profile that maximizes the performance of your
attached devices. The Magma host card can communicate up to a bandwidth of x8 to and from the expansion chassis and devices. You should choose a profile that matches the configuration of all the cards installed in your Mac. Magma
recommends that you install the system host card into a x8 slot in order to maximize throughput.
In this example, the Magma host card is installed in slot 4 and appears as “Intel PCI-to-PCI Bridge Card”.
If your computer did not automatically prompt you to choose a PCI Express profile, you can locate this utility under
System Library CoreServices Expansion Slot Utility.app.
Apple System Profiler
When using Mac OS X no additional software or drivers are needed. As long as you are using Mac OS X Version 10.4 or
newer, the operating system should automatically recognize the Magma expansion chassis.
Select “About This Mac” under the Apple Icon
Magma
EB7-X8G2 | Chapter 3 Software Installation
23
Then click the “More Info” button click on System Report select PCI as shown below:
Upon selecting the “PCI Cards”, you should see all the available PCIe cards that are in the expansion unit. The Magma
devices are transparent to the Operating System, you will only see the PCIe cards that are in the expansion slots.
If any of these devices are not displayed as shown above, you should shut down your system (computer first, then the
expansion chassis) and reconnect the cables and the PCIe expansion host card to ensure that you have a solid
connection. Then restart the Magma expansion chassis followed by the computer. Next, try to verify the installation
again, as shown above. If you are still having problems, contact Magma Technical Support at (858) 530-2511.
Magma
EB7-X8G2 | Chapter 3 Software Installation
24
RedHat Linux
Once the EB7-X8G2 has been installed in a RedHat9-based system, its installation can be verified by typing the following
command lines:
lspci –t Displays the overall structure of the PCIe expansion system
lspci –vv Lists additional information about the PCIe switch (in our case it will list the Integrated Device Technology (IDT)
information.
Ispci –vvv Displays the most comprehensive information about the expansion system.
Typical output from lspci –vvv is verbose, but you can dig through the information to find very important information.
There are so many registers and settings associated with PCI Express Switches.
Use the “lspci -vvv| grep “IDT” command to check that the Magma card and slot devices are detected (see image
below). IDT is the PCIe switch (component) on the Magma expansion board.
You can alsouse the “lspci –vvv | grep “807”. The vendor ID for IDT PCie switch is 8077
The first PCI Bridge in this example is the Upstream Port. The ‘Downstream” ports are the remaining are the PCIe slots.
Magma
EB7-X8G2 | Chapter 3 Software Installation
25
To check the details of the Magma Upstream Port on Bus 1, Device 0, Function 0 (01:00.0), type “lspci –s 01:00.0 –vvv”
command on the terminal window. The Bus number will change depending on the Server and location of host card.
Below is the output of “lspci –s 01:00.0 –vvv”, there are several important information you need to check and these are
the Link speed, port#, slot# and Bandwidth. There are commands to use to extract this information, go to “Linux
Commands…..”
Magma
EB7-X8G2 | Chapter 3 Software Installation
26
IMPORTANT ORDER OF PCI EXPRESS SLOTS
The PHYSICAL PCI Express Slots 1 – 7 are not in order when displayed in any Operating Systems
Device information.
Mapping Physical Slot locations to port locations using lspci
How do you locate your PCI Express Devices in our Magma Chassis? And how does that correspond to physical slot
locations?
Below is an example of 7 PCI Express Upstream and Downstream Ports in our Magma Chassis. This output comes from
lspci –vvv > info.txt. It has been cleaned up for this example. The Magma Chassis is located below under Bus 01. There
are 7 downstream ports on Bus 2, each port has a number starting with 2, 4, … up to 14. The Bus number will change
depending on the Server and location of host card. Each port is associated with a physical slot number, 1 through 7.
To check on Magma device, type lspci – vvv | grep “IDT” or lspci –vvv | grep “8077”.
To check or to identify whether the bus 01:00.0 is the Upstream port and Downstream port, on the terminal window type
lspci –s 01:00.0 -vvv | grep –Hrn “Capabilities” . The outout below shows that the 01:00.0 is assigned to Upstream Port.
To check on the Magma Upstream port speed and bandwidth, type lspci -s 01:00.0 -vvv | grep –Hrn “LnkCap” or
lspci -s 01:00.0 -vvv | grep “LnkCap” . The output shows Port#0 , speed is 5GT/s and width is x8.
To check on the speed and linkwidth only, type lspci -s 01:00.0 -vvv | grep –Hrn “LnkSta”
or lspci -s 01:00.0 -vvv | grep “LnkSta”. The output shows the speed is 5GT/s and width is x8.
To check the second bus, see if it is Upstream port or Downstream port, type lspci –s 02:00.0 -vvv | grep –Hrn
“Capabilities” or lspci –s 02:00.0 -vvv | grep “Capabilities”.
To check for the slot# and port# of the Downstream port, type lspci –s 02:00.0 -vvv | grep -Hrn ‘Slot\|port’.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
31
CAUTION
Hardware installation shall be performed only by qualified service personnel per
UL and IEC 60950-1.
IMPORTANT
We will provide reasonable technical support with 3P
rd
P
Party PCIe cards.
However, if you have verified a successful installation of the MAGMA expansion
system (as defined in HHHUUChapter 3)UUHHH, but experience difficulty installing your 3P
rd
P
Party PCIe cards, the card manufacturer should be able to provide the best
support.
Chapter 4 Install PCIe Cards
rd
This chapter provides information on how to install 3P
on the installation of individual cards are provided by the card’s manufacturer. This chapter is provided as a simple
guide to help you install your PCIe cards in the chassis.
For the purpose of installation, the MAGMA expansion chassis functions exactly as a standard desktop computer chassis.
Always follow the manufacturer’s instructions for installing their card or hard drive on a desktop computer.
P
Party PCIe cards into your MAGMA expansion chassis. More details
Open PCIe Expansion Chassis
In order to remove the lid off the chassis unlock the back thumbscrews and slide the lid towards you as shown below:
After removing the lid you will note the card hold-down bar as shown below:
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
32
Electrostatic Discharge (ESD) Warning
All add-in cards are susceptible to electrostatic discharge. When moving cards, it is best to carry the
cards in anti-static packaging. If you need to set a circuit card down, be sure to place it inside or on
top of an anti-static surface. For more information, see “Protecting Against Electrostatic Discharge” in
the Preface.
WARNING
High voltages are present inside the expansion chassis when the unit’s power cord is
plugged into an electrical outlet. Disconnect the power cord from the AC outlet before
removing the enclosure cover. Turning the system power off at the power on/off switch
does not remove power to components. High voltage is still present.
In order to access the add-in PCIe cards, you will need to remove that bar as follows:
1. Rotate the plastic pieces until their grooves are aligned with the cards.
2. Unscrew the captive screw, lift up and remove the apparatus.
3. Tighten the screw in the black plastic piece to lock it into place and prepare it to lock the PCIe add-in card that will
be installed. Reinsert the bar into the chassis and tighten the captive screw.
Install PCI Express (PCIe) Cards
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
33
CAUTION
Before touching anything inside the enclosure, move to an ESD station and follow proper ESD
procedures. Failure to do so may result in electrostatic discharge, damaging the computer or its
components. For more information, see “Protecting Against Electrostatic Discharge” in the Preface.
CAUTION
Before installing add-in cards, please ensure that the input current rating specified on the AC input label is
not exceeded.
When installing 3rd Party PCIe cards into the Magma expansion chassis, it makes no difference which PCIe slot you place
your cards in. Usually that is determined by accessibility and heat dissipation consideration as may be specified by the
card manufacturer.
Be sure to install the PCIe cards following the card manufacturer’s recommendations. Some PCIe card manufacturers
recommend that you install their software driver(s) prior to installing the hardware. If this is the case, you should install
their driver before you connect and power up the expansion chassis.
Make sure that all PCIe cards are fully seated in their connectors. When correctly seated in its connector, you will notice
a firm resistance when you pull up gently on the card. To keep the cards in place, secure them in the enclosure with their
retaining screws (supplied with the MAGMA expansion chassis).
After securing the cards verify that they do not touch each other. Depending on PCIe card size and thickness, you may
require mechanical card guides to ensure isolation, such as the case with 2 single full-length PCIe cards. Card guides for
this system can be purchased separately from Magma.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
34
IMPORTANT
The sheer number of PCIe cards and device drivers available makes it
impossible for Magma to fully test and certify all available PCIe cards for use in
the MAGMA expansion chassis. Our best advice to you in this regard is to insist
on full PCIe Specification compliance from your card and system vendors.
Cards and systems should be at least PCIe Specification Revision 1.0 compliant
or better. Compliance in your system motherboard, PCIe cards, and console
firmware (or BIOS) is your best assurance that everything will install and operate
smoothly.
System Should Be Up and Running
Apply power to the MAGMA expansion chassis first, then power up the computer.
Use the procedures detailed in UUChapter 3UUHHH to confirm the card installation(s) in the Windows Device Manager or Apple
System Profiler. When everything is functioning correctly, your Windows Device Manager should look something like this:
SNMP Features and Configuration
This is only applicable to Magma’s EB7-X89G2-RAS chassis
SNMP Features
Magma’s EB7-X89G2-RAS chassis supports the Simple Network Management Protocol for remote monitoring and
administration by offering the following features:
Internal Temperature monitoring
Clear Alarm button monitoring
Swappable fan status (for fans 1,2,3 and 4 in the front)
Power supply 1 status
Power supply 2 status
10 Traps are defined to alert the SNMP server in case of overheats or failure in any of the subsystems mentioned
above.
Remote chassis turn on
Input/output switching
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
35
CAUTION
Aside from reading an IP address, the IPsetup.exe utility can be used to set an IP
address other than the one assigned initially by the DHCP server—using the Set
button. It is recommended, however, not to use the utility for this purpose since we
will lose connectivity with the chassis until the machine running IPsetup.exe obtains
an IP address in the same IP subnet. The next section will show a preferred way of
accomplishing this via the browser interface. In case you need to back-trace any
of these steps, you can always reset the chassis back to its factory settings.
SNMP Configuration
To ensure that you can successfully monitor your new system, you will need to connect
it to a local or private hub using a standard RJ-45 Ethernet Cable. Connect one end of
the cable to the RJ-45 port, located to the right of the power supply modules, and the
other end to your local area network connector. In case you connect the chassis to a
local computer/laptop is sure to use a Hub with a regular network cable or a crossover
cable without a Hub.
The SNMP module in the EB7-X8G2-RAS system is configured for DHCP access (though
this setting can be changed as described in the next section). Once the chassis is
turned on it will be assigned an IP address by your network’s DHCP server.
If you have access to your network’s DHCP server make sure to look up and write down
that IP address. In any other case you will need to use the IPsetup.exe utility to discover
the IP address that was assigned to the chassis. It can be downloaded in the SNMP section of the Magma driver
downloads at: http://www.magma.com/drivers.asp
Double click on the utility icon after your chassis has been connected to the network and powered on. It will then
identify your chassis based on its MAC address and display the following information.
In this case the IPsetup utility has found the EB7-X8G2-RAS chassis at IP address 192.168.1.10.
To verify we’ve successfully detected the EB7-X8G2-RAS on our network press on the Launch Webpage button or open
your browser and direct it to the new found IP address of the chassis (in our case it will be: http://192.168.1.10).
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
36
Configure Network Settings
Open your browser and enter the IP address in the URL window and press Enter. The following browser window will open
up:
The initial, Generic Info page provides status information and no username or password is required. If the main power
switch is off, then this page will show the IP Address that is currently assigned to the chassis, the IP Address that will
receive trap information, the temperature settings and that the chassis is powered off. To make changes to your settings
you will need to follow the “IP Configuration” link. The IP configuration page is password protected and before access is
given the following dialog will appear:
The factory settings define User nameto be “default” and the password to be “magma”. Enter these values in the
appropriate field and click OK. If the username and password have not been changed from the factory settings, the IP
Configuration page will appear as shown below. If it doesn’t, see your network administrator for the correct user name
and password.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
37
To change the IP address, enter the new static IP address in the IP Address field. Enter the new subnet mask in the
Network Mask field. Enter the IP addresses for the Gateway and the DNS Server in the appropriate fields. Finally, enter a
new network name for the EB7-X8G2-RAS in the DHCP Device Name field for use when accessing the chassis when DHCP
is enabled. If you wish to use DHCP, enter 0.0.0.0 in the IP Address field, but be sure you have the tools and proper
network privileges to access the system after a server had assigned it an IP address.
When you have finished configuring the network settings, you can either configure the SNMP settings as described in the
next section, change the default user name and password, or save the current changes by clicking on the Save Network Configuration button at the bottom of the screen.
Now you can connect your chassis to the network. To find the IP address assigned by your DHCP server, look in the DHCP
server’s list of attached devices for the name you assigned to your EB7-X8G2-RAS chassis.
Configure SNMP Settings
If you are adding your EB7-X8G2-RAS chassis to an existing SNMP network, or if you are planning to trap SNMP errors, you
will need to configure the SNMP settings for use with your SNMP agent.
To configure these values for your SNMP network, select the SNMP section on the top bar and change the default values
to match your requirements.
Change the Read Community Name and Write Community Name fields to match those required by your SNMP network.
The default value is public.
Change the Trap Destination IP Address to the IP address of the computer getting the SNMP data. The default Trap Destination IP address in the above example was: 192.168.1.2.
Finally, save the newly entered settings:
Temperature settings
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
38
IMPORTANT
The user name and password fields are case-sensitive.
In the Temperature section you can view in real time the temperatures inside the chassis. Should the temperature rise
above the set limit, the respective value will be shown in red, an audible alarm will be triggered and the temperature
LED in the front control panel will turn orange (see example below concerning Main Temperature 3 exceeding its limit):
Change Credentials
This section allows you to change the default user name (default) and password (magma).
To change the user name, simply enter your new user name in the user name field. To change your password, enter your
new password in the password field. Enter it again in the password(again) field. The password in both fields must match
before they can be accepted.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
39
When you have finished changing the default user name and password save the current changes by clicking on the
Save New Credentials button at the bottom of the screen:
Reset to Default Values
You can restore your EB7-X8G2-RAS chassis to the factory default values by pressing and holding the Alarm Reset Button
for 10 seconds the Power LED will blink during this 10 second period. When all values have been restored, the LED will stop
blinking and turn off.
Configure your SNMP Agent
If you use an SNMP agent to help you monitor your network, you will find all necessary monitoring information in the MIB
file.
Retrieving the MIB File
The MIB file is available for download at: http://www.magma.com/drivers.asp in the SNMP section of that page.
After you click on the MIB file link, save the file as type “All Files” to your preferred location. You may then open the file
(using Notepad, or equivalent text editor) and all the information needed to configure your SNMP agent will be
displayed on the screen:
Once the MIB file is saved it can now be copied and loaded locally or to a remote server.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
40
Accessing the various SNMP functions
Once the MIB file has been loaded to an SNMP server (via a front-end software typically called a MIB Browser) we can
read in status information and set up specific functions otherwise not available via the Web interface.
The MIB Browser (or equivalent front-end SNMP software) will display the Magma chassis MIB contents in an explorer-like,
Tree interface. A snapshot from the MIB Browser by iReasoning is shown below:
Under the MIB Tree, the Magma Chassis will have status information that can be read by expanding the respective
folders. This information is also available in the Web interface mentioned previously. In addition, if we
expand the sendActionfolder (as shown above) we gain access to “writable” functions that essentially allow us to
remote-control the chassis.
Remote Chassis Reset (turnPowerOffOn)
This function allows us to remotely turn the chassis off and on.
Right-click on it, and an options menu will appear. Select the “Set “command:
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
41
IMPORTANT
In order to successfully apply this function you must first set the SNMP Power-on
Jumper in the position between PS_ON and ON_BY_MCU. This is not the default
position of that jumper.
Additionally, the chassis’ master on/off switch as well as each of the redundant
power supplies’ switches must be turned ON.
I/O Switching
The SNMP interface allows us to configure voluntary I/O switching so that the resources offered by PCIe cards installed in
the Magma chassis can be rolled from one PC to another in real time. To access this feature, click on the I/O Failover link
as shown below:
For more information on this feature see Appendix B: I/O Switching
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
42
IMPORTANT
For this feature to work, you need to install the Magma HotPlug software driver.
See Chapter 2 for instructions on how to download the latest software for your
system.
IMPORTANT
There are cases in which you would wish to turn off this feature, especially if the
PCIe cards you plan on installing in the EB7-X8 chassis require or adhere to a
different timing budget than allowed in the PCIe specifications.
In order to turn off Hot-plug/Hot-swap, toggle the top actuator on the Chassis
Alternate Function DIP Switch from its default right position to the left as shown
below:
If you have any doubts, please check with you card’s vendor that no such
constrains exist for this card.
COMPATIBILITY ISSUE
A documented compatibility issue exists between an Apple’s MacBook Pro
and G5 systems in conjunction with the EB7-X8G2-RAS chassis on which is
connected an ATTO Technologies’ UL5D PCIe SCSI adapter. In this
configuration, the Hot Plug feature needs to be disabled, otherwise the
system won’t boot.
Finishing Touches
After your system is working properly, replace any empty slots with slot covers, replace the host computer cover, and the
close the expansion chassis.
“Hot-Swappable” PCIe Card Installations
New PCI Express technology allows you to remove your 3rd Party PCIe cards for maintenance or replacement – without
shutting down the system. The EB7-X8G2-RAS expansions system supports Hot Plugging/Hot Swapping of cards as defined
by the PCI express specifications.
By design, this feature allows the host PC to gracefully remove power to a slot, so that a PCIe card can be removed and
replaced. It then powers on the new card in coordination with the PC’s operating system. By default, the EB7-X8G2-RAS
ships with this feature turned on.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
43
Each of the PCIe slots is controlled by a Hotplug (HP) pushbutton. The buttons are enumerated 1-7 as shown below:
Simply press the Attention Pushbutton corresponding to the slot you wish to “power-down.” The power will be removed
from that slot within 5 seconds so that the card can be replaced. All other PCIe cards remain.
Hot-Plug/Swap Procedure for Windows
1. Given a stable Windows-based system booted with the Magma chassis, an applet on the right
hand side of the start menu bar should appear depicting a card with a green arrow above it.
Double click on the applet.
2. A dialog should appear with the title “Safely Remove Hardware” in the dialog will be a list of devices that may
be removed from the system. Within this list will be the cards currently plugged into the chassis.
Select a device and click on the “Properties button”.
3. If the device is currently in the Magma chassis, the location will show “Magma chassis x slot y”. Where x
identifies the physical chassis and y identifies the slot the device is plugged into.
After verifying that this is the device to be removed, click on the OK button to close the new dialog.
4. The properties dialog should close and the original “Safely Remove Hardware” dialog should remain.
Click on the Stop button of the dialog.
5. A dialog with the title “Stop a Hardware device” should appear. This is to confirm the stop command that will
be sent to this device.
Click on the OK button of the new dialog.
6. After a brief period a pop up will appear confirming that the device may be removed safely, and the device
will be removed from the list of the original dialog.
In the chassis, press the Attention Button that corresponds to the slot where the device is located.
7.A green LED, labeled PX PwrE (where X corresponds to the slot number) will begin to flash.
Note: If, by mistake, you’ve pressed the button corresponding to the wrong slot, then press it again within 5 seconds
and the hot plug request will be ignored. Otherwise continue to step 8.
8. After 5-6 seconds the LED will stop flashing and turn off completely.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
44
IMPORTANT
Ideally the PCIe card that was removed from the system will be replaced with
an identical, working card. Replacing that card with one that has a different
function or purpose may cause the system to crash due to a mismatch in the
resources pre-allocated by the operating system.
Remove the card and replace it with a new one. Then press the button again.
1. The LED should start flashing again.
If power should not be applied to this slot, immediately press the button again and the LED will stop flashing and
remain off, otherwise go to step 10.
2. After 5-6 seconds the LED will stop flashing and remain on.
After a brief period the new device will be recognized by the system, and it should be added back to the list in the
“Safely Remove Hardware” dialog.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
45
Hot-Plug/Swap Procedure for Linux
1. Set up a console as super user and run: “tail …” to receive messages.
sudo –f /var/log/messages
2. Open another console as super user and run: “modprobe pciehp”
sudo /sbin/modprobe pciehp
3. If there are any error messages in the first console run: “modprobe pciehp pciehp_force=1”
sudo /sbin/modprobe pciehp pciehp_force=1
4. Verify that there are entries in the /sys/bus/pci/slots directory and determine which slot corresponds to the
chassis. The entries shown may not correspond to the slot numbers labeled on the chassis, therefore
this verification is required.
cd /sys/bus/pci/slots/
Note:
For SUSE 11, slots may be reported as 1,2,3...
For SUSE 10 sp2, slots may be reported as:
Segement:Bus:Device:Function.
5. In order to determine whether power is applied to a slot run:
cat <./slot filename>/power
1 – Means the slot is powered;
0 – Means the slot does not have power
6. In order to turn off power to a slot run:
echo 0 > <./slot filename>/power
After the PCIe card has been removed and replaced, turning on the power to the slot is done by running:
echo 1 > <./slot filename>/power
Note: Different Linux versions and platforms may perform differently. Also, older versions, such as Redhat ver. 4 or
(2.4.x do not support this feature).
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
46
The Alternate Function DIP Switch
The Alternate function DIP switch controls the following three functions: Hot Plug, Clock and power delivery behavior.
Actuator (1) Hot Plug:
Turns the Hot Plug function ON and OFF. Its default position is Enabled in which case a Hot Plug controller supervises
power delivery to the PCIe slots.
Actuator (2): Local Clock:
Turns on a local clock generated by the chassis itself independent of that of the Host system. Its default position is
Disabled, i.e. the system Clock comes from the Host system (uplink).
Actuator (3): Slot Clock
Should be enabled only when a PCIe CPU card is placed in the 7th slot. That way a locally-generated clock can be
supplied to the card.
Actuator (4): For Magma internal use.
EEPROM Loading
The core component in the expansion chassis—the PCIe switch— requires EEPROM loading of code for proper operation
in PCIe Gen II mode. Therefore in an EB7x8G2 system, which supports Gen II speeds, J16 must be installed. In case of the
EB7x8 system, J16 may remain open.
Magma
EB7-X8G2 | Chapter 4 Install PCIe Cards
47
EEPROM Write Protect (WP)
J9 is used to enable or disable writing/programming the EEPROM with new code. Since EEPROM programming should be
done only by Magma personnel, it is recommended to keep write-protection on.
PCIe Switch I2C Address Setting
SW9 is used to specify a different address for the PCIe switch in its secondary I2C bus. To be used by Magma personnel
only.
Magma
EB7-X8G2 |
48
PCIe Expansion Performance with the EB7-X8G2-RAS
In the following section we will take a look at possible PCI Express expansion solutions using Magma’s EB7 chassis.
High Performance Video Card expansion solutions
Magma’s EB7-X8G2-RAS chassis can be used to add a high end PCI express video card to a system, be it a server, a PC
or a laptop that were not equipped with such a device for various reasons: cost, lack of physical space, heat dissipation
considerations, etc.
A question then arises as to how good of a performance can we obtain by utilizing
the expanded PCIe bus and high end video card vs. the built in video solution. For
that we turn to Futuremark’s 3DMark® benchmarking software which has quickly
become the de-facto standard in Video card performance testing and evaluation.
The 3DMark® suite is optimized to work under Windows XP/Vista/Win7 and supports
the latest DirectX and derivative 3D multimedia technologies.
In this environment, a Gigabyte X58-UD5 was tested with various external PCIe
video cards connected to Slot #1 (PCIe x8G2) of the EB7-X8G2-RAS.
The motherboard has a Geforce 7600GS graphic card which is used an secondary
monitor. We first established a baseline by installing a high performance x16 Gen1
PCIe card into the EB7-X8G2-RAS: The Nvidia 8800 Ultra.
* These tests measured the net GPU performance, not including the CPU
The comparison table above shows an average 54% performance improvement between the baseline and the highestend video card tested. In other words, by expanding the PCI Express bus, the EB7-X8G2-RAS system was able to facilitate
an ever-improving benchmark result limited only by the 3rd party card’s performance and the bandwidth limitations of
the bus itself.
For more details on the actual test methodology and an explanation of the benchmark figures please refer to:
www.futuremark.com
Magma
EB7-X8G2 | Chapter 5 Chassis Maintenance
49
Always remember to power down your computer and the expansion system BEFORE you attempt to
perform any maintenance tasks.
Do not use a vacuum because vacuums create ESD.
Chapter 5 Chassis Maintenance
Like all computer systems, you will need to perform some routine maintenance tasks. Some of these include making sure
that the air vents in the chassis are clear of obstructions and that the cooling air from the fans flows freely. You will also
need to check the foam filter behind the front panel to ensure it is clean, thus allowing for unrestricted air flow to the
fans. You should always keep an eye on all cables to make sure they are not damaged and are securely connected.
Occasionally, you should remove the chassis cover and check for loose cards, and remove any dust build-up.
General Chassis Cleaning
The environment where your Magma chassis is operating should be the determining factor as to how often you should
perform a general cleanup of the chassis. To perform a routine general cleaning of your chassis, you will need the
following:
1. Can of compressed air (proper distance, 6 inches)
2. Cotton Swabs
3. Isopropyl (alcohol)
4. Anti static wipes
5. Warm water (for filter)
6. Dish soap (for filter)
First, remove the four cover screws and the top chassis cover:
Next, use a can of compressed air from your local computer store to blow out any dust that may have accumulated in
the chassis fans.
Be sure to keep the can of compressed air about six inches from the parts being sprayed with air. Pay particular
attention to the fans in the chassis and power supply because they are critical to air movement and to keeping
your chassis cool. Also spray the PCIe slots on the backplane.
Magma
EB7-X8G2 | Chapter 5 Chassis Maintenance
50
If your chassis is extremely dirty and you would like professional help with getting
it clean, you can contact Magma Support for instructions and costs on shipping
the chassis back for cleaning.
NOTE
The Magma part number for a replacement fan is: 26-00031-00
Next, you can use anti static wipes to wipe down any open areas inside and outside of the chassis to remove any
remaining dust or dirt. If you have dust or dirt remaining in any “hard to reach area”, such as corners of a fan blade, you
can use the cotton swabs, dipped in the isopropyl (alcohol), to gently rub the area clean.
Lastly, if the chassis was extremely dirty, you can remove any installed 3rd Party cards and wipe the PCIe slots with a soft
bristle brush (like a toothbrush), dipped in the isopropyl (alcohol), to gently clean each slot. When finished, blow the slots
with compressed air from about six inches away until dry.
Finally, clean the air filter following the instructions later in this chapter. When finished, replace the cover and turn on
power to the system.
Fan replacement
The EB7-x8G2-RAS chassis was designed to allow “hot-swappable” fan replacement while the chassis is powered on. First
you will need to remove the chassis’ lid as shown in the beginning of Chapter 4. Then locate the fan that has failed,
unlock its thumbscrew, lift up its metal tab and pull it out.
Insert the new fan in and secure it in place. Verify the new fan is spinning and restore the chassis lid.
Magma
EB7-X8G2 | Chapter 5 Chassis Maintenance
51
In order to ensure the safety and efficiency of your expansion system, it is
recommended that you keep a spare power supply module on hand – just in
case. Protect yourself, keep a spare. Order your spare power supply module
from Magma –
PN 40-00030-01.
“Hot-Swappable” Power Supply
In spite of regular performance of routine maintenance tasks, some computer systems can experience hardware failures.
Fortunately, your investment in a Magma Expansion system with a redundant power supply provides you with the ability
to easily replace a power module in the event of a failure.
The redundant power supply includes two hot-swappable modules that share the power load requirements during
normal operations. Should one module fail for any reason, the power load will be shifted to the other module and sound
an audible alarm.
If a power supply fails, an alarm will sound to alert you of the problem. Press the black button on the status panel on the
front of the unit to stop the audible alert.
To replace a failed power supply, simply grab the handle, press down on the release lever at the top of the module, and
pull. Replace the failed module with a new one and turn on the power to the module using the power switch at the
bottom of the module. The power load will again be shared between these two modules.
Magma
EB7-X8G2 | Chapter 5 Chassis Maintenance
52
NOTE
Note the different types of screws and where they go as you take them out.
Cleaning the Air Filter
The chassis is equipped with an air filter that is easy to remove and clean. To keep your chassis running at its coolest, you
should clean this filter regularly. How often the filter requires cleaning depends on environmental conditions where your
Magma Expansion chassis is located. To clean this filter, follow these simple steps.
First, power down the chassis and then remove the screws on the side of the front panel with a Phillips screwdriver.
Next, open the faceplate slowly and disconnect the wire marked below:
Then remove the foam filter, located behind the faceplate, and clean it with a solution of warm water and mild dish
soap.
Finally, replace the filter, reconnect the LED panel. Secure faceplate with Phillips screws. Tighten screws until snug and
turn on power to the chassis.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
53
Chapter 6 Troubleshooting
Before discussing a troubleshooting methodology for locating the problem we will first introduce several indicators and
configuration switches that provide general and specific information for this process.
Status Indicators and configuration switches
Under normal operating conditions the status indicators are for internal Magma troubleshooting while the configuration
switches/jumpers should remain in their default state preset by Magma for best compatibility. However, should a
problem occur with the chassis (or a special mode of operation be solicited by the client) we included below
explanations as to what all these items are and how they should be treated:
Status Panel indicators
All LED’s should be green at all times. An orange LED means a fault of the corresponding item listed in the picture above.
Chassis Signal Detect Indicators
This group of LEDs (D2, D6-D8) indicates the existence of PCIe traffic on the receiver side on the respective PCIe lanes. In
the example shown here, an active x8 link is identified by x1, x2, x4, and x8 LEDs being ON. During normal operation
signal detect LEDs and D14 (clock good) should be ON with the exception of D9 whose role is to indicate loss of signal
and logic failure.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
54
Chassis Slot Power Indicators
If the unit is in Hot-Plug mode (default factory setting) then the orange Power Off LEDs found between the slots and
chassis will be lit. They indicate lack of power at the respective PCIe slot. This would be a normal condition if the chassis is
powered on while the Host system is turned off (RESET state) or if power to a specific slot has been removed for it to be
swapped as part of the Hot-Plug procedure.
If the Host system is turned ON but there is no PCIe card in the slot, the Power Off LED will be ON.
If the unit is NOT in Hot-Plug mode, the orange LED’s should be all off.
If a slot has a card in it and the respective orange LED turns on that means there was a power fault in that slot. If that is
the case, one needs to follow appropriate procedure to power down the host and then power down the chassis. If the
problem persists, check with the card manufacturer if it requires more than 8 Amps of current at any time. Otherwise
contact Magma Technical support.
Chassis Linkup and Activity Indicators:
These indicators were purposely made visible at the back of the chassis in order to allow a quick verification of
connectivity between Host and chassis.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
55
Each of the LEDs shown above indicates the connectivity status of the PCIe card inserted into the respective PCIe slot.
Once connectivity has been established between the host computer and one (or more) PCIe cards, the respective
LED(s) will light up. The Uplink Port LED will light up as soon as the chassis had linked with the host system regardless of how
many PCIe cards are installed in the chassis, or if none at all. Therefore in normal working conditions it should always be
lit.
The activity LEDs will blink occasionally whenever the host is communicating with the card is a respective slot.
SNMP Power-On Source Jumper
The SNMP module inside the EB7-X8G2-RAS chassis features a power-on source jumper to select between local power-on
(via the master on/off switch) and remote turn-on (via the SNMP software/front end).
In order to gain access to this module (and respective jumper), the top cover of the chassis needs to be removed.
Dismount the chassis from the rack (if applicable) and carefully remove the screws holding the chassis cover in place.
The SNMP module will be located on the right side of the unit oriented with the fans facing us.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
56
Now locate the J6 jumper as shown below
Locating the Problem
If you are having trouble with the Magma expansion system, first verify that all cards and cables are seated properly. Be
sure you followed the instructions in earlier sections of this Service Manual. Always remember to power On and Off
correctly when rechecking your installation. If you are still having problems, try these troubleshooting steps:
My Computer Can’t Find the PCIe Expansion System
When Nothing Works
My PCIe Card Doesn’t Work
My system hangs beyond a certain number of add-in cards
The Magma PCIe Expansion System is correctly displayed as a “PCI standard PCI-to-PCI bridge” in Windows Device
Manager and as a “pci-bridge” in the MAC Apple System Profiler and in Linux. When connected and functioning
correctly, this Expansion System will be displayed as follows:
Windows
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
57
MAC
If this is not what you see when you verify your installation, the following troubleshooting steps may help you locate and
resolve your installation issues without having to call Technical Support.
My Computer Can’t Find the PCIe Expansion System
If the expansion system is not visible in your Windows Device Manager or your Apple System Profiler at all, you will need to
turn off your computer (first) and then the Magma expansion chassis (second) and test all cords and cables to ensure
you have everything connected correctly. If everything seems to be connected correctly, and you are sure you have
applied power correctly (power up the expansion chassis first and then the computer), then try the following
troubleshooting steps:
Verify that the required LEDs on the back of the chassis are lit as explained in the Chassis Linkup section above.
The most important indicators are the LINK LEDs that indicate a proper connection. All LINK LEDs on the host and
expansion cards should be ON if both PCIe slots are populated and both an uplink and a downlink iPass cable
are connected properly. The ACT (activity) LEDs will light/blink only upon data transfers between host and
expansion. They can be off so long as the required LINK LEDs remain on.
Also verify the Magma PCI Express Host card is properly inserted into the host computer slot. In case any other LED
is off, ensure the respective card is functional and properly seated in its ExpressBox slot.
Try moving the PCIe host card to a different PCIe slot.
If the expansion system is still not visible after trying all of the above steps, go to Chapter 7 to get additional help.
Windows
If the PCI-to-PCI Bridge is now visible, but contains a (exclamation) in front of it, it has a problem that must be
fixed.
To identify this problem, right-click on the line with the and select “Properties” from the pop-up menu.
Resolve the identified problem or go to Chapter 7 to get additional help.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
58
MAC
Go to Chapter 7 to get additional help
RedHat9 Linux
Go to Chapter 7 to get additional help
When Nothing Works
The following troubleshooting steps will help you when the computer or chassis won’t turn on or “nothing seems to work”
correctly:
If it powers up OK, but nothing works, check the computer’s Device Manager or System Profiler to see if the expansion
system has been found. If not found, try the troubleshooting steps for My Computer Can’t Find the PCIe Expansion
System. If the expansion system is visible, but has a problem, try to resolve the problem (See Note above). If that fails, go
to Chapter 7 to get additional help.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
59
My Computer Hangs During Power Up
If your computer “hangs” while being turned on and you can’t even start, follow the following steps to try to fix this
problem:
1. Shut off the computer (first) and then the Magma expansion system and verify that all cards and cables are
connected and seated correctly.
2. If it still hangs and you have added one or more hard drives in addition to several PCIe cards, ensure that you
have not exceeded the power capabilities of the expansion system‘s power supply. You can verify the
capacity of your power supply by checking the label on the power supply. If you are not certain about the
power consumption of your peripherals, it is best to remove them one by one (starting with those you suspect of
being most “power hungry”) until the system powers up.
rd
3. If you have removed all 3P
a. Remove the Magma PCIe expansion host card from the computer and try booting up without the Magma
expansion system attached.
i. If it boots up OK without the Magma expansion system attached, call Magma Technical Support.
ii. If it still hangs, the problem is in the computer and not with the Magma expansion system or the 3
Party PCIe cards.
b. If it boots up OK without any 3
i. If it boots up OK with one card in it, shut it down and swap cards. Repeat this until all cards have been
tested. If they all test OK, then add them back one at a time until you find the combination that
doesn’t work. If you find a badcard, call Technical Support. If you don’t – congratulations, you fixed it!
P
Party PCIe cards from the Magma chassis and it still hangs, try the following:
rd
Party PCIe cards installed, try adding only one card and see if it boots up.
rd
ii. If it still hangs up, try a different card – this one is probably bad (or has driver problems). If the second
cards works, troubleshoot the first card. If the second card also fails, call Technical Support.
My PCIe Card Doesn’t Work
The following flowchart describes a general approach to resolve PCIe card issues:
The following additional steps might also help when the above troubleshooting steps fail to resolve your problem:
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
60
IMPORTANT
The Magma PCIe Expansion System is designed to function exactly like your desktop
computer. This means that you should follow the card maker’s instructions for installation
on a Windows or Mac computer as if the expansion chassis WAS the desktop computer.
When correctly installed, there is no difference to the operating system, removable
cards, or most software.
1. Shut down the computer followed by the Magma expansion chassis
2. Remove the PCIe card displaying a problem
3. Replace the “problem card” with a simple PCIe card, such as an Ethernet card that has drivers built into the
operating system. (Using this “type of card” will avoid any future questions about drivers possibly being installed incorrectly.)
4. Turn on the Magma expansion chassis, and then turn on the computer.
Windows
5. Next, open the Device Manager (View by Connection selection).
rd
If the is gone, the problem is with the 3P
P
Party PCIe card or the card drivers. You should go to the Windows
Error Codes section of this chapter to learn how to troubleshoot using error codes.
If the is still visible, the problem may be with the Magma expansion system. Please contact Magma
Technical Support for further guidance and/or a replacement product.
MAC
rd
6. Next, open the Apple System Profiler and the 3P
P
Party PCIe card(s) should now be visible.
RedHat9 Linux
7. Using the lspci command, verify that the PCIe card is visible.
rd
Support for 3P
Magma will provide reasonable technical support to with 3P
installation of the Magma PCIe Expansion System (as defined in Chapter 4), but experience difficulty installing your 3P
Party PCIe cards, the card manufacturer should be able to provide the best support.
Windows Error Codes
P
Party PCIe Cards
rd
P
Party PCIe cards. However, if you have verified a successful
rd
P
If you are having a problem with one of your devices, and the Device status box shows a Windows Error Code, refer to
the following list of error codes for guidance:
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
61
Error Code
Description/Action
10
This code indicates that there is a problem with the 3rd Party PCIe
Card driver. If necessary, contact the card’s manufacturer for
updated software drivers. If all else fails, contact Magma
Technical Support for further assistance.
28
The driver for the PCIe card is not installed on your system.
Reinstall the card driver following the manufacturer’s instructions.
If that fails to fix the problem, call the card manufacturer for new
drivers.
1
The PCIe host card or expansion chassis are not working correctly.
Reinstall the PCIe host card into the computer’s slot and recheck
all cable connections. If the error code remains, try another PCIe
slot. If the error persists, call Magma Technical Support.
12
On the Bridge: If you receive error code 12 on the first PCI to PCI
Bridge, call Magma Technical Support.
On the Card: This usually means the memory, I/O, or prefetch is
more than has been allocated. Call Magma Technical Support
Other Codes
For all other error codes, call:
On the PCI to PCI Bridge: Magma Technical Support
On the Card: Card Manufacturer’s Technical Support, after first
verifying that the Magma expansion system is installed properly.
If you are still having problems, contact Magma Technical Support for more help.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
62
My system hangs beyond a certain number of add-in cards
Any PCI or PCI Express expansion scheme requires the cooperation of the computer system’s BIOS in order to operate
properly, regardless of the platform (PC/Laptop/Server) or operating system (MS Windows/MAC OS/LINUX etc.)
The BIOS hosts the first and the most fundamental code (firmware) that a computer executes upon boot-up. It is then
that each and every PCI/PCIe add-in card (be it located on the host system or on Magma’s expansions chassis) is
allocated Input/output memory space for proper operation.
By installing multiple add-in cards in one chassis or chaining multiple Magma chasses (as discussed in: Appendix A),
we’re requesting more and more resources from the BIOS and thus must make sure we pre-allocate them sufficiently.
It is therefore imperative that our computing platform allocates at least 32KB of I/O memory space to allow multiple add
in cards to operate properly. This setting may be editable or preset by your BIOS (or computer) vendor. If you’re having
this problem it is recommended that you first update your system to the latest firmware provided by your vendor.
Instruction on how to do that (as well as making a backup of your current BIOS firmware) should be provided by your
computer vendor on their web site.
In case this property is editable, you computer vendor should also be able to tell you how to select at least 32KB using
their BIOS interface.
Rackmounting the Chassis
Locate a vacant 4U slot in your rack that is within the reach of the one-meter cable that came with your EB7-X8G2-RAS
Expansion System. Install the rails in the rack as shown below:
Measure the rack from front to back so you can confirm how long the rail must be to fit properly.
Next, assemble the Slide piece with the end bracket as shown and secure with 2 Panhead screws and locking nut.
Ensure the Phillips screw head is located on the “open” side of the Slide pieces as shown.
Tighten finger tight only to allow for minor adjustment during assembly.Depending on the depth of your rack you may
select either the long or the short end bracket.
Magma
EB7-X8G2 | Chapter 6 Troubleshooting
63
NOTE
Notice that the holes on the Bar Nut are spaced unevenly to accommodate
different racks.
Add Screws to Rack Post
Attach 2 Panhead screws into the rack post where you want the chassis
mounted. Be sure you have measured accurately to ensure that everything fits in
the rack correctly. Leave the screws untightened until after you place the slide
rail’s fingers between the screws as shown.
If your rack has holes too large for the screws, you can use the Bar Nut to secure
your mounting by inserting the Panhead screw through the rack hole and
screwing it into the Bar Nut on the reverse side of the rack post, as shown.
Attach Slide Rail to Rack
Attach to inside of rack with “fingers” pointing “out” and the end bracket
to the rear. Secure each Slide Mount with 4 screws as shown below.
Secure the slide rail to the rack with 2 screws to both front and rear posts.
After you have secured the slide rail fingers to the rack posts, tighten the 2
screws used to attach the slide rail to the end bracket.
Attach Chassis to Slide Rail
The chassis mounts into the rack from the front. Insert the chassis into the rack slide and press it forward until the chassis
stops. When the chassis is completely inserted into the rack, secure the mounting brackets 2 screws on each side.
Magma
EB7-X8G2 | Chapter 7 How to Get More Help
64
1) Name
2) Company Name
3) Phone Number
4) Fax Number
5) Email Address
6) Model Number
7) Serial Number
8) Computer Make
9) Computer Model
10) Operating System and Version
11) Make/Model of PCI cards in expansion chassis
12) Detailed description of the problem
Chapter 7 How to Get More Help
Frequently Asked Questions (FAQ)
You can visit the Magma Technical Support FAQ pages on the Internet at: Twww.magma.com/support/TH
Contacting Technical Support
Our support department can be reached by fax at (858) 530-2733 or by phone at (858) 530-2511. Support is available
Monday through Friday, 8:00 AM to 5:00 PM PT. When contacting Magma Technical Support, please be sure to include
the following information:
You can also visit our web site at: HTwww.magma.com/support/T
For a quick response, use the Technical Support and RMA Request Form available in the Support Section of the website.
Simply complete the form with all required information. Please make sure that your problem description is sufficiently
detailed to help us understand your problem.
For example: Don’t say “Won’t boot up.” Do say “Tried all the steps in the Troubleshooting Section and it still
won’t boot up.”
For faster diagnosis of your problem, please run the two utility programs described in the following sections and include
the diagnostic files they generate with your email.
PCIScope Software Utility
PCIScope is a powerful diagnostic tool for Windows designed by APSoft. This software utility is a valuable resource to
explore, examine and debug the PCI subsystem of your computer. It was made to fit the requirements of service
personnel, especially engineers, programmers, and system administrators, and to integrate all advanced functions and
tools into one product. Please visit HTwww.tssc.deTH for more information about the capabilities of PCIScope and other
utilities offered by APSoft.
An evaluation version of PCIScope is available for download at HTwww.tssc.deTH. (You can purchase an inexpensive license
from APSoft for use beyond the evaluation period.)
PCIScope has proven to be extremely useful when verifying and debugging configurations involving the Magma PCI
Expansion Systems under any Windows platform.
PCIScope can provide information to you and our Technical Support Group such as PCI Bus Numbering, Resource
Allocation, and other information that may prove useful when debugging expansion chassis or PCI card problems.
If you are experiencing problems setting up your system, you should run PCIScope before contacting the Magma
Technical Support Group.
Magma
EB7-X8G2 | Chapter 7 How to Get More Help
65
With the Magma expansion chassis powered up and connected to your computer, load and launch the PCIScope
application. The PCIScope Program will be installed on your computer and a window similar to the one shown below will
appear. (The example was taken from a Compaq Armada 7400).
You should save this data as a file on your computer. Please include your name and date as part of the file name with
an extension of “.bpd.” This file should be included as an attachment when submitting a Technical Support request at
Hwww.magma.com/TUsUTupportH
Magma
EB7-X8G2 | Chapter 7 How to Get More Help
66
Returning Merchandise to MAGMA
If factory service is required, a Service Representative will give you a Return Merchandise Authorization (RMA) number.
Put this number and your return address on the shipping label when you return the item(s) for service. Magma will return any productthat is not accompanied by an RMA number. Please note that Magma WILL NOT accept COD packages, so
be sure to return the product freight and duties-paid.
Ship the well-packaged product to the address below:
MAGMA RETURNS DEPT.
RMA # ________
9918 Via Pasar
San Diego, CA 92126
USA
It is not required, though highly recommended, that you keep the packaging from the original shipment of your Magma
product. However, if you return a product to Magma for warranty repair/ replacement or take advantage of the 30-day
money back guarantee, you will need to package the product in a manner similar to the manner in which it was
received from our plant. Magma cannot be responsible for any physical damage to the product or component pieces
of the product (such as the host or expansion interfaces for the PCIe expansion chassis) that are damaged due to
inadequate packing. Physical damage sustained in such a situation will be repaired at the owner’s expense in
accordance with Out of Warranty Procedures. Please, protect your investment, a bit more padding in a good box will
go a long way to insuring the device is returned to use in the same condition you shipped it in. Please call for an RMA
number first.
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
67
In theory, your computer “should” be able to travel across up to 255 PCIe buses to identify
and configure all installed PCIe cards. The 255 PCI bus limit is actually a theoretical maximum.
The practical limit is somewhat lower and differs from one system to another, but should still be
a fairly large number.
In a desktop computer the bus numbers tend to be lower (0, 1, 2, etc.). Once the BIOS is
finished configuring everything and assigning resources, the Operating System starts loading
and activates the PCIe cards found.
When adding more Expansion Systems to an existing system, be sure to connect and test
them “one-at-a-time.” This will allow you to quickly resolve any connectivity, or other, issues
right at the start. DO NOT INSTALL any 3rd Party PCIe cards into any system until ALL attached
systems are working correctly.
Appendix A Need More PCIe Slots?
Multiple PCIe Expansion System Configurations
The PCI Express Local Bus Specification defines the bus as hierarchical, where logical PCI to PCI Bridges (PPBs) may be
used to add "levels" to the PCI bus hierarchy within a PCIe switch. Because hierarchies are organized systems arranged into different levels, you can take advantage of this automatic organizing and layering to expand the number of
available PCIe slots beyond the number available in your computer’s motherboard.
You can easily add two or more Magma expansion systems to your current system in a "fan-out" configuration. Each of
these configurations has advantages and uses. To determine which type of configuration you wish to use, you should first
understand a few basic facts:
1. In a desktop computer, the BIOS enumerates automatically behind logical PCI bridges. In the Magma
configuration, the BIOS looks beyond the Host card to find any PCIe cards installed in the expansion chassis
behind a PCIe switch. The PCIe switch, in turn, emulates logical PRBs. The BIOS can then configure the cards
and allocate resources. Empty PCIe slots are ignored during configuration.
2. Most computers allow multiple logical bridges (and thus PCIe buses) to be correctly configured. Some
computers, unfortunately, place an arbitrary limit on the number of bridge levels that can be traveled during
power-on configuration. Your computer “power-on-software” should be compliant with the PCIe bus
specification in order to effectively use a Magma PCIe Expansion System. For a "fan-out" system configuration,
where more than one PCIe expansion system is being used, you should count all of the logical bridge levels to
your most deeply nested PCI bus to determine the maximum number of bridge levels that must be traveled.
Exceeding this number may cause software configuration conflicts even though hardware-wise the PCIe
system is properly configured.
3. For easier understanding, a given PCI system should be viewed as a “Resource Toll road” that runs from the
computer CPU (resource home), through the “Toll Booths” (the PCIe switches and logical PCI bridges), to the
“Resource Users” (PCIe Cards). As in the case of a real Toll Road, the more Toll Booths you have to cross (even if
it takes a nanosecond), the longer it will take you (your data) to get from the PCIe Card to the CPU and back
again. Under most circumstances the effect cannot even be detected. However, under other conditions, it
can be important to know about.
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
68
You must ensure that you have the corresponding PCIe to PCIe Expansion System, or chassis to
connect with your host card to support your desired configuration.
For clarification, it is necessary to understand that the amount of latency caused by a PCIe
switch (or a PCIe-to-PCI bridge built into some 3rd Party PCIe cards) is negligible
(“nanoseconds”) and will not produce any visible effect on most systems. It is only mentioned
here because of certain specialized configurations involving unique PCIe cards with special
software drivers. The total number of logical buses that the data must pass through COULD
make a difference. See Chapter 5 Troubleshooting for more information if you suspect this
could be an issue with one of your specialty PCIe cards.
The Fan-Out Configuration
The Fan Out addition to the PCI bus hierarchy is at the "peer" level of other existing expansion buses, thus adding
"breadth" to the PCI bus hierarchy, since these buses will be at the same hierarchical level within the system
configuration.
In this configuration, you have fewer “Toll Booths” to pass through; therefore the latency is shorter, however you
“sacrifice” a PCIe slot in the host computer for each added chassis.
Verify your configuration
Before you start installing your PCIe cards (refer to Chapter 4 Install PCIe Cards for more information), you should confirm
that everything is in proper working order. Refer to Chapter 3 Verify Installation for guidance in verifying the proper
installation of your Expansion System. For example, the following image shows the division within the Windows Device
Manager display between two Expansion Systems connected in a “Fan-Out” configuration. In this case each expansion
chassis offers only two slots of expansion.
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
69
The following image shows the Apple Profiler display when a MAC has 2 Expansion Systems connected in a “Fan-Out”
configuration.
Daisy-Chaining
This configuration offers multiple expansion slots by “sacrificing” only a single slot on the host computer. However, in this
scenario we must also dedicate one of the slots in the expansion chassis for Daisy-Chaining another chassis below it
(a.k.a Downlink). For optimal downlink performance, it is best to dedicate the chassis’ x8 slot for daisy-chaining.
In the daisy-chain configuration, successive PCIe expansion systems are added to the "end" of the PCIe expansion
hierarchy, which adds "depth" to the Local Bus by increasing the number of the logical PCI levels active in the system
configuration.
The daisy-chain configuration is therefore more popular among those who have only one available PCIe slot on the host
computer, but require additional slots downlink keeping in mind that more latency will be introduced every time we go
from one expansion chassis to the other.
Verify your configuration
Before you start installing your PCIe cards (refer to Chapter 4 Install PCIe Cards for more information), you should confirm
that everything is in proper working order. Refer to Chapter 3 Verify Installation for guidance in verifying the proper
installation of your Expansion System. For example, the following image shows the division within the Windows Device
Manager display between two Expansion Systems connected in a “Fan-Out” configuration. In this case each expansion
chassis offers only two slots of expansion.
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
70
NOTE
Notice that each Daisy-Chained unit appears in the Device Manager in the
reverse order of its place in the configuration.
PCI e Card Conflicts
If you determine that one PCIe card is interfering with the operation of another card, first try reorganizing the cards on
the motherboard. Moving the cards around can change the order in which the cards are configured by the system
during power-on. This will go a long way toward resolving module conflicts.
Power-On Sequence for Advanced Configurations
As previously stated in Chapter 2 Hardware Installation, it remains necessary to power up ALL Expansions Systems BEFORE
you turn on the computer. This will ensure that your power-on software can read all available buses and properly
configure all installed PCIe cards.
Obviously, the reverse also remains true for shutting your system down. The computer must be shut off BEFORE you
attempt to turn off your Expansion System(s).
Troubleshooting Advanced Configurations
When trying to troubleshoot problems with PCIe cards in a multiple expansion system configurations, it is vital to correctly
determine the nature of the problem. Therefore, the first task is to identify the card or chassis having a problem by using
the Windows Device Manager, or Apple System Profiler. Refer to the first part of this Appendix for more information on
identifying hierarchical levels in multiple expansion system configurations.
Problems with 3rd Party PCIe cards might only be traceable once you have identified the expansion system containing
the problem card.
Below is a flow chart offering a troubleshooting approach when multiple expansion chasses are involved:
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
71
Finding the Problem Card
Windows
If you need help to determine which PCIe card, or which expansion chassis, has the problem, you can “right-click” on
the card with the and check the information contained in the “Location:” field
Magma
EB7-X8G2 | Appendix A Need More PCIe Slots?
72
Look for the “Error Code” in the box in the center of the Properties Window and then go to the Windows Error Code
section for information on how to resolve this issue.
MAC and Linux
If you have already reinstalled and reseated everything according to instructions in Chapter 2, and the PCI to PCI Bridge
is still not visible in the Apple System Profiler, call Magma Technical Support.
Magma
EB7-X8G2 | APPENDIX B I/O Switching Via SNMP
73
APPENDIX B I/O Switching Via SNMP
The following instructions involve configuring 2 servers that are exactly identical to be able to switch I/Os at any given
time. The switch I/O feature can be used as a failover mechanism if one server went down or if the I/Os need to be
designated to Server 2 for any reason. It should be noted that this feature is not yet applicable to cases where the two
host machines are not identical (i.e. taking the I/Os of a serial card away from and IBM server and re-designating them
to a Dell server).
Further, Server 1 and Server 2 must share the same processors, chipsets and overall architecture, for example, two IBM
Blade servers.
In the next example we will use the EB7-x8G2RAS chassis with Magma’s fiber EIF card, 01-04978-05, connected to two IBM
servers. Similarly, the EB7-x8G2RAS chassis can accommodate two regular EIF cards in slots 0 and 1, each connected via
an iPass cable to the two servers. Finally, this test was performed under VMware ESX4.1.
Step 1: Make sure all systems are off – after doing so, connect both servers to the uplink EIF card in the Magma chassis.
Do not turn the servers on just yet. The dual uplink is labeled Server 1 and Server 2, which correspond to the specified
fiber ports, as shown below.
Make sure the chassis is off
Insert and secure the I/O cards in slots 1 through 7 of the chassis
Step 2: Power on the Magma chassis.
BY DEFAULT, ALL I/O ARE ASSIGNED TO SERVER 1
In this example, we will refer to server 2 as the backup server, and server 1 as the main (primary) server.
Step 3: Hook the chassis up to some type of NAT with an addressing scheme of 192.168.X.X so you can access and or
change the networking properties
Step 4: Power on server 1 and boot it into the WMware ESX4.1 shell.
Once WMware ESX 4.1 is booted, connect to Server 1 via VSphere and mark our target PCIe device for pass-through as
08:00.0 and 08.00.1. This device is a PCIe card plugged into the Magma chassis, whose I/Os we wish to re-direct, in this
case an Oxford Semiconductor serial card.
Magma
EB7-X8G2 | APPENDIX B I/O Switching Via SNMP
74
After rebooting add the pass-through device to the guest OS of server 1, provide the drivers and install the PCI device.
Step 5: In preparation for switching the I/Os over to Server 2, uninstall the PCI device from the Device Manager of Server
1. Next, open the web UI for the chassis (set to 192.168.1.10) and your browser will show the SNMP web interface for the
chassis. Navigate to the tab labeled “I/O Failover” and you will find the default I/O configuration:
In the next image note the status of the two servers indicating which physical fiber link currently has all the I/Os:
Magma
EB7-X8G2 | APPENDIX B I/O Switching Via SNMP
75
Step 6: Switch all I/Os to server 2, the secondary server, by clicking the button “Switch All I/O Ports >>” in the web
interface. You will be directed to a temporary waiting page that looks like this:
After 10 seconds or so, the page will automatically change back to the I/O Failover tab, where you should be able to
note that the I/Os have been switched to Server 2:
The image below shows the statuses after the switchover:
Magma
EB7-X8G2 | APPENDIX B I/O Switching Via SNMP
76
Step 7: Now that your secondary server is ready to handle the transferred I/Os, you can now boot it up into VMware ESX
4.1. After FULLY BOOTING up server 2, connect to Server 1 via VSphere and set up a pass-through on server 2:
Since both server 1 and 2 are hardware-identical, our PCIe device remains at 08:00.0 and 08:00.1. Reboot server 2 and
add the PCIe device to the guest OS:
Magma
EB7-X8G2 | APPENDIX B I/O Switching Via SNMP
77
Now make sure on your server 2 that the drivers for the PCIe device are successfully installed and that it is visible in the
Device Manager.
At this point both servers have interfaced with the PCIe device, so that its respective I/Os can be switched back and
forth between them. Before switching the I/Os back to the primary server, be sure to terminate any applications that
generate I/O traffic.
Step 8: Open up the SNMP web UI once again and switch the I/O back over to Server 1. Be sure to leave the backup
server on while doing this. Once you switch I/O back to server 1, your new I/O Failover page will resemble the initial one
in the beginning of the process:
Step 9: You are now ready to boot up the primary server (server 1). Once you fully boot up your primary server, you can
access all the I/O allocated to it. If you so desire, you can switch the I/Os back over to the secondary server with the
ease of a button without having to reconfigure any of the two servers to handle those I/Os
Magma
EB7-X8G2 | APPENDIX C Compliance
78
NOTE
The assembler of a personal computer system may be required to test the system
and/or make necessary modifications if a system is found to cause harmful
interferences or to be noncompliant with the appropriate standards for its intended
use.
APPENDIX C Compliance
FCC
NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part
15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the
equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency
energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to
radio communications. Operation of this equipment in a residential area is likely to cause harmful interference in which
case the service personnel will be required to correct the interference at his own expense.
This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) this device
may not cause harmful interference, and (2) this device must accept any interference received including interference
that may cause undesired operation.
Changes or modifications not expressly approved by the party responsible for compliance could void the service
personnel’s authority to operate the equipment.
Industry Canada
This Class A digital apparatus complies with Canadian ICES-003. Cet appareil numériqué de la
classe A est conformé à la norme NMB-003 du Canada
CE
The product(s) described in this manual complies with all applicable European Union (CE) directives. Magma will not
retest or recertify systems or components that have been reconfigured by customers
Magma
EB7-X8G2 |
79
Manual P/N 09-09919-02 rev A3
Loading...
+ hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.