Hp COMPAQ PROLIANT 6000, COMPAQ PROLIANT 5500, COMPAQ PROLIANT 3000, COMPAQ PROLIANT 1600, COMPAQ PROLIANT 5000 PCI Bus Balancing and Optimization on Compaq ProLiant Servers
[March 1998]
Prepared By
Windows NT
Integration Team
Compaq Computer
Corporation
CONTENTS
Executive Sum mary 3
PCI Archi tecture 3
PCI Load Balancing 5
Performance Optimiz ation
Using PCI Bus Balanc ing 5
Bus Balancing Rules 5
Example Configurations 6
PCI Bus Loading with
PCI Hot Plug 7
PCI Bus
Balancing Tools 9
System Management
Performance Monitor 10
Balancing Bus Use 10
PCI Bus Loading with
Redundant Controllers 10
Online Storage Controller
Recovery Option 10
Compaq Advanced Net work
Control Utility 10
Future PCI Bus Loading
and Technical Summar y 11
ECG073/0398
WHITE PAPER
.
.
.
.
.
PCI Bus Balancing and Optimization on
.
.
.
.
.
.
.
Compaq ProLiant Servers
.
.
.
.
.
With the introduction of dual-peer PCI (Peripheral Component Interconnect) bus
.
.
.
architecture, Compaq recommends balancing the load between the two PCI buses to
.
.
.
.
achieve opt i ma l performance on t h e s er ver .
.
.
.
.
This white paper identifies the importance of PCI Bus Balancing and provides technical
.
.
.
configurations for achieving high performance and availability on bridged PCI buses
.
.
.
.
and dual-peer PCI bus architectures.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Additional Resources include:
.
.
.
.
PCI Bus Numbering in a Microsoft Windows NT
.
.
.
February, 1998 – Doc ID ECG024/0298.
.
.
.
.
.
Configuring the Compaq
.
.
.
July 1997 – Doc ID 679A/0697.
.
.
.
.
.
Implementing Online Storage Controller Recovery Option Under Windows NT
.
.
.
1997 - Doc ID ECG066A/0797.
.
.
.
.
.
Compaq Advanced Network Error Correction Support using PCI Hot Plug with
.
.
.
Microsoft Windows NT
.
.
.
.
.
Compaq Advanced Network Error Correction Support in a Microsoft
.
.
.
Windows NT
.
.
.
.
Advanced Network Fault Detection and Correction Feature for NetWare
.
.
.
.
Part Number 385A/0696.
.
.
.
.
.
.
.
.
.
Help us impr ove our technical communic ation. Let us know what you think about the
.
.
.
technical information in this docum ent. Your feedback i s valuable and will help us
.
.
.
structure future communications. Please send your comments to: CompaqNT@compaq.com
.
.
1
Server Environment, June 1996 – Part Number 353A/0696.
ProLiant 5000 Server for Peak Performance, Fourth Edition,
, August 1997 – Doc ID ECG057/0897.
Environment, First Edition,
, July
, June 1996 –
WHITE PAPER (cont.)
.
.
.
.
NOTICE
.
.
.
.
.
The information in this publication is subject to change without notice.
.
.
.
.
.
.
.
OMPAQ COM PUTER CORPORATION SHALL NOT BE LIABLE FOR TECHNICAL
C
.
.
.
OR EDITORIAL ERRORS OR OMISSIONS CONTAINED HEREIN
.
.
INCIDENTAL OR CONSEQUENTIAL DAMAGES RESULTING FROM THE
.
.
.
FURNISHING
.
.
.
.
This publication does not constitute an endorsement of the product or products that were tested.
.
.
.
The configuration or configurations tested or described may or may not be the only available
.
.
.
solution. This test is not a determination of product quality or correctness, nor does it ensure
.
.
.
compliance with any federal, state or local requirements. Compaq does not warrant products
.
.
.
other than its own strictly as stated in Compaq product warranties.
.
.
.
.
.
Product names mentioned herein may be trademarks and/or registered trademarks of their
.
.
.
respective companies.
.
.
.
.
Compaq, Contura, Deskpro, Fastar t, Compaq Insight Manager, LTE, PageMar q, Systempro,
.
.
.
Systempro/LT, ProLiant, TwinTray, ROMPaq, LicensePa q, QVision, SLT, ProLinea, SmartStart,
.
.
.
NetFlex, DirectPlus, QuickFind, RemotePaq, BackPaq, TechPaq, SpeedPaq, QuickBack, PaqFax,
.
.
.
Presario, SilentCool, CompaqCare (design), Aero, SmartStation, MiniStation, and PaqRap,
.
.
.
registered United States Patent and Trademark Office.
.
.
.
.
Netelligent, Armada, Cruiser, Concerto, QuickChoice, ProSignia, Systempro/XL, Net1, LTE
.
.
.
Elite, Vocalyst, PageMate, SoftPaq, FirstPaq, SolutionPaq, EasyPoint, EZ Help, MaxLight,
.
.
.
MultiLock, QuickBlank, QuickLock, UltraView, Innovate logo, Wonder Tools logo in black/white
.
.
.
and color, and Compaq PC Card Solution logo are trademarks and/or service marks of Compaq
.
.
.
Computer Corporation.
.
.
.
.
Other product names mentioned herein may be trademarks and/or registered trademarks of their
.
.
.
respective companies.
.
.
.
.
.
Copyright ©1998 Compaq Computer Corporation. All rights reserved. Printed in the U.S.A.
.
.
.
.
Microsoft, Windows, Windows NT, Windows NT Server and Workstation, Microsoft SQL Server
.
.
.
for Windows NT are trademarks and/or registered trademarks of Microsoft Corporation.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
PCI Bus Balancing and Optimization on Compaq
.
.
.
.
ProLiant Servers
.
.
.
First Edition (March 1998)
.
.
Document Number: ECG073/0398
.
.
.
.
.
, PERFORMANCE, OR USE OF THIS MATERIAL.
, NOR FOR
ECG073/0398
2
NOTE: Table 1 lists the
Compaq Pr oLiant fami ly of
servers that embody the
dual-peer P C I bus architecture.
NOTE: Table 1 lists the
Compaq Pr oLiant fami ly of
servers that embody the bridged
PCI bus ar chitecture.
WHITE PAPER (cont.)
.
.
.
.
.
EXECUTIVE SUMMARY
.
.
.
.
With the in t roduction of the Compaq ProLiant 5000 Server and its dual-peer PCI (Peripher a l
.
.
.
Component Interconnect) bus architecture, Compaq recommended certain configurations to
.
.
.
balance the load between the two PCI buses and achieve optimal performance on the server.
.
.
.
Customers now question what load balancing means, how it affects server performance and what
.
.
.
to consider for future planning and implementation of PCI bus loading.
.
.
.
.
This white paper identifies the overall importance of PCI bus balancing and provides technical
.
.
.
configurations for achieving high performance and availability on bridged and dual-peer PCI bus
.
.
.
architectures. The supporting facts presented along with recommendations will assist system
.
.
.
administrators and network operators in attaining and maintain in g th is goal.
.
.
.
.
.
.
.
PCI ARCHITECTURE
.
.
.
.
.
Two basic architectures are used to connect the primary and secondary PCI bus to the host bus:
.
.
the dual-peer PCI bus or the bridged PCI bus. The dual-peer bus architecture, as shown in
.
.
.
Figure 1, provides two PCI buses independently linked to the host processor bus by means of two
.
.
.
Host-to-PCI Bridges. Since each PCI bus runs independently, it is possible to have two PCI bus
.
.
.
masters transferring data simultaneously thus producing more overall throughput. This is an
.
.
.
advantage with systems that have two or more high-bandwidth peripherals. Splitting these
.
.
.
peripherals between the two buses provides an uniformed load.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Processors
Slots
Figure 1: Dual-peer PCI architecture.
The bridged PCI architecture, as shown in Figure 2, requires all processed transactions on the
bridged PCI bus (the secondary bus) to go through the PCI-to-PCI Bridge to reach the primary
bus, then through the Host-to-PCI Bridge. In effect there is only one path to the host bus;
therefore, no load balancing is required on a system with this type of architecture.
133 MB/s 133 MB/s
Secon dary PCI Bus
Bridge
Host Bus
Host Bus
540 MB/s
Host-
Host-
to-PCI
to-PCI
PCI-to-EISA
Bridge
Primary PCI Bus
Bridge
33 MB/s
EISA Bus
Memory
Slots
Slots
ECG073/0398
3
WHITE PAPER (cont.)
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Processors Memory
Figure 2: Bridged PCI architecture.
Knowing what PCI bus specific slots are assigned can be difficult to determine; therefore, Table 1
lists the slots for Compaq PCI bridged and dual-peer PCI servers and which bus they populate.
Use this matrix to identify which slot is assigned to the primary or secondary bus.
For any servers not listed, refer to the server user guide for the slot information or the Compaq
and Microsoft Windows NT Frontline Partnership web site located at:
http://www.compaq.com/solutions/frontline/pciutils.html.
TABLE 1: PCI BUS TO SLOT NUMBER ASSIGNMENTS
Slot
Bridged PCI
Number
Bus Systems
ProLiant 2500 ProLiant 1200 ProLiant 1600
1 Secondary Secondary Secondary Primary Primary
2 Secondary Secondary Secondary Primary Secondary Primary
3 Secondary Secondary Secondary Primary Secondary Primary Secondary
4 Primary Primary Primary Primary Secondary Primary Secondary
5 Primary Primary Primary Secondary Primary Primary Secondary
6 Primary Primary Primary Secondary Primary Primary Secondary
7 Secondary Primary Secondary Secondary
8 Secondary Primary Secondary Secondary
9 Secondary
10 Secondary
11 Secondary
Host Bus
Host-to-PCI
Bridge
133 MB/s
PCI-to-PCI
Bridge
PCI Bus
PCI Bus
133 MB/s
Dual-Peer PCI Bus Systems
ProLiant 3000/
ProLiant 5500 ProLiant 5000
Slots
Slots
ProLiant 6000/
ProLiant 7000
ProLiant 6500
ECG073/0398
4
Loading...