HP Hewlett Packard Server 643063 001 User Manual

HP ProLiant DL580 G7server technology  
Technology brief  
Introduction......................................................................................................................................... 2  
Environments for the DL580 G7............................................................................................................. 3  
Operating systems and Virtualization software ........................................................................................ 3  
Comparison between the DL580 G7 and DL580 G5 servers .................................................................... 3  
HP servers and balanced architecture..................................................................................................... 5  
DL580 G7 architecture......................................................................................................................... 5  
Hemisphere mode............................................................................................................................ 8  
Increasing memory performance ...................................................................................................... 10  
Memory RAS ................................................................................................................................. 11  
I/O technologies ............................................................................................................................... 15  
Smart Array P410i controller........................................................................................................... 17  
Serial Attached SCSI ...................................................................................................................... 19  
SAS and SATA Small Form Factor hard drives................................................................................... 19  
Networking technologies.................................................................................................................... 19  
Network Adapter Teaming.............................................................................................................. 19  
Jumbo Frames................................................................................................................................ 20  
Server management technologies ........................................................................................................ 20  
HP Insight Control .......................................................................................................................... 20  
HP Integrated Lights-Out 3 (iLO 3).................................................................................................... 20  
HP Power Regulator ........................................................................................................................... 21  
HP Dynamic Power Capping............................................................................................................... 21  
Conclusion........................................................................................................................................ 22  
For more information.......................................................................................................................... 23  
Call to action .................................................................................................................................... 24  
 
The DL580 G7 uses HP’s leading “Sea of Sensors” technology to track and manage the temperature and health of  
both individual subsystems and field-replaceable units (FRU). At a reduced level of power and noise, a set of four  
redundant (3+1) fans run efficiently and cool the DL580 G7 reliably.  
The reliability, serviceability, and manageability features in the server have improved with the development of  
components, interconnect fault tolerance, structured design and validation as well as the renewed ProLiant iLO3  
system management processor.  
In the server chassis, the eight front-serviceable small form factor (SFF) drive bays offer a low-latency solution for hot-  
plug RAID disk drives and solid-state drives. The support for external drives gives you additional storage capacity  
for direct-attached, network-attached, or SAN-attached solutions.  
Environments for the DL580 G7  
The DL580 G7 is ideal for the following environments:  
Server Consolidation and Virtualization–Within a virtual environment, the DL580 G7’s high-bandwidth and large  
memory footprint speed the execution of multiple applications.  
Large Enterprise Database–The server’s multiple processor cores provide the performance necessary for mining  
large databases for information. (The closer the memory’s database to the processor, the shorter is the time to  
access the data.)  
Virtual Desktop Infrastructure (VDI)–The DL580 G7’s large memory footprint efficiently utilizes VDI thin clients.  
(Each client requires approximately 4 GB of memory.) The server’s high I/O capacity allows many VDI clients to  
move a large amount of small data packet traffic.  
Web Hosting–The DL580 G7’s memory footprint optimally meets the memory requirements and demands of web-  
hosted applications.  
High Performance Numeric Computing– The DL580 G7 easily handles the high I/O bandwidth requirements of  
these applications through its support of up to three double-wide x16 General- Purpose Computing on Graphics  
Processing Units (GPGPUs). The GPGPUs offload repetitive floating-point applications (numeric computing  
intensive, high precision arithmetic). GPGPUs have a 10x floating point advantage over processors.  
Operating systems and Virtualization software  
The HP ProLiant DL580 G7 supports the following operating systems and virtualization software:  
Microsoft Windows Server  
Red Hat Enterprise Linux (RHEL)  
SUSE Linux Enterprise Server (SLES)  
Oracle Solaris  
VMware  
Citrix XenServer  
For more information on HP's Certified and Supported ProLiant Servers for OS and Virtualization Software and for  
the latest listing of software drivers available for your server, see our Support Matrix at www.hp.com/go/ossupport  
Comparison between the DL580 G7 and DL580 G5 servers  
The DL580 G7 offers multiple enhancements:  
Processors—With the introduction of the new Intel® Xeon® Processor E7 series, the DL580 G7 supports up to 40  
cores and 80 hyperthreads (10 cores/20 threads and 30MB shared cache per processor). This allows for  
3
 
better performance of multithreaded applications and more resources for virtual machines. The Intel® Xeon®  
Processor 7500 series support up to 8 cores (16 hyperthreads) per processor.  
Memory—With the support for a new Memory Cartridge and 32 GB DDR3 DIMM, the DL580 G7 supports 2TB  
of memory capacity. In addition, by supporting low-voltage DIMMs, the DL580 G7 reduces power consumption  
when compared with previous generations.  
Expansion Slots—The DL580 G7 features PCI Express Gen 2.0. This achieves twice the bandwidth when  
compared to PCI-Express 1.1 in G5. The DL580 G7 supports up to (11) I/O slots with dual IOH. It also  
supports up to three 300 W Graphic Cards and GPGPUs. The DL580 G7 features a modular I/O subsystem  
(base I/O feature set plus an I/O expansion module) for more choices in configuration. The DL580 G7  
standard configuration is five PCI-Express I/O slots. Upgrade the server with the optional 6-slot PCI-Express or  
PCI-X modules for a maximum number of 11 slots.  
Storage Controller—The DL580 G7 has an integrated Smart Array P410i storage controller and comes standard  
with Flash-Backed Write Cache (FBWC), eliminating the worries of losing data with loss of battery power.  
Network Controller—The DL580 G7 provides two more embedded 1-gigabyte (GbE) Ethernet NIC ports for a  
total of four. An optional NC524SFP module will upgrade two of the ports to 10 GbE without requiring the use  
of an I/O slot.  
Redundancy—The DL580 G7 supports up to four hot-plug fans and up to four 1200W 94% efficient, common-slot  
power supplies. The DL580 G7 offers memory redundancy through memory mirroring, sparing, ECC, Single  
Device Data Correction (SDDC), and Double Device Data Correction (DDDC).  
Table 1 presents the DL580 G7major enhancements.  
Table 1. DL580 G5 and G7 components have significant differences.  
Component  
DL 580 G7  
DL 580 G5  
Chipset  
Intel® 7500 Chip set with high-  
speed interconnects at 6.4GT/s  
Industry Standard Intel® 7300  
Chip set with four high-speed  
interconnects at 1066 MT/s  
Processors  
Memory  
Intel® Xeon® processor E7 series; Intel Xeon 7300, 7400 series  
Up (10 cores/20 threads per  
CPU); the Intel Xeon 7500 series,  
supports up to 8 cores  
64 Sockets, DDR3 up to 1066  
MT/s 2TB max.  
32 Sockets, DDR2 667 MT/s 256  
GB max.  
New (E7) Memory Cartridge, LV  
DIMMs ; Intel® 7500 Scalable  
Memory Buffer  
Storage Controller  
HP Smart Array P410i Controller  
HP Smart Array P400i/256 MB  
Controller  
HP Smart Array P400i/512 MB  
BBWC Controller  
Internal Drive Support  
Network Controller  
8 SFF SAS/SATA/SSD  
16 SFF SAS/SATA  
NC375i Quad Port GbE  
Multifunction NIC; optional Dual  
Port 10 GB E upgrade  
Two embedded NC373i  
Multifunction Gigabit Network  
Adapters  
Expansion Slots  
Up to 11 FL/FH I/O slots  
Base  
4
 
Base :  
4 PCI-E 1.1 x8, 4 PCI-E 1.1 x4  
Optional Mezzanines  
3 PCI-X 100MHz  
2 PCI-E 2.0 x16, 3 PCI-E 2.0 x8  
Optional Mezzanines  
Option 1: 2 PCI-E 2.0 x16, 4 PCI- 3 PCI-E 1.1 x8  
E 2.0 x8  
Up to 11 slots supported; slots 9-  
Option 2: 1 PCI-E 2.0 x16, 2 PCI- 11 low profile**  
E 2.0 x8, 1 PCI-E 2.0 x4, 2 PCI-X  
USB Ports  
Front: USB (2)  
Rear: USB (2)  
Internal: USB (1)/ SD slot (1)  
Front: USB (2)  
Rear: USB (2)  
Internal: USB (1)  
Redundancy  
Fan: Hot-Plug, N+1 redundant  
fans  
Fans: (6) Hot-Plug redundant  
fans  
Power: Up to (4) x 1200W 94%  
efficient, common slot; optional  
Power: (2) or four depending on  
the model  
Management  
ProLiant Onboard Administrator  
featuring the HP Integrated Lights-  
Out 3 (iLO 3)  
Integrated Lights Out 2  
HP servers and balanced architecture  
HP servers achieve a balanced architecture through superior engineering of fundamental elements. These elements  
include mechanical infrastructure, power, cooling, processor, and memory as well as I/O devices, storage,  
boot, networking, and interconnecting components. A balanced architecture involves:  
Compute capability based on processor core count, cache size per processor, and processor socket count  
Low-latency processor-to-memory bandwidth, commensurate with this compute capability  
Memory footprint that maximizes bandwidth and capacity with power-efficiency and performance without  
compromising quality or reliability  
Application-appropriate I/O devices  
Closely-coupled and balanced processor-to-memory and processor-to-I/O ratios  
Mechanical design that ensures optimum levels of cooling, stability, and serviceability through space-efficient and  
modular partitioning  
By designing a balanced architecture, HP ensures that all subsystems perform effectively under a broad range of  
applications and workloads.  
For example, a virtual machine (VM) benefits from memory, coupled to the processor responsible for that VM. In  
addition, a server needs to have appropriate levels of I/O bandwidth and CPU capabilities to ensure that every VM  
has the resources it needs.  
DL580 G7 architecture  
The DL580 G7 is a powerful, 4U enterprise server incorporating technologies that extends the capabilities of  
industry-standard x86 computing. This high-performance server can run both 32-bit and 64-bit applications  
simultaneously. There is no performance penalty when the server uses an operating system that supports 64-bit  
extensions.  
The server’s architecture includes the following essential features:  
The new Intel Xeon Processor E7 series allows the DL580 G7 to support up to 40 cores and 80 hyperthreads  
(10 cores/20 threads and 30MB shared cache per processor. This design allows for improved performance of  
5
 
multithreaded applications and provides more resources for virtual machines. The Xeon 7500 series processor  
supports up to eight cores (16 hyperthreads) per processor.  
The Intel 7500 chipset  
Up to 2.0TB (32 GB DDR3 DIMMs) with a new (E7) Memory Cartridge  
Five PCIe 2.0 slots are standard, with the choice of adding one of two optional Mezzanine modules. One option  
provides PCI-X slots; the other option provides additional PCIe slots.  
NC375i Quad Port GbE Multifunction NIC; optional Dual Port 10 GbE upgrade  
HP Integrated Lights-Out 3 management (iLO 3)  
The DL580 G7 uses the next generation Intel Xeon Processor E7 and 7500 series processor. Its architecture departs  
radically from Intel processors based on front-side bus architecture. The front-side bus uses an embedded memory  
controller to produce a common share point for memory access to all processors.  
The next-generation Xeon processors use NUMA (Non-Uniform Memory Access) architecture that incorporates  
QuickPath Interconnect (QPI) links for point-to-point connectivity between the server’s four processors, providing  
dedicated, local memory for each processor. This new architecture includes a memory buffer for each scalable  
memory interfaces (SMI) in its memory subsystem, allowing for enhanced memory expansion. As a result, the DL580  
G7 server offers over twelve times the memory bandwidth of the previous-generation Intel Xeon 7400 platforms and  
eight times the memory footprint (2TB with 64 x 32 GB DDR3 DIMMs).  
The combination of enhanced processor cores, more cores, more memory controllers, higher-speed memory and I’O  
interconnect, higher memory footprint produce dramatic level of performance, posting the highest-ever jump from a  
previous generation processor.  
The DL580 G7’s new architecture adds new reliability, availability and serviceability (RAS) features traditionally  
found in the Intel Itanium processor family. An example is the architecture for HP Memory Quarantine. Intel’s  
Machine Check Recovery (MCA Recovery) is the basis of HP Memory Quarantine.  
Intel’s processor advantages include:  
Built on Intel's 45nm (7500 series) and 32nm (E7 series) High-K Metal Gate technology process  
Up to 10 and 8 cores per processor  
Up to 40 threads per processor with Intel Hyper-Threading Technology  
QuickPath architecture with four high-bandwidth links  
Up to 30MB of shared cache per processor  
Integrated memory controllers  
Intel Turbo Boost Technology  
Intel scalable memory buffer (SMB) and scalable memory interconnects (SMI)  
Up to 6.4 the memory bandwidth of previous generation  
Advanced RAS capabilities  
2.3 billion transistors  
6
 
Figure 2. HP ProLiant DL580 G7 architecture  
7
 
Memory Subsystem Architecture  
The HP ProLiant DL580 G7 provides a 2TB memory footprint and supports up to 64 DDR3 RDIMMs. Each of the  
server’s four processors receives 16 RDIMM sockets in two easily serviceable memory cartridges. The DL580 G7  
supports 2, 4, 8, 16, and 32GB RDIMMs.  
The server incorporates four processors. Each processor contains two memory controllers as shown above in Figure  
2. Each memory controller has two Scalable Memory Interface (SMI) links operating in lockstep. Each SMI link  
connects to a scalable memory buffer (SMB). The SMB converts SMI to DDR3 and expands memory capacity of the  
system. Each SMB supports two DDR3 channels, and each DDR3 channel can support up to two DIMMs for eight  
DIMMs per memory cartridge, 16 DIMMs per processor, and 64 DIMMs per system.  
The new Intel Xeon Processor E7 and 7500 series memory architecture take advantage of multiple stages of memory  
interleaving to reduce the perceived latency and increase throughput.  
The scalable memory buffer (SMB) prevents the varying number of installed DIMMs (or their electrical loads) from  
affecting the processor’s memory speed. The DL580 G7 runs all DIMMs at the highest possible speed that a given  
processor supports.  
The DDR3 memory speed is a function of the QPI bus speed supported by the processor. For example, processors  
with a QPI speed of 6.4 GT/s run memory at 1066 MT/s. Processors with a QPI speed of 5.6 GT/s run memory at  
978 MT/s, and processors with a QPI speed of 4.8 GT/s run memory at 800 MT/s.  
Hemisphere mode  
The memory architecture for the Intel Xeon Processor E7 utilizing the 7500 Series chipset design includes a high-  
performance interleaving technology called Hemisphere mode (see Figure 3.) It combines the tracking resources of  
both memory controllers within each processor to speed the movement of data along a cache-line by a process  
called pipelining.  
To utilize Hemisphere mode, the system processors must have identical DIMM populations behind both of their  
memory controllers. To enable each processor to enter the Hemisphere mode, you must install and populate both  
DIMM memory cartridges with identical memory capacities based on the DIMM installation guidelines.  
Hemisphere mode produces the best overall performance for many applications. You can disable Hemisphere mode  
if it produces lower performance for a particular application (for example, an RBSU option).  
You can obtain better performance when populating all cartridges with either four or eight dual- or quad-rank  
DIMMs. (The server does not support memory mirroring when it enables Hemisphere mode.)  
Figure 3 below shows six examples of Hemisphere vs. Non-Hemisphere populations.  
8
 
Figure 3: Hemisphere vs. Non-Hemisphere populations  
9
 
The above Non-Hemisphere Example 5 and Example 6 illustrate:  
Each memory controller must have a memory cartridge  
DIMM configurations of each memory cartridge connected to controller 1 and 2 of a processor must be identical.  
Note that “Example 4” is a Hemisphere configuration. The two cartridges connected to each processor share  
identical configurations, but Cartridge 1 and Cartridge 2 are not identical to Cartridge 3 and Cartridge 4.  
Increasing memory performance  
For improved performance, successive cache lines interleave between the DIMMs and the lockstep SMI channels of  
the processor’s two memory controllers. This alternate-layer arrangement of cache lines boosts performance by  
allowing adjacent cache lines to reside on different memory controllers, different SMIs, different DIMMs, and DIMM  
ranks. SMI channel DIMMs are evenly populated. If a given SMI channel pair has more DIMMs than other  
channels, the extra memory will not receive the benefit of the interleaving mechanism.  
Achieving optimum performance  
The DL580 G7 supports 64 DIMMs slots across four multi-core processors. While there are multiple DIMM  
population configurations that may support the desired total memory size, you can only achieve optimal  
performance when populating DIMMs that can take advantage of the Intel Xeon Processor E7 and 7500 series  
architecture.  
The Hemisphere Population Diagram (Figure 3) displays how to achieve the best performance for a given memory  
and processor configuration. Follow these rules:  
Use both memory controllers inside the processor and populate two memory cartridges for each installed  
processor. This is the top contributor to memory bandwidth performance.  
10  
 
Populate each DDR3 channel in each memory cartridge. To achieve this, the minimum DIMM count per cartridge  
is four DIMMs installed in DIMM pair locations A and B. This is the second largest contributor to performance.  
Use dual-rank DIMMs for significantly better performance than that of single-rank DIMMs. Quad-rank DIMMs  
provide a greater performance boost. The number of ranks per DIMMs is the third largest contributor to  
performance.  
Use all installed processors in Hemisphere mode for the best performance. Installation of four or eight DIMMs per  
cartridge optimizes Hemisphere mode. You achieve maximum throughput when you populate each memory  
cartridge with eight quad-rank DIMMs.  
Memory RAS  
Advanced ECC (Error Checking and Correcting) is the default memory RAS option for the DL580 G7. ECC gives  
you the greatest memory capacity for a given DIMM size. To enhance availability, the server supports the following  
Advanced Memory Protection (AMP) modes:  
Online Sparing provides protection against persistent DRAM failure. Rank sparing is more efficient than DIMM-  
sparing because it sets aside only a portion of a DIMM for memory protection.  
Mirrored Memory provides optimum protection against failed DIMMs. If one DIMM in a processor’s memory  
cartridge experiences an uncorrectable error, the DIMM in the processor’s mirrored cartridge can provide the  
correct data.  
Double-Device Data Correction (DDDC) provides the capability to withstand failures in two x4 DRAM devices.  
DDDC can fix both single-and double-DRAM device memory errors.  
Advanced ECC memory  
Advanced ECC memory is the default memory mode for the DL580 G7. It supports up to 2TB of active memory,  
utilizing 32GB DIMMs.  
Advanced ECC memory can correct single-bit memory errors and multi-bit memory errors on a single x8 or two  
adjacent x4 DRAM devices.  
The DL580 G7 provides notification when correctable errors exceed a predefined threshold. When Advanced ECC  
detects uncorrectable errors, the server notifies the user and shuts down the operating system.  
Double Devide Data Correction  
The DL580 G7 offers DDDC with the Intel Xeon Processor E7 series. DDDC produces significantly less system  
downtime over SDDC. It can tolerate soft and hard errors encountered in up to two x4 DRAM devices within any  
DIMM pair. Tolerating memory faults greatly extends system up-time.  
Using two DIMMs in a pair group, 16 check bits are available to the error correcting algorithm to protect 128 data  
bits (16 bytes) of data. By reserving one x4 DRAM device in each rank as a spare, the DDDC algorithm assures  
data availability after hard failures occur within any two x4 DRAM devices.  
The DDDC algorithm protects against double-device failure of x4 DIMMs. DDDC is disabled if the memory  
configuration includes a mix of x4 and x8 DIMMs. This scenario will engage SDDC (single-device data correct).  
Enabling Memory Mirroring will disable DDDC.  
In DDDC mode, DL580 G7 provides the full memory bandwidth and capacity that is available in the system. There  
is no capacity or bandwidth overhead associated with enabling DDDC.  
Online spare memory—rank sparing  
Online spare memory, or rank-sparing, protects against persistent DRAM failure. Online spare memory monitors  
DIMMs for excessively frequent correctable errors. It copies the content of an unhealthy rank to an available spare  
rank in advance of multi-bit or persistent single-bit failures. Rank-sparing is more efficient than DIMM-sparing  
because only a portion of a DIMM is set aside for memory protection.  
11  
 
When the system enables online sparing, the first ranked DIMM pair of 1A/8A are set aside as the sparing ranks,  
reducing available memory. If a DIMM rank on either of the SMI buses exceeds its correctable ECC threshold, the  
contents of the failing DIMM ranks go to the spare DIMM ranks. Once the copy is complete, all memory accesses to  
the previous failing DIMM ranks go to the spare DIMM ranks.  
During normal operation, there is no performance penalty for rank-sparing. Upon detection of a frequent error, the  
performance impact occurs only during the time it takes to copy the data from the failing rank to the spare rank.  
Lockstep memory mode  
As Figure 4 below and Table 1 below both illustrate, each memory controller has two scalable memory interfaces  
(SMI). Each SMI connects to one scalable memory buffer (SMB) and couples with two DDR3 buses. Each DDR3 bus  
runs in lockstep with its DIMM pair of the other SMB. Running DIMM pairs in lockstep provides for wider error  
detection and correction coverage. Through lockstep operation, the memory subsystem of the DL580 G7 server can  
tolerate a x4 or a x8 DRAM device failure.  
Lockstep memory mode uses two SMI links to produce a higher level of fault tolerance than the normal 64+8 bit  
ECC. In lockstep mode, two channels operate as a single channel to form 16 redundant bits for each 128 data bits.  
Each write and read operation moves a 144 data word. A 64-byte cache line splits across 2 DDR3 buses with a  
burst length of 4. The split lines provide 2x 8-bit error detection and 8-bit error correction for a single x4 or x8  
DRAM within a DIMM pair.  
Using DIMM Isolation, the DL580 G7 detects and corrects errors associated with failing DIMMs that have crossed a  
correctable error threshold. It detects and corrects DIMM errors caused by single x4 or x8 DRAM device failure. The  
DL580 G7 identifies the individual DIMM associated with correctable errors. It also identifies the DIMM pair  
associated with a failed DRAM device (detected and corrected) or with non-correctable errors (detected and  
uncorrected).Mirrored memory  
Memory Sparing cannot correct errors that evade correction by the ECC or SDDC. By providing added redundancy  
in the memory subsystem, Memory Mirroring delivers the greatest protection against memory failure beyond ECC,  
SDDC, and Memory Sparing.  
In the mirrored mode, each lockstep DIMM pair in a memory controller has a mirrored DIMM pair on the other  
memory cartridge.  
After the DL580 G7 detects an uncorrectable memory error from a DIMM pair of a memory cartridge, the server  
avoids a system crash by reading the mirrored DIMM pairs from the other memory cartridge. In this case, the system  
management disables the failed DIMM. Later memory reads and writes will occur only on the mirrored DIMM pairs.  
Note that in Memory Mirroring mode, useable memory capacity is half of the available memory, and the perceived  
available memory bandwidth is about half of available memory bandwidth.  
For population guidelines, see the DL 580 G7 User Guide at  
Figure 4 displays the server’s memory expansion architecture.  
12  
 
Figure 4. DL580 G7 memory expansion boards  
DL580 G7 Memory Boards  
(Front of Chassis)  
DIMM  
Board 1  
DIMM  
Board 2  
Processor 1  
Processor 2  
Processor 3  
Processor 4  
DDR3 RDIMM  
DDR3 RDIMM  
DDR3 RDIMM  
DDR3 RDIMM  
Voltage  
Regulators  
(VRDs)  
DDR  
DDR  
DDR3 RDIMM  
DDR3 RDIMM  
DDR3 RDIMM  
DDR3 RDIMM  
PCIe Type Connector  
13  
 
In memory expansion architecture, each processor has two embedded memory controllers. Each memory controller  
controls two high-speed scalable memory interfaces (SMI). Each SMI link expands to two DDR3 buses via a scalable  
memory buffer (SMB). Each memory controller runs its two SMI links in lockstep. Memory expansion architecture  
furnishes a level of fault tolerance to sustain the failure of any DRAM device within any pair of lockstep DIMMs.  
This memory subsystem design supplies enhanced performance in Advanced ECC mode. Additional memory  
protection comes through online spare, mirrored memory and DDDC modes.  
The DL580 G7 Advanced ECC supports up to 2TB of active memory utilizing 32 GB DDR3 RDIMMs. The server  
provides notification if the level of correctable errors exceeds a pre-defined threshold. Standard ECC can only  
correct single-bit memory errors. Advanced ECC corrects any single-bit and multi-bit memory error associated with a  
single DRAM device (SDDC).  
Online spare memory gives additional protection against degrading DIMMs. For example, rank sparing allows the  
allocation of a rank in a DIMM as the online spare memory for a collection of two DIMMs. If one of the non-spare  
DIMMs exceeds a threshold for correctable memory errors, the server automatically copies the contents of the  
degraded memory to the online spare rank. Then the server deactivates the failing memory rank, and automatically  
switches over to the online spare rank. This reduces the likelihood of uncorrectable memory errors, which could  
result in server downtime. Online spare memory protection is available without any operating system support.  
Mirrored memory protects against failed DIMMs. It supports up to 1 TB of active memory and 1 TB of mirrored  
memory using 32-GB DIMMs. Within each processor, mirroring occurs on the memory controller level. Note that  
each memory controller supports two SMI links. When two memory controllers mirror each other, DIMM pairs  
associated with each memory controller maintain a copy of all memory contents. Memory writes go to DIMM pairs  
of both memory controllers. Memory reads come from only one set of DIMM pairs of the two memory controllers,  
unless an uncorrectable error occurs. If a memory read on one DIMM pair returns incorrect data due to an  
uncorrectable memory error, the system automatically retrieves the correct data from the mirrored DIMM pair.  
Systems do not lose mirroring protection because of transient and soft uncorrectable errors and maintain mirroring  
protection unless memory in both DIMM pairs fail.  
14  
 
I/O technologies  
The DL580 G7 supports up to eleven I/O full length, full height expansion slots with the available option cards  
installed. The standard configuration includes five slots, 2 PCIe x8 2.0 and 3 PCIe x4 2.0. Two optional cards are  
available:  
Option No. 1, Standard PCIe  
1 PCIe 2.0 x4, 1 PCIe 1.0 x4 and 4PCIe 2.0 x8  
Option No. 2, Combination PCI—X, PCIe and 300W GPU  
2 PCI-X 64 bit, 1PCIe 2.0 X4, 2PCIe 2.0 X16  
PCIe 2.0 (Gen 2) is an expansion bus technology that arises from earlier PCI and PCIe technologies. The server uses  
a serial interface running at 5 Gb/s. A PCIe interface supports one or more lanes, as determined by the PCIe slot.  
Multiple-lane connections are x4 for a 4-lane link, x8 for an 8-lane link, and x16 for a 16-lane link.  
Each PCIe 2.0 lane consists of four wires for a differential pair of transmit-and-receive signals. Each runs serially at  
5 Gb/s with an 8b10b encoding (10-bit symbols to represent 8 data bits). Each PCIe 2.0 lane has a bandwidth of  
512 MB/s in each direction (for a total bandwidth of 1 GB/s per lane).  
The end ports of PCIe links automatically negotiate the highest bit rate and the highest number of lanes that the slot  
and the add-in card support. A PCIe expansion card can run correctly in any slot it will fit.  
With enormous aggregate IO bandwidth, the DL580 G7 supports concurrent operation of all 11 slots. The server  
offers the support for dual- and triple-slot, high-powered PCIe add-in cards. With unencumbered bandwidth to the  
host memory, such 200W and 300W add-in boards may perform high-performance computations demanded by  
vector processors and IO accelerators.  
15  
 
Refer above to the Figure 2 block diagram for details and below to Tables 1, 2 and 3 for slot assignments.  
Table 1. Main I/O Board Standard Expansion Slots  
NOTE: Up to 11 slots supported; all full-length-full-height. Standard: 2 PCI-E 2.0 x8, 3 PCI-E 2.0 x4.  
Expansion Slot  
#
Connector  
Width*  
Bus / Dev  
Number**  
Technology  
Width  
Form Factor  
Notes  
1
2
3
4
5
6
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
N/A  
PCI Express  
Gen2  
7
8
x4  
x4  
x8  
x4  
x8  
x8  
x8  
0/0A  
0/09  
0/07  
0/01  
0/05  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
PCI Express  
Gen2  
PCI Express  
Gen2  
9
x16  
x8  
PCI Express  
Gen2  
10  
11  
PCI Express  
Gen2  
x16  
* Default bus assignment. Inserting cards with PCI bridges may alter the actual bus assignment number.  
** Slots enumerated differently based on OS. MS OS's enumerate from lowest to highest Device ID by  
bus (starting with the lowest bus).  
FL= Full length; FH = Full height; LP = low profile.  
Table 2. Expansion Slots With I/O Expander (combination PCI-X, PCI-e and 300W GPU  
Expansion Slot  
#
Connector  
Width*  
Bus / Dev  
Number**  
Technology  
Width  
Form Factor  
Notes  
1
2
PCI-X  
PCI-X  
64-bit  
64-bit  
N/A  
N/A  
82/01  
82/02  
FH/FL  
FH/FL  
100MHz  
100MHz  
PCI Express  
Gen2  
3
x16  
x16  
80/07  
FH/FL  
PCI Express  
Gen2  
4
5
6
x4  
x8  
80/01  
N/A  
FH/FL  
N/A  
N/A  
N/A  
x16  
N/A  
x16  
N/A  
PCI Express  
Gen2  
80/03  
FH/FL  
PCI Express  
Gen2  
7
8
x4  
x4  
x8  
x4  
x8  
x8  
0/0A  
0/09  
0/07  
0/01  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
PCI Express  
Gen2  
PCI Express  
Gen2  
9
x16  
x8  
PCI Express  
Gen2  
10  
16  
 
PCI Express  
Gen2  
11  
x8  
x16  
0/05  
FH/FL  
* Default bus assignment. Inserting cards with PCI bridges may alter the actual bus assignment number.  
** Slots enumerated differently based on OS. MS OS's enumerate from lowest to highest Device ID by  
bus (starting with the lowest bus).  
FL= Full length; FH = Full height; LP = low profile.  
Table 3. Expansion Slots With I/O Expander (Standard PCI-e Option)  
Expansion Slot  
#
Connector  
Width*  
Bus / Dev  
Number**  
Technology  
Width  
Form Factor  
Notes  
PCI Express  
Gen1  
1
2
x4  
x8  
x8  
x4  
x8  
x8  
x4  
x4  
x8  
x4  
x8  
x8  
x16  
x16  
x8  
80/00  
80/09  
80/07  
80/01  
80/05  
80/03  
0/0A  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
FH/FL  
PCI Express  
Gen2  
PCI Express  
Gen2  
3
PCI Express  
Gen2  
4
PCI Express  
Gen2  
5
x16  
x16  
x8  
PCI Express  
Gen2  
6
PCI Express  
Gen2  
7
PCI Express  
Gen2  
8
x8  
0/09  
PCI Express  
Gen2  
9
x16  
x8  
0/07  
PCI Express  
Gen2  
10  
11  
0/01  
PCI Express  
Gen2  
x16  
0/05  
* Default bus assignment. Inserting cards with PCI bridges may alter the actual bus assignment number.  
** Slots enumerated differently based on OS. MS OS's enumerate from lowest to highest Device ID by  
bus (starting with the lowest bus).  
FL= Full length; FH = Full height; LP = low profile.  
Smart Array P410i controller  
The HP ProLiant DL580 G7 includes the Smart Array P410i controller. It is the HP PCI Express 2.0 (PCIe) Serial  
Attached SCSI RAID controller. The controller has eight ports and uses DDR2-800 memory. It is ideal for RAID 0/1,  
1+0, and 5+0. You can upgrade it with the 512 MB BBWC module and Smart Array Advanced through the license  
17  
 
key for RAID 6 and 6 +0. The SA-P410i supports up to eight drives and up to 4.8 TB of storage (8 x 600 GB HDD).  
It also supports tape storage.  
On the SA-P410i, a flash-backed write cache (FBWC) module comes standard with either 512 MB or1 GB,  
depending on the model. Battery-backed write cache (BBWC) modules are also available on factory-configured  
systems. In the event of a controller or server failure, you can remove the BBWC equipped Smart Array cache from  
the SA-P410i and place it on another SA-P410i controller board. The cached data will move to the disk drives.  
The following features support failure detection. They keep the server running and data available while you replace  
a failed drive: HP developed Monitoring Analysis and Reporting Technology to detect possible disk failure before it  
occurs.  
Drive Parameter Tracking monitors drives operational parameters, predicting failure and notifying the  
administrator.  
Dynamic Sector Repairing continually performs background surface scans on the disk drives during inactive  
periods and automatically remaps bad sectors, ensuring data integrity.  
RAID 6 with Advanced Data Guarding (ADG) allocates two sets of parity data across drives and allows  
simultaneous write operations. This level of fault tolerance can withstand two simultaneous drive failures without  
downtime or data loss.  
RAID 5 (Distributed Data Guarding) allocates one set of parity data across drives and allows simultaneous write  
operations. This level of fault tolerance can withstand a single drive failure without downtime or data loss.  
RAID 5+0 is a RAID 0 array striped across elements. It combines the straight block-level striping of RAID 0 with the  
distributed parity of RAID 5.  
RAID 1, 1+0 (Drive Mirroring) allocates half of the drive array to data and the other half to mirrored data,  
providing two copies of every file. It is a high-performance RAID.  
Smart Array Cache Tracking monitors integrity of controller cache, allowing pre-failure preventative maintenance.  
Recovery ROM protects from firmware image corruption by storing a redundant copy of the image. If the active  
image becomes corrupt, the controller will use the redundant image and continue operating.  
DRAM ECC detects and corrects data bit errors.  
Battery-Backed Write Cache upgrade supplies up to two days of battery power for data cache retention. You can  
extend the retention time during system power down when the server's auxiliary power is available.  
On-Line spares minimize downtime, reconstruct data, and facilitate a quick recovery from drive failure. You can  
install up to two spare drives before a drive failure. If a failure occurs, the recovery begins automatically with  
an On-Line Spare and data reconstructs.  
Online Drive Flashing is available on the SA-P410. With Online Drive Flashing, you can download an updated  
hard disk drive (HDD) firmware image to the controller and update all of your SAS HDDs the next time you reboot  
the server, greatly reducing the time involved in updating disk drive firmware.  
Mirror Splitting and recombining with the HP Smart Array Advanced Pack (SAAP) let you divide a RAID 1 array into  
two RAID 0 arrays and later combine the two RAID 0 arrays into a single RAID 1 array. The Array Configuration  
Utility (ACU) lets you combine any two RAID 0 arrays of the same size and select which drive keeps the data. This  
feature is only available offline. You must boot to the Smart Start CD and run ACU from there. Typically, you use  
this feature when testing out a software patch. You could split the mirror as a means to save the current data and  
then perform any type of destructive software update necessary, keeping the resulting data set or reverting back to  
the old data. BBWC is not required to enable this feature.  
Capacity expansion adds drives to a configured array. The logical drives (or volumes) that exist in an array before  
the expansion takes place remain unchanged, only the amount of free space in the array changes. BBWC is  
required for this feature.  
All Smart Array controllers use the same configuration utility and diagnostic software, Array Configuration Utility  
(ACU), and management software, HP Insight Manager. The SA-P410 also provides Option ROM Configuration for  
Arrays (ORCA) that allows a simplified configuration tool at the time of controller boot.  
18  
 
Serial Attached SCSI  
Serial Attached SCSI (SAS) leverages a common electrical and physical connection interface with Serial ATA  
(SATA). It supports logical SCSI compatibility along with SCSI reliability, performance and manageability. SAS  
provides investment protection in compatible SCSI software and middleware. It offers the choice of direct-attach  
storage devices (SAS or SATA). In addition, SAS allows greater performance, longer cabling distances, smaller  
form factors and greater addressability. All will lead to a new level of flexibility when deploying mainstream data  
center servers and subsystems. This compatibility gives you many choices for server and storage subsystem  
deployment, by leveraging the SATA development effort on smaller cable connectors. It gives customers a  
downstream compatibility with desktop-class ATA technologies.  
SAS and SATA Small Form Factor hard drives  
The SAS architecture enables system designs that deploy high-performance SAS and high-capacity SATA Small  
Form Factor (SFF) drives. This capability offers a broad range of storage solutions that give IT managers the  
flexibility to choose storage devices based on reliability, performance, and cost.  
SFF drives provide higher performance than large form factor drives. The smaller SFF platters reduce seek times  
because the heads have a shorter distance to travel. RAID performance improves by increasing the numbers of  
spindles.  
HP ships SATA drives with Drive Write Cache (DWC) disabled. We selected the preset configuration to provide  
greater safety for drive data in case of a sudden power loss when there is no battery on the controller to protect the  
cache. Enabling DWC may result in data loss if power fails and there is no power protection.  
Native Command Queuing (NCQ) increases SATA HDD performance by prioritizing read and write command  
execution. This reduces unnecessary drive head movement and increases performance, especially in server or  
storage-type applications with outstanding multiple simultaneous read/write requests. Without NCQ, the drive can  
process and complete only one command at a time. You must activate NCQ in both the controller and the drive.  
Networking technologies  
The DL580 G7 includes the integrated NC375i network controller. The NC375i is a quad port Gigabit Server  
Adapter that allows access to four 1 GbE ports. The NC375i has an eight lane (x8) PCI Express data path. With  
four ports on a single integrated controller, this density design contributes to saving server I/O slots. It also makes  
the configuration ideal for virtualization and security applications, server consolidation, and increased network  
segmentation. The quad port NC375i meets the needs of customers wanting high bandwidth but are not yet ready  
to move to 10 Gigabit Ethernet.  
The NC375i supports the NC524SFP 10 GbE upgrade module, allowing two of the four ports to move to 10 GbE.  
The NC524SFP modulewith its theoretical maximum of 40 Gbps, dual port, bi-directional full duplex mode—  
delivers optimum network performance designed to improve response time and remove bottlenecks. The NC375i  
provides full driver support. The support includes teaming drivers for all major operating systems, along with  
management utilities.  
Network Adapter Teaming  
ProLiant Network Adapter Teaming provides fault tolerance and load balancing across a team of two or more  
network adapters. The team of adapters works together as a single virtual adapter. Support for several different  
types of teaming is included. Teaming options offers an easy, efficient, and cost-effective way to provide network  
fault tolerance and increased network bandwidth.  
19  
 
Jumbo Frames  
Jumbo frames (also known as extended frames) permit a 9K byte transmission unit (MTU), which is six times the size  
of a standard 1500-byte Ethernet frame. The NC375i supports jumbo frames to achieve higher throughput and  
better CPU utilization. Jumbo frames are particularly useful for database transfers and tape backups.  
Server management technologies  
The DL580 G7ships standard with sever management capabilities.  
HP Insight Control  
HP Insight Control gives you more control over your ProLiant servers. With Insight Control, you can deploy ProLiant  
servers quickly. You can catalog your environment accurately, and monitor its health reliably to pinpoint failures. In  
addition, you can manage systems remotely away from your office, and optimize power confidently. As a result,  
you can reduce unplanned downtime and deliver stable IT services to your business users. You can also respond to  
pressing business needs faster by facilitating the rapid rollout of new IT services and optimizing the utilization of  
compute resources and data center facilities. HP Insight Control for Microsoft System Center and HP Insight Control  
for VMware vCenter deliver hardware management expertise into Microsoft System Center and VMware vCenter  
environments. Customers need only purchase one Insight Control license to take advantage of both System Center  
and vCenter integrations  
HP Insight Control helps you unlock the potential of your infrastructure with deep insight, precise control, and  
ongoing optimization. With HP Insight Control, you can:  
Deploy ProLiant servers quickly with a reliable drag-and-drop tool that can turn a manual server deployment into  
an unattended, repeatable, and automated deployment. Insight Control includes a complete set of wizard-  
driven server migration capabilities (P2P, P2V, V2P, and V2V).  
Monitor ProLiant server health with one simple, integrated interface and receive notification of any actual or  
impending failure  
Control ProLiant servers from anywhere, regardless of location, and improve system recovery times. With Insight  
Control, you can eliminate the cost of visiting servers anywhere in the world at anytime. HP Insight Control taps  
into and unleashes the HP iLO Advanced technology, a set of licensed embedded management capabilities that  
enhances the remote management experience  
Measure power consumption, reduce power usage, and reclaim trapped power and cooling capacity to extend  
the life of data centers  
Support all leading hypervisors, such as Microsoft Hyper-V, VMware vSphere, and Citrix XenServer. You also have  
the option of Linux-based Central Management Console -Insight Control for Linux for IT shops requiring full-Linux  
management.  
HP Integrated Lights-Out 3 (iLO 3)  
As previously noted, the HP ProLiant DL580 G7 server ships with the iLO 3 management processor onboard. An HP  
Advanced license either included with the HP Insight Control software or purchased stand-alone, upgrades the iLO  
firmware, enhancing remote management.  
The iLO 3 hardware and firmware provide remote server management capabilities over the Ethernet. The iLO 3  
management processor remains available whenever power flows to the server―even if the operating system is in  
shutdown. This feature lets you troubleshoot from a remote location.  
HP iLO 3 connects through a dedicated Ethernet port. The port can connect to a highly secured, dedicated  
management network that is out of the server’s data path. Alternately, iLO 3 provides a Shared Network Port (SNP)  
that allows network access to both iLO and the host server using a single network port. SNP allows routing of iLO  
network traffic through a sideband connection on one of the server NIC interfaces. Although the iLO traffic shares a  
20  
 
port with the server OS traffic, both the iLO processor and the server NIC have their own Media Access Control  
(MAC) address, which gives iLO and the server separate Internet Protocol (IP) addresses. The SNP simplifies  
hardware installation and reduces hardware costs because corporate and iLO network traffic comes through the  
system NIC.  
Advantages of iLO 3  
With HP iLO3, you can:  
Reduce expense and travel costs by accessing a secure Remote Console to the server from anywhere. Use the  
shared iLO 3 Remote Console to collaborate with up to six server administrators  
Remotely mount high-performance Virtual Media devices to the server from anywhere on the network  
Securely and remotely control the power state of the server  
Send alerts from iLO 3 regardless of the state of the host server  
Access advanced troubleshooting features through the iLO 3 interface  
Experience a fast Remote Console incorporating the newest technologies like Simple Network Time Protocol  
(SNTP) and IPMI over LAN (Intelligent Platform Management Interface) DCMI (Data Center Manageability  
Interface)  
Launch URL or scriptable Virtual Media from Remote Console  
Experience a streamlined user interface using Web 2.0 technologies  
Experience AES (in addition to RC4) encryption in the hardware for improved performance  
HP Power Regulator  
The DL580 G7 includes HP Power Regulator, an innovative OS-independent power management tool. HP Power  
Regulator is a ROM-based utility used to set the server to power modes:  
Static high power—Server runs continuously in the highest performance state  
Static low power—Server runs continuously in the lowest power state  
Dynamic power savings—Server processor-power adjusts according to application activity  
HP Power Regulator improves the energy efficiency of the DL580 G7. Intel processors run at full power when they  
need to, but with reduced application activity, they run in a power savings mode without performance degradation.  
RBSU during POST or the iLO 3 remote management console allows selection of the HP Power Regulator modes.  
HP Dynamic Power Capping  
Server performance per watt continues to increase steadily. However, the number of watts per server also continues  
to climb. These increases, combined with the growing number of servers and density in modern data centers, make  
planning and managing facility power and cooling resources critically important. HP Dynamic Power Capping is a  
ProLiant power management tool unique to HP and assists the data center administrator with managing these critical  
tasks.  
Because it is hardware based, Dynamic Power Capping can control server power consumption quickly. Dynamic  
Power Capping ensures sudden surges in server power demand do not allow the HP Power Distribution Unit circuit  
breakers to trip.  
Administrators can use power consumption information gathered with Insight Control power management software  
to set appropriate power caps to individual servers.  
Setting power caps to the peak observed power consumption makes it possible to free up additional power. Power  
is then available for additional servers.  
21  
 
For more information on the topic of HP Power Capping see:  
Conclusion  
The HP ProLiant DL580 G7 is a 4U rack-optimized, four-processor server. We engineer it for large data center  
deployments requiring enterprise-class performance, uptime, scalability, and remote management capabilities. The  
DL580 G7 offers customers running both 32- and 64-bit applications with increased performance and memory  
bandwidth. This platform’s balance of new system architecture, extensive memory capacity, and I/O throughput  
provides the high performance needed for large-scale enterprise applications.  
22  
 
For more information  
See the URLs listed below if you need additional information.  
Type of information  
Source  
HP ProLiant DL580 G7 Server  
series―Models  
351-15351-3328412-241644-3328422-4142916.html  
HP ProLiant DL 580 G7 Server User Guide  
nual/c02267159/c02267159.pdf  
Up-to-date information on operating systems  
and versions supported by the HP ProLiant  
DL580 G7 server  
Latest drivers available for the HP ProLiant  
DL580 G7 server  
www.hp.com/go/iLO  
Details about HP Insight Control  
Information about iLO 3  
Information about SAS technology  
Details about Serial ATA technology  
Smart Array P410i controller QuickSpecs  
nual/c01613420/c01613420.pdf  
nual/c00301688/c00301688.pdf  
div/13201_div.html  
23  
 
Call to action  
Send comments about this paper to [email protected]  
Follow us on Twitter: http://twitter.com/ISSGeekatHP  
© Copyright 2011 Hewlett-Packard Development Company, L.P. The information  
contained herein is subject to change without notice. The only warranties for HP  
products and services are set forth in the express warranty statements accompanying  
such products and services. Nothing herein should be construed as constituting an  
additional warranty. HP shall not be liable for technical or editorial errors or omissions  
contained herein.  
Intel, Intel Celeron, Itanium, Intel Itanium, Pentium, and Intel Xeon are trademarks of Intel  
Corporation in the United States and other countries.  
TC1006475, June 2011  
 

Graham Field Blood Pressure Monitor JB02017 User Manual
Graham Field Nebulizer JB0112 164 User Manual
Grandstream Networks Telephone Accessories HT 502 User Manual
Gravely Snow Blower 210E+05 User Manual
Harbor Freight Tools Power Supply 92464 User Manual
Hasselblad Digital Camera H3D User Manual
Hotpoint Cooktop 50HEGS User Manual
Hotpoint Range RGB508PEAAD User Manual
Hotpoint Range RGB735DEP User Manual
Husqvarna Lawn Mower Z 242F User Manual