Now in its fifth generation, IBM X-Architecture continues to build on its deep partnership with Intel and a decade ofx86 innovations to provide unparalleled configuration choice,mainframe-inspired reliability, comprehensive systems management and an energy-smart design. With the ability to help you maximize memory, minimize costs and simplify deployment and ownership, eX5 can help you get the greatest value for your organization today and in the future.
10. eX5 leadership for an evolving marketplace with increasing demands 1 st Gen: First x86 server with scalable 16 processor design 2 nd Gen: First x86 server with 100 #1 Benchmarks 3 rd Gen: First x86 server with Hot-swap memory 4 th Gen: First x86 server to break 1 Million tpmC 5 th Gen: Breakthrough performance, ultimate flexibility, simpler management 2010 5th Generation 2003 2nd Generation 2005 3rd Generation 2007 4th Generation 2001 1st Generation
11. eX5 Portfolio — Systems for a Smarter Planet Broad coverage for most enterprise applications, server consolidation, virtualized workload enablement. 4U / 4-Way Scalable Powerful and scalable system allows some workloads to migrate onto 2-socket design that delivers enterprise computing in a dense package Demand for minimum footprint as well as integrated networking infrastructure has increased the growth of the blade form factor. BladeCenter HX5 System x3690 X5 Consolidation, virtualization, and database workloads being migrated off of proprietary hardware are demanding more addressability System x3850 X5
12.
13. (2x) 1975W Rear Access Hot Swap, Redundant P/S (4x) Intel Xeon CPU’s (8x) Memory Cards for 64 DIMMs – 8 1066MHz DDR3 DIMMs per card 6x - PCIe Gen2 Slots (+2 additional) 2x 60mm Hot Swap Fans (8x) Gen2 2.5” Drives or 2 eXFlash packs (2x) 120mm Hot Swap Fans Dual USB Light Path Diagnostics RAID (0/1) standard, RAID 5/6 Optional DVD Drive 2x 10Gb Ethernet Adapter x3850 X5: 4-socket 4U x86 (Nehalem EX) platform
14.
15.
16.
17. (1x) x16 (full height, full length or (2x) x8 (1 full size, 1 full height / half length) (2x) PCIe x8 Low Profile (1x) PCIe x4 Low Profile for RAID (4x) N+N 675W Rear Access Hot Swap Redundant P/S (16x) Gen2 2.5” Drives or 3 eXFlash packs Scaling ports 32 x DDR3 Memory DIMMs 16 in upper mezzanine (pictured) 16 below 8x Memory Buffers (4x) 60mm Hot Swap Fans Dual USB Light Path Diagnostics DVD Drive x3690 X5: 2-socket 2U (Nehalem EX) platform
31. System Images – Chassis View Front Access 120mm fans Rear I/O Shutttle Rear Access HS PSUs - lift up on handle then pull out QPI Scalability Ports / Cables
32. System Images – CPU and Memory Memory Cards CPU and Heatsink installation
33. System Images – Options M1015 RAID card and Installation bracket 8 HDD SAS Backplane
34.
35.
36. x3850M2 to x3850X5 Transition Subsystem x3850M2 x3850 X5 PSU 1440W hot swap, full redundancy HIGH line, 720W low line. Rear Access. No PS option, 2 std. 1975W hot swap, full redundancy HIGH line, 875W low line. Rear Access. No PS option, 2 std. Config restrictions at 110V. CPU Card No VRDs, 4 VRMs, Top access to CPU/VRM and CPU card No VRMs, 4 VRDs, Top access to CPUs and CPU card Memory 4 Memory cards, DDR2 PC2-5300 running at 533Mbs. 8 DIMMs per memory card (32 DIMMs per chassis max) 8 Memory cards, DDR3 PC3-10600 running at 1066Mbs. 8 DIMMs per memory card (64 DIMMs per chassis max) PCIe Board CalIOC2 2.0, Slots = 7@2.5Gb PCIE x8, slots 6-7 hot plug Boxboro EX, Slots = 7@5GHz Slot1 x16, Slot2 x4, Slots 3-7 x8 No hotswap. SAS Controller LSI Logic 1078 w/RAID1 (no key), Elliott Key for RAID5, SAS 4x external port Ruskin IR or Fareham MR adapter Battery option for Fareham Ethernet Controller BCM 5709 Dual Gigabit Ethernet PCIE x4 attach to Southbridge BCM 5709 Dual Gigabit Ethernet PCIE x4 Gen2 attach to Boxboro Dual 10Gb Emulex adapter in PCIe Slot 7 on some models Video Controller ATI RN50 on RSA2, 16MB Matrox G200 in IMM, 16MB Service Processor RSA2 standard Maxim VSC452 Integrated BMC (IMM) SAS Design Four 2.5 Inch internal + 4x external Eight 2.5 Inch internal Support for SATA, SSD USB, SuperIO Design ICH7, 5 external ports, 1 internal, No SuperIO, embedded 512M key, No PS2 Kb/Ms, No FDD controller ICH10, 6 external ports, 2 internal, No SuperIO, embedded 512M key, No PS2 Kb/Ms, No FDD controller Fans 4 x 120mm, 2 x 92mm, 8 total (2 x 80mm in Power supplies) 2 x 120mm, 2 x 60mm, 6 total 2 x 120mm in Power Supplies
37. x3850 X5 configuration flexibility Base System Shipping today Memory Expansion with MAX5 via QPI Shipping today Native Scaling via QPI Shipping today Memory Expansion and Scaling with MAX5 via QPI and EXA Available 2011
54. (1x) x16 (full height, full length or (2x) x8 (1 full size, 1 full height / half length) (2x) PCIe x8 Low Profile (4x) N+N 675W Rear Access Hot Swap Redundant P/S (16x) Gen2 2.5” Drives or (24x) 1.8” SSD Drives 2 Scalability cables for eX5 Memory Expansion (16x) DDR3 Memory DIMMs Upper mezzanine 8x Intel Memory Buffers (BoB’s) Intel Nehelam EX processor details, staired heat sinks x3690 X5: 2-socket 2U platform 2U Rack Mechanical Chassis Top view Maximum performance, maximum memory for virtualization and database applications
55. QPI Cable cage (2x) 1Gb Ethernet (2 std, 2 optional) x3690 X5: 2-socket 2U platform 2U Rack Mechanical Chassis Rear view Maximum performance, maximum memory for virtualization and database applications
56.
57.
58. x3690 X5 – Inside, No Memory Mezzanine (2x) Intel Xeon EX CPU’s Memory Mezzanine Connectors (16x) DDR3 Memory DIMMs Base Planar (4x) Intel Memory Buffers (BoB’s) Base Planar (2x) USB (front) Light Path Diagnostics UltraSlim SATA DVD Drive Front video
69. MAX5 for System x front and rear views Redundant 675W Power Supplies Lightpath Diagnostics QPI Ports EXA Ports Hot swap fans Front Rear System removes from chassis for easy access
83. HX5 Operating System Support All NOS apply to both HX5 and HX5+MAX5 models Note: Solaris 10 support WIP U5, which includes KVM support. N-1 1 & 2 P2-Hammerhead P1-Thresher Red Hat Enterprise Linux 5 Server, 64-bit U5, which includes KVM support. N-1 1 & 2 P2 Red Hat Enterprise Linux 5 Server with Xen, 64-bit 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 1 & 2 Nodes U1. Emulex Tiger Shark - no drivers. Driver for Intel 10G NIC will be async - not in kernel. No CIM provider for SAS-2. Waiting on code from LSI. No way to manage SAS-2. N P1 VMWare ESXi 4.0 N P2 SUSE Linux Enterprise Server 11 with Xen, 64-bit SP3 N-1 P2 SUSE Linux Enterprise Server 10, 64-bit SP3 N-1 P2 SUSE Linux Enterprise Server 10 with Xen, 64-bit N N N-1 N N N N / N-1 P3 for Hammerhead, to be moved to P2 immediately following initial SIT Exit. Test completion outlook is 4-6 weeks after initial SIT Exit. P2 for Thresher. P3-Hammerhead P2-Thresher Red Hat Enterprise Linux 6, 64-bit SP2 P1 Windows Server 2008, 64-bit (Std, Ent, Web, DC) U1 P1 VMware ESX 4.0 P1 SUSE Linux Enterprise Server 11, 64-bit Comments Pri NOS SP2 P3 Windows HPC Server 2008 P1 Windows Server 2008 R2 (64-bit)
84.
85. HX5 & Westmere support in BCE, BCS, BCHT & BCT Source: BCH Power Matrix 25JAN10_elb.xls ^^ Throttling / over-subscription enabled No support Up to 95W TBD 12 Enterprise 6 6 3 6 BCS No support Up to 80W CPU No support No support NEBS BCHT No support Same as NEH-EP HS22 No support No support 2000W No support 14^^ No support No support 2320W BC-E HS22 WSM 130W Westmere (HS22 & HS22V) HX5 w/ MAX5 130W HX5 95W / 105W
96. Intel Nehalem-EX: Designed For Modularity QPI: Intel ® QuickPath Interconnect #QPI Links # mem channels Size of cache # cores Power Manage- ment Type of Memory Integrated graphics Differentiation in the “Uncore”: DRAM QPI Core Uncore C O R E C O R E C O R E IMC QPI Power & Clock … QPI … … … L3 Cache
120. IBM x3850 X5 + MAX5 memory map 2-node example 0G 2G 4G 18G 34G 50G 66G 74G 82G 90G 98G CPU1 CPU1 CPU2 CPU3 CPU4 CPU1 CPU2 CPU3 CPU4 98G Primary Node Partitioned to CPUs Secondary Node Partitioned to CPUs Example: 192GB, 96 x 2GB DIMMs, 2 x3850 X5, 8 CPUs, 16 Mem Cds (4 DIMMs each), 2 MAX5 (16 DIMMs each) 2G MMIO IBM Confidential 256MB L4 Cache creates small memory gap to next node OS Memory is 191.5GB CPU5 CPU6 CPU7 CPU8 114G 130G 146G 162G X5 Mem CPU5 CPU6 CPU7 CPU8 170G 178G 186G 194G X5 Mem
121. Trademarks IBM, the IBM logo, the e-business logo, Active Memory, Predictive Failure Analysis, ServeRAID, System i, System Storage, System x, Xcelerated Memory Technology, and XArchitecture are trademarks of IBM Corporation in the United States and/or other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://ibm.com/legal/copytrade.shtml . Intel, the Intel Logo, Itanium, ServerWorks, and Xeon are registered trademarks of Intel Corporation in the United States, other countries, or both. Dell is a trademark of Dell, Inc. in the United States, other countries, or both. HP is a trademark of Hewlett-Packard Development Company, L.P. in the United States, other countries, or both. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Hyper-V, SQL Server, and Windows are trademarks or registered trademarks of Microsoft Corporation in the United States, other countries, or both. Red Hat is a trademark of Red Hat, Inc. SAP and all SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries. TPC, TPC-C, tpmC, TPC-E and tpsE are trademarks of the Transaction Processing Performance Council. UNIX is a registered trademark of The Open Group in the United States, other countries, or both. VMware, VMworld, VMmark, and ESX are registered trademark of VMware, Inc. in the United States and/or other jurisdictions. All other company/product names and service marks may be trademarks or registered trademarks of their respective companies. IBM reserves the right to change specifications or other product information without notice. References in this publication to IBM products or services do not imply that IBM intends to make them available in all countries in which IBM operates. IBM PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you. This publication may contain links to third party sites that are not under the control of or maintained by IBM. Access to any such third party site is at the user's own risk and IBM is not responsible for the accuracy or reliability of any information, data, opinions, advice or statements made on these sites. IBM provides these links merely as a convenience and the inclusion of such links does not imply an endorsement. Information in this presentation concerning non-IBM products was obtained from the suppliers of these products, published announcement material or other publicly available sources. IBM has not tested these products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Now let’s take a closer look at how HX5 delivers value to our customers: HX5 with MAX5 delivers 25% more memory capacity than any server in it’s class. Resulting in optimal server utilization for memory constrained applications. More memory also allows customers to run more, larger virtual machines per servers and results in greater database throughput. For customers looking for maximum performance, HX5 offers compute capacity of up to 32 CPU cores with the 4S blade. This not only provides blazing fast performance, it also enables customers save on system costs by getting most out of their licensing costs where SW is priced by servers or # of CPUs. For memory limited apps, more apps just doesn’t cost another server….. Smaller DIMMs HX5 delivers faster time to value for our clients. Since it is built from the same 2S base blade, customers have to qualify a single platform for 2-socket to 4-socket server needs, which will allow them to standardize on a single system and deliver faster time to value. The image customers develop for a 2S HX5 system, will essentially work on all other scaled HX5 systems. Memory Price HS22/HS22V HX5 2G $125 $125 4G $235 $275 8G $990 $989 6K memory savings Memory Price: 2G $125 4G $275 8G $989 Blade Price (base model w/ all CPUs populated ) 4S HX5: $17,000 4S HX5+MAX5: $25,600 256GB Memory config price (memory only) 4S HX5: 32*8G = $31,648 4S HX5+MAX5: 32*2G + 48*4G = $17200 Total System Price 4S HX5: 32*8G = $48,648 4S HX5+MAX5: 32*2G + 48*4G = $42,800 Delta: $5,848
5x Memory (Jan 23, 2010) HP DL380 G6 has 18 DIMMs, but only supports up to 128GB (12 x 16) due to rank limitations in Nehalem EP
QPI transfers memory @ 6GTS
after this “switch gears”
Each CPU needs at least one memory card Each memory card needs at least 2 DIMM’s DIMM’s must be installed in matching pairs Optimal memory performance requires 2 memory cards per CPU, with 4 DIMMs on each memory card, equal amounts of memory per card. If memory mirrored, then DIMM’s must match in sets of 4 eX5 Memory expansion works best with DIMM’s in sets of 4 eX5 Memory expansion works best with a ratio of 2/1 memory in host/expander Memory Size DIMM FRU Option (contains only 1 DIMM) 1GB DIMM (1Gb, x8, SR) 43X5044 44T1490 44T1480 2GB DIMM (1Gb, x8, DR) 43X5045 44T1491 44T1481 4GB DIMM (1Gb, x8, QR) 43X5055 46C7452 46C7448 8GB DIMM (2Gb, x8, QR) 43X5070 46C7488 46C7482 16GB DIMM (2Gb, x4, QR) 43X5071 46C7489 46C7483 Best not to mix ranks in a channel Memory Installation Card number DIMM Numbers 1 1 & 8 7 1 & 8 3 1 & 8 5 1 & 8 2 1 & 8 8 1 & 8 4 1 & 8 6 1 & 8 1 3 & 6 7 3 & 6 3 3 & 6 5 3 & 6 2 3 & 6 8 3 & 6 4 3 & 6 6 3 & 6 1 2 & 7 7 2 & 7 3 2 & 7 5 2 & 7 2 2 & 7 8 2 & 7 4 2 & 7 6 2 & 7 1 4 & 5 7 4 & 5 3 4 & 5 5 4 & 5 2 4 & 5 8 4 & 5 4 4 & 5 6 4 & 5
A PCIe Gen 2 lane is 500MB/s X16 PCIe slot is ~~ 8GB/s X8 PCIe slot is ~~5GB/s X4 PCIe slot is ~~2GB/s
SAP Business All-In-One fast-start Fast-Start is SAP‘s primary ‘out-of-the-box’ Mid-market solution, which includes an optional, pre-installed, fixed price infrastructure offering. Fast-Start solutions are exclusively sold by SAP Value Added Resellers. Fast-Start infrastructure stacks will be co-marketed with a HW reseller, and fulfilled by the HW reseller. The SAP® Business All-in-One fast-start program enables you to configure a SAP Industry specific solution online, obtain an estimate of costs, and implement the solution quickly and cost-effectively while delivering a rapid time to value SAP All-In-One Value Proposition Provide industry-specific functionality at a low cost of ownership. Bounded project scope, predictable costs, and short implementation times. Minimize IT staff dedicated to supporting on premise business solutions. Flexibility to grow and adapt to meet your company’s changing business requirements IBM All-In-One fast-start Value Proposition Preinstalled solution with minimal IT support requirements Flexibility and growth with investment protection using IBM Blade C enter S or System x 3850 with IBM Systems Storage Local support from IBM and SAP Business partners Predictable IT costs through IBM leasing offerings Reduced risk with preinstalled Linux All-In-One Fast-Start solution Which customers are good candidates for SAP Business All-In-One fast-start Small and Midmarket customers who need industry specific business functionality Customers looking to replace legacy ERP solutions Customers who have complex business requirements Customers who have plans for growth and expansion
SAP Business All-In-One fast-start Fast-Start is SAP‘s primary ‘out-of-the-box’ Mid-market solution, which includes an optional, pre-installed, fixed price infrastructure offering. Fast-Start solutions are exclusively sold by SAP Value Added Resellers. Fast-Start infrastructure stacks will be co-marketed with a HW reseller, and fulfilled by the HW reseller. The SAP® Business All-in-One fast-start program enables you to configure a SAP Industry specific solution online, obtain an estimate of costs, and implement the solution quickly and cost-effectively while delivering a rapid time to value SAP All-In-One Value Proposition Provide industry-specific functionality at a low cost of ownership. Bounded project scope, predictable costs, and short implementation times. Minimize IT staff dedicated to supporting on premise business solutions. Flexibility to grow and adapt to meet your company’s changing business requirements IBM All-In-One fast-start Value Proposition Preinstalled solution with minimal IT support requirements Flexibility and growth with investment protection using IBM Blade C enter S or System x 3850 with IBM Systems Storage Local support from IBM and SAP Business partners Predictable IT costs through IBM leasing offerings Reduced risk with preinstalled Linux All-In-One Fast-Start solution Which customers are good candidates for SAP Business All-In-One fast-start Small and Midmarket customers who need industry specific business functionality Customers looking to replace legacy ERP solutions Customers who have complex business requirements Customers who have plans for growth and expansion
Have to borrow a QPI link to connect to MK.
Ent / nebs
It is technically possible for a platform to have different QPI links running at different frequencies (e.g. slower between node controllers and faster from CPU to IOH’s). But this is an OEM design decision and does add complexity to the design…so different QPI link speeds in the same system are not probable.
Best DIMM choices More ranks are better (QR better than DR better than SR) Remember: More ranks does NOT reduce frequency
Have to borrow a QPI link to connect to MK.
Important Points “ Uncore” provides segment differentiation. Separate V/F domains decouples core and uncore designs. Core -consistent logic across processor family -Same uArch across all segments.. Good for software optimization… Uncore – things that glue all the cores together… # cores Size of LLC Type of memory… native vs. buffer Number of sockets… Integrated graphics available on some but not all… Different knobs that we can play to Important point to note: Uncore is what differentiates Nehalem EP from EX Q: is the common core, the same core as Nehalem EP A: Yes
Nehalem-EP (NHM-EP) 4 cores/8 threads per socket, Nehalem core, 45nm process, 8MB shared LLC SMT (~hyper threading) QPI links (only 1 is coherent link) per socket One integrated memory controller (IMC) Three DDR channels per socket Scales to 2 sockets MAX Nehalem-EX (NHM-EX) Up to 8 cores/ 16 threads per socket, Nehalem core, 45nm process, 24MB shared L3 SMT (~Hyper-Threading) Turbo Boost Four QPI Links (3 coherent) Two integrated memory controllers (IMC) Four buffered memory channels per socket Scales to up to 16 sockets
The physical connectivity of each interconnect link is made up of twenty differential signal pairs plus a differential forwarded clock. Each port supports a link pair consisting of two uni-directional links to complete the connection between two components. This supports traffic in both directions simultaneously. The Intel® QuickPath Interconnect is a double-pumped data bus, meaning data is captured at the rate of one data transfer per edge of the forwarded clock. So every clock period captures two chunks of data. The maximum amount of data sent across a full-width Intel® QuickPath Interconnect is 16 bits, or 2 bytes. Note that 16 bits are used for this calculation, not 20 bits. Although the link has up to 20 1-bit lanes, no more than 16 bits of real ‘data’ payload are ever transmitted at a time, so the more accurate calculation would be to use 16 bits of data at a time. The maximum frequency of the initial Intel® QuickPath Interconnect implementation is 3.2 GHz. This yields a double-pumped data rate of 6.4 GT/s with 2 bytes per transition, or 12.8 GB/s. An Intel® QuickPath Interconnect link pair operates two uni-directional links simultaneously, which gives a final theoretical raw bandwidth of 25.6 GB/s.