CCCC Broadcom Nicholas Ilyadis

www.cloudcomputingchina.org
www.broadcom.com

Large Scale Data Centers
大规模数据中心
Ethernet as the Enabling Technology
以太网技术起到了推动和促进作用

Nick Ilyadis
副总裁兼首席技术官
Broadcom（博通）公司

2010年3月

www.broadcom.com
Broadcom Proprietary & Confidential. © 2010 Broadcom Corporation. All rights reserved.

Safe Harbor
This presentation may contain forward-looking statements regarding future events or the future performance of Broadcom. These
forward-looking statements may include guidance we will provide on future growth drivers in the markets in which we operate and
statements about the prospects for our various businesses. All statements that we make or incorporate by reference in the
presentation, other than statements or characterizations of historical fact, are forward-looking statements. It should be clearly
understood that these forward-looking statements, and our assumptions about the factors that influence them, are based on the
limited information available to us at this date. Such information is subject to change. We undertake no obligation to revise or
update publicly any forward-looking statement, except as required by law.

Forward-looking statements are not guarantees of future results and are subject to risks, uncertainties and assumptions that are
difficult to predict. Therefore, our actual results could differ materially and adversely from those described in the statements you
hear today as a result of various factors. We refer you to our 2008 Form 10-K, subsequent and forthcoming 10-Qs and other
filings with the SEC, which discuss some of the important risk factors that could contribute to such differences or otherwise affect
our business, results of operations and financial condition.

In addition, during the presentation we may refer to certain non-GAAP financial measures. Non-GAAP free cash flow is defined as
net cash provided from operating activities less purchases of property and equipment, net, as reported in our statements of cash
flows presented in accordance with GAAP. The non-GAAP financial information presented herein should be considered
supplemental to, and not as a substitute for, or superior to, financial measures calculated in accordance with GAAP. However,
Broadcom believes that non-GAAP reporting, giving effect to the adjustments shown in the reconciliations in this presentation,
provides important supplemental information to management and investors regarding financial and business trends relating to the
company's financial condition and results of operations.

© 2009 Broadcom Corporation. All rights reserved. Broadcom®, the pulse logo, Connecting everything®, and the Connecting everything
logo are among the trademarks of Broadcom Corporation and/or its affiliates in the United States, certain other countries and/or the EU. Any
other trademarks or trade names mentioned are the property of their respective owners.

Broadcom Proprietary & Confidential. © 2010 Broadcom Corporation. All rights reserved. 2

关于Broadcom
• 成立于1991年 Founded in 1991
• 1998年初次公开发行股票
Initial public offering in April 1998 (NASDAQ-BRCM)
• 财富500强公司 Fortune 500 company
• 全球有线及无线通讯半导体市场的领导者
Global leader in semiconductors for wired and
wireless communications
• 2009年净营业额44.9亿美元
2009 net revenue of $4.49 billion
• 2009年第四季度净营业额13.4亿美元
Q4 2009 net revenue of $1.34 billion
• 最大的无晶圆生产半导体公司之一 One of the largest volume fabless semiconductor suppliers
• 广泛的知识产权及超过13,150个美国和国外专利及专利申请
Broad IP portfolio with over 13,150 U.S. and foreign patents and applications
• 全球员工及临时人力7,400人（不包含实习生）
7,400 employees and temporary workers worldwide (excluding interns)
– 平均每位雇员为公司增值净额72.5万美元
$725,000 Annualized net revenue per employee
– 在亚洲拥有超过1500名雇员
More than 1,500 employees in Asia
– 在中国上海、北京和深圳的研发中心里共有超过300位员工
300+ employees in China with R&D sites in Shanghai, Beijing and Shenzhen

通过独特创新的产品来创造新组合与应用
Driving convergence through unique and innovative product offerings

互联网数据中心Internet Data Center
需要以更低的功率提供更高速、更高密度和更大的存储容量
Demanding Higher Speed and Density and More Storage at Lower Power

互联网视频观众预测， 2006年–2012年
每天观看的视频总数预测，2006年–2012年
Forecast of Total Videos Viewed per Day, 2006–2012
Internet Video Viewers Forecast, 2006–2012
1,400
中国前10位的社交网站 (单位：百万) 60%
1,800
250 90%
35%
Top 10 China Social NetworkingInternet Video ViewersIDC, 2009
中国数据中心市场 2007-2013
每天观看的视频总数 Total 互联网视频观众 Day
Video Viewed per
Sites Source:

增长率 (%) China Data Center Market,Growth Rate (%)
Growth Rate (%)增长率 (%) 2007–2013
1,200 (Service Revenue – Dollars in Millions) 30%
1,500 更多运算在数据中心中运行 50%
75%
每天观看的视频总数 (单位：百万)

200

1,000
Market Size
“云计算”
Growth Rate (%) 25%
视频观众 (单位：百万)

1,200 More web applications running in data center 40%
60%
“Cloud Computing”
US$ (in millions)

150
800 20%
更多基于浏览器的用户设备
Top 10
30%
900 45%
China user devices are browsers
More Social Networking Sites
600 15%
100
在互联网数据中心运行的企业数据和应用日益增加 20%
600
Corporate data and number of applications 30%
running in Internet data centers are growing
400 10%

50
300 10%
15%
200 5%

0
0 0
0%
2006
2007 2007
2008 2008
2009 2009
2010 2010
2011 2011
2012 2012
2013
数据来源：In-Stat，2007年11月


我们走了多远，将去向何方？
How Far Have We Come, Where Are We Going?

过去现在将来
Honeywell DDP-516 PalmOne 3G/4G
接口信息处理机 Treo 设备
1969 2004 2010
Interface Message Processor Device

半导体电子产品领域的创新是这些技术进步的关键驱动力
Innovation in the field of semiconductor electronics was the key to unlocking these advancements

通过50Kbps的租用线通过50Kbps的GPRS链路以数Mbps速度
连接到互联网连接到互联网连接到互联网
Connected to Internet via Connected to Internet via Connected to Internet via
50 Kbps leased line 50 Kbps GPRS link many Mbps


中国总体网络使用情况
Total Network Usage in China
Internet Users in China – 2008

中国的互联网用户 – 2009

384 Million 233 Million 703 Million
(by end of 2009) (by end of 2009) (by July 2009)

Source: CNNIC, 1/10

移动互联网用户互联网用户移动电话用户
Mobile Internet Users Internet Users Mobile Phone Subscribers


智能手机销售…Smartphone Sales…
到2013年，会达到1.23亿部，或者占整个手机销售的
36%，这是由于丰富的产品及不断下降的价格
… will reach 123 million units or 36% of the total handset sales in 2013,
thanks to enriched product portfolio and falling price
140
China Smart Phone Market Forecast (2008-2013F, million units)
120
123.4
100 31.1% CAGR from
103.5
2008 to 2013
80
82.1
60
61.4
40
44.2
20 31.8

0
2008 2009 2010F 2011F 2012F 2013F
Percent of
smart phone 16.0% 18.0% 23.0% 28.0% 32.0% 36.0%
Note: BDA’s forecast model is based on demand driven methodology.
The above figures may be larger than retail tracking data.

Source: BDA, CCID – 03/2010

不断演变的计算模式：数据中心
Evolving Computing Models: Data Center

1960s: Big Iron Mainframes
10K+ servers Uplinks: Cloud Computing Multi-chas
2000s: 100 Tbps
10K+服务器上行链路： 100Tbps多机箱
上世纪60年代：大型计算机 2000年：云计算
10/40GE
Mesh
网状网
40/100

Blade switch or
top-of-rack pizzabox Moving
刀片式交换机或 Back Aggregation
In
1990s: Decentralized Computing Switch Layer
架顶式（ToR）比萨盒服务器又向内转移
汇聚交换机层
上世纪90年代：分布式计算

Moving Outside
向外转移


含有百万台服务器的数据中心
Million Server Data Center
冷却：用水循环的高效率冷却系统结构：一个占地2.4万平方米的建筑
，与传统冷却系统相比，能量密度物中安装了400个容器。这些容器由
较低，通过容器循环冷水以去除热卡车运抵，连到凸脊式基础设施上电源：两个电源子站总共向
量，因此房间无需装空调。，这种基础设施提供网络连接、电数据中心提供300MW电力，
源和水。数据中心没有照惯例提高其中200MW用于计算设备，
地板。其余100MW消耗在冷却和电
量损失上。电池和发电机提
供备份电源。

Power & water distribution
功率和水的分配

Water-based
cooling system
采用水循环
的冷却系统
容器：每个容积为67.5立
方米的容器中都安装了
2500台服务器，而在常规
数据中心中，同样大小的
空间所能容纳的服务器约 Racks of
Truck carrying 为其1/10。每个容器都集
servers Power
container 成了计算、网络、电源和
服务器 supply
容器由卡车冷却系统。
机架电源
运抵
Source: IEEE Spectrum

数据中心架构的作用
Data Center Fabric Role

100s of Data Center servers may be involved per
transaction/request  large multiplier between Internet facing
capacity and internal capacity
Internet互联网每项交易/请求也许涉及100台数据中心服务器
Request请求互联网连接容量和内部容量之间相差很大的倍数

Response响应

Data Center Interconnect
数据中心互连

ToR Switch ToR Switch ToR Switch
For deployments in the 200-2000 node range ToR交换机 ToR交换机 ToR交换机
the interconnect (*) represents ~1/30th of the
rack space, ~1/10th of the cost
对于200至2000个节点的部署规模来说
，互连（*）占用1/30的机架空间，同
时约占其成本的1/10

Rack servers Rack servers Rack servers
机架式服务器机架式服务器机架式服务器

(*) 10G based interconnect, including NIC,QSFP transceivers, and cables, non-redundant model, no storage interconnect
（*）基于10G的互连，包括NIC、QSFP收发器和电缆，非冗余模式，无存储系统互连


数据中心大容量交换机面临的挑战
Data Center Scale Switch Challenges

C0-0 C0-1 C0-31 C0-0 C0-1 C0-31 C0-0 C0-1 C0-31

Aggregation & Core B0-0 B0-1 B0-63 B0-0 B0-1 B0-63 B0-0 B0-1 B0-63
汇聚与核心
32x10GE 32x10GE 32x10GE 32x10GE 32x10GE 32x10GE 32x10GE 32x10GE 32x10GE

Large L2 Networks
大型 L2 网络

Fat Tree 粗树

ToR ToR MapReduce, reduce A-0 A-1 A-2047
N:1 overload events and
Oversubscription port speed mismatch
MapReduce，减少过 32x10GE 32x10GE 32x10GE
超负载
载事件和端口速度
失配

• Traditional B/W hierarchy does not reach DC scale
传统带宽体系达不到数据中心容量要求
– Backplanes are not faster than links anymore 背板速度不再高于链路
Radix 64 - CLOS Cost Per Port

Total Cost Per Port
– 10:1 link speed ratios are not sufficient aggregation 10:1的链路速度比使汇聚不够充分
• Multipathing enables large L2/L3 data center:
• 多路径可实现大规模L2/L3数据中心：
– Solves Spanning Trees limits 解决生成树受限问题
– Solves Rebalancing difficulties of ECMP/LAG static hashes
克服ECMP/LAG静态散列重平衡的难题
• Spatial aggregation has a cost effective capacity curve
空间汇聚具有经济实惠的容量曲线
– Proven in large HPTC clusters with non blocking workload demands across various
0 10,000 20,000 30,000 40,000 50,000 60,000 70,000
technologies 在大型HPTC集群中、在采用各种不同技术的非阻塞工作量需求情
况下得到证实
Servers
– Uses uniform building blocks (i.e.: Broadcom XGS switch family)
采用一致的基本构件（即Broadcom XGS交换器系列）

I/O技术的演进
Evolution of I/O Technology

100 Gb/s

10 Gb/s

1 Gb/s

0.1 Gb/s

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009


数据中心演进：以10GbE作为统一架构
The Data Center Evolution:10 GbE As the Unifying Fabric

10 GbE Switch and Client ASSP Port Shipments
Today’s Data Center
10GbE交换机和客户ASSP端口交付量
Tomorrow’s Converged Network
16000 10 GbE Client 10 GbE Switch

14000

12000

10000
Thousands

8000

6000

4000

2000

0
2007 2008 2009 2010 2011 2012
Source: Linley 3/2010
数据来源：Linley公司，2010年3月

* Forecast does not include Uplink ports on GbE switches. 不包括GbE交换机上行链路端口的预测数据
* Forecast includes ports using merchant silicon or OEM developed ASICs 预测数据考虑了采用商用芯片或OEM开发的ASIC芯片的端口

速率与接口
Speeds and Interfaces
Backplane

24 X 10G Front Panel


热插拔 10G 模块比较
Hot Pluggable 10G Module Comparison

SFP / SFP+
(1G/2G/4G/8G/10G) XFP
0.52" x 1.6" x 0.33" 0.65" x 2.3" x 0.33"

XPAK or X2 XENPAK
1.3″ x 2.4″ x.5″ 2" x 5" x 0.88"

1W
1.5W
4.5W

6W


具有10G和40G端口的1U架顶式交换机
1U Top of Rack Switches with 10G and 40G Ports

48 X 10G SFP+ Ports + 4 X 40G QSFP Ports 48 X 10G SFP+端口＋4 X 40G QSFP端口
480G Down Links + 160G Up Links = 640 Gbps (3:1 OS) 480G下行链路＋160G上行链路＝640Gbps（3:1 OS）

32 X 40G QSFPs
960G Down Links + 320G Up Links = 1280 Gbps (3:1 OS) 960G下行链路＋320G上行链路＝1280Gbps（3:1 OS）

BCM5684x


10G / 40G XGS Based Chassis基于10G/40G XGS的机架
方框图和属性（以5Tbps和10Tbps为例）
Block Diagram and Attributes (5 and 10Tbps examples)

5 Tbps 10 Tbps

Flexible switch line card configuration Full mesh backplane
Utilizing 10G + 40G uplinks distributed fabric examples
灵活的交换机线卡配置采用10G+40G上行链路全网状背板分布式架构举例

… …
… …
… … … …

64 x 10G Line Card 16 x 40G Line Card 64 x 10G Line Card 16 x 40G Line Card
64 x 10G线卡 16 x 40G线卡 64 x 10G线卡 16 x 40G线卡
5.12 Tbps, 8 slot Up to 10.24 Tbps, 16 slot
5.12Tbps，8槽高达10.24Tbps，16槽

可扩展架构模块化交换机
Scalable Fabric Modular Switch
• Acquisition of Dune Networks provides the next level of switching capacity
收购Dune Networks提供了下一级的交换能力
• Most scalable switching architecture based on SAND >30K servers
大部分可扩展交换架构基于SAND >30K服务器
• Strictly non-blocking – highest utilization of the networks resources
严格的无阻碍 - 最多的利用网络资源
• Dynamically load balancing across the data center
在整个数据中进行实时的负载平衡
• Efficient single hop packet processing with end-to-end scheduling
通过端至端调度实现高效单独跳包处理


架构可扩展的模块式交换机
Scalable Fabric Modular Switch

Carrier Grade MAC Integrated TM and Fabric Element
with Integrated TM Fabric Access (FE)
集成了TM的运营商级MAC 集成的TM和架构接入架构组件（FE)

ECAD
R
LIN

ECAD
R
LIN

Integrated MAC, PP,
TM and Fabric Access
集成的MAC、PP、
TM和架构接入


具有LOM功能的统一架构: 可面向任何融合网络协议进行配置
LOM-able Unified Fabric: Configure for Any Converged Network Protocol
Single-chip LOM-able Solution!
具有LOM功能的单芯片解决方案！

FCoE, iSCSI & TCP / IP Traffic
FCoE, iSCSI和TCP/IP流量

Fibre
Channel Storage Local Area Network iSCSI Storage
Area Network 局域网 Area Network
光纤通道存储域网 iSCSI存储域网

Market Leading Performance – iSCSI and FCoE
市场领先的性能－ iSCSI和FCoE

Next-Gen 下一代
BCM57711
BCM57711 >1M
>500K IOPS
>500K IOPS IOPS!

Only vendor with simultaneous per port capability: Network + iSCSI + FCoE
惟一一个每端口同时提供多种功能的厂商：网络＋iSCSI＋FCoE

提高数据中心功率效率: 卸载显著提高性能/W
Improve Data Center Power Efficiency:
Offload Significantly Improves Performance / Watt

MBps vs CPU vs Watts
35% Data Center
Web, Power Copy, OS 33% File
File Load, Streaming Media,
Paging Server, Database Video Rendering,
数据中心功率 30% IPTV
30%
250 1200
25%
Loading %

20%
200 18% 1000

15% 800
Watts / %CPU

150
9%

MBps
10% 600
5%
100 3%
5%
1% 1% 400
0%
50 Lighting Switch UPS / PDU IT Chiller CRAC Humidifier
200
照明 Gear Generator Equipment 冷却器加湿器
交换设备 UPS/发电机 IT 设备
0 Equipment Categories 设备类别 0
512 1024 2048 4096 8192 16384 32768 65536 131072 262144 524288 1048576

Offload • Improved PUE (Power Utilization Efficiency) 更高的PUE（功率利用效率）
57711 iSCSI Offload – Sum of WATTS
Provides iSCSI Offload – Sum of MBps
57711
• Permanentofpower savings for right-sizing 因大小合适而长久节省功率
Data Centers 50-70%Sum MBpspower savings 额外节省50%-70%的功率
Competitor’s L2 –
additional
Competitor’s L2 – Sum of WATTS

卸载为数据中心提供 Lowers non-IT infrastructure CAPEX 降低非IT基础设施的CAPEX

Broadcom hardware offload saves ~60W per port of power while delivering higher throughput
Broadcom硬件卸载每端口节省约60W功率，同时提供更高的吞吐量

Broadcom实现节能以太网
Broadcom Enabling Energy Efficient Ethernet
Comprehensive Energy-Efficient Ethernet portfolio includes
完整的节能以太网产品包括
10/100/1000BASE-T PHYs • 10GBASE-T PHYs • Gig E and 10GE controllers
Switches • SMB switches


未来的方向－在云中的虚拟化交换环境
Future Directions – Virtualized Switching Environments in the Cloud

Virtual Ethernet Bridge Virtual Ethernet Port Multichannel Remote Replication
(VEB) 虚拟以太网桥（VEB） Aggregation (VEPA)虚拟以太多通道远程复制
MAC+VID to steer frames 网端口汇聚（VEPA）
Uses tag for remote ports Uses tag to replicate packets
MAC+VID控制帧 MAC+VID to steer frames 使用远程端口标记使用标记来复制数据包
• Emulates 802.1 bridge MAC+VID控制帧
模仿802.1桥 • Exploits 802.1 bridge • Exploits provider bridge • Extends Multichannel
利用802.1桥利用提供商的桥扩展多通道
• Existing implementations
(vSwitch, SR-IOV bridge) • Works with many existing bridges • Similarities to remote • Optimizes multicast delivery
已有部署（vSwitch，SR-IOV桥） (hairpin) service Interface
优化多播交付
与很多已有桥一起运行（发夹式）与远程服务接口类似
• Works with all existing bridges • Enables external cascading
与全部已有桥一起运行 • No changes to existing frame format • Uses existing frame formats (S-tags)
利用已有帧格式（S-tags）实现外部级联
• No changes to existing frame format 不改变已有帧格式
不改变已有帧格式 • Full bridge visibility • Creates bridge virtual ports • Defines new tag format
桥完全可见建立桥虚拟端口定义新的标记格式
• Limited bridge visibility
桥的可见性有限 • Access to bridge features • Defines restricted s-component • Defines new name space
使用桥功能定义受限制的s-分量定义新的名字空间
• Limited feature set 功能有限
• Constrained performance • Access to bridge features
• Best local performance 使用桥功能
最佳的本地性能性能受限
• Leverages VEB resources • Adjacent bridge multicast replication
• Legacy, pervasive solution (constrained performance)
利用VEB资源
传统的、无处不在的解决方案邻接桥多播复制（性能受限）


结论
Conclusions

• Next generation large scale data centers can be built utilizing Converged Ethernet Fabrics
新一代大规模数据中心可以利用融合以太网架构来搭建
• 10G, 40G and 100G provide the scale and capacity to implement the large switching
infrastructures that are required to support 10,000s of servers
10G、40G和100G提供实现大型交换基础设施所需的规模和容量，要求
这样的基础设施支持1万台服务器
• 10G and future 40G Ethernet Controllers with off-load technologies will enable efficient I/O
and high performance computing
采用卸载技术的10G和未来的40G以太网控制器将实现高效率I/O和高性
能计算
• Current and next generation Switch and Controller devices from companies like Broadcom
will allow OEMs to build cost effective Data Center networking equipment
Broadcom等公司提供的目前和下一代交换机和控制器用器件将使OEM能
够开发经济实惠的数据中心网络设备


CCCC Broadcom Nicholas Ilyadis

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (20)

Semelhante a CCCC Broadcom Nicholas Ilyadis

Semelhante a CCCC Broadcom Nicholas Ilyadis (20)

Mais de Cloud Congress

Mais de Cloud Congress (8)

Último

Último (20)

CCCC Broadcom Nicholas Ilyadis