Personal Information
Organização/Local de trabalho
China China
Cargo
Engineer / Big Data Arch / Hadoop / Spark / HBase / Kafka / Flume
Setor
Technology / Software / Internet
Site
http://luoli523.com
Sobre
Taobao's hadoop cluster started at 2008,when the alibaba group started to realize that the big data might be very important in the future. The team established in 2008 and Li is the first batch of employees. The hadoop cluster named as Yunti,which means scaling ladder in English.
The Yunti hadoop cluster started with the hadoop version of 0.19.1 and the scale was 200 nodes at the beginning in 2008. Five years later, in 2013, the cluster's scale is now 10000 nodes with 200PB data after compressed and erasure coded.
The Version of yunti is still 0.19.1, but with about 800 patches on it in the svn of taobao. Li is the leader of the hadoop development team and hands-on improve most the ha...
Marcadores
bigdata
hadoop
flink
hadoop alibaba yunti
hdfs namenode namespace ha
hadoop namenode cross datacenter
Ver mais
Apresentações
(4)Gostaram
(1)Advanced Hadoop Tuning and Optimization - Hadoop Consulting
Impetus Technologies
•
Há 14 anos
Personal Information
Organização/Local de trabalho
China China
Cargo
Engineer / Big Data Arch / Hadoop / Spark / HBase / Kafka / Flume
Setor
Technology / Software / Internet
Site
http://luoli523.com
Sobre
Taobao's hadoop cluster started at 2008,when the alibaba group started to realize that the big data might be very important in the future. The team established in 2008 and Li is the first batch of employees. The hadoop cluster named as Yunti,which means scaling ladder in English.
The Yunti hadoop cluster started with the hadoop version of 0.19.1 and the scale was 200 nodes at the beginning in 2008. Five years later, in 2013, the cluster's scale is now 10000 nodes with 200PB data after compressed and erasure coded.
The Version of yunti is still 0.19.1, but with about 800 patches on it in the svn of taobao. Li is the leader of the hadoop development team and hands-on improve most the ha...
Marcadores
bigdata
hadoop
flink
hadoop alibaba yunti
hdfs namenode namespace ha
hadoop namenode cross datacenter
Ver mais