Umeng & Testin China Mobile Internet Market Insight Report 2012: Android Device Usage & Testing Trends

1. China Mobile Internet Market
Android Usage & Testing Trends
Insight Report 2012
January 2013

2. Key Findings
Entire year of 2012:
 Only 3 of the Top 10 Android devices in 2012 are included in the Top 10 devices
tested by app developers that year.
 The most common resolutions are also the most tested.
 The large variety of screen sizes still presents developers with a challenge,
highlighting the complexity of compatibility testing.
Second Half of 2012:
 App developers remain focused on testing compatibility with older OS versions,
despite significant growth in new Android versions distribution.
November 2012:
 Errors occur more in newer and less tested OS versions.
 Top Android devices display high error rates. Only 15% of problematic devices are
among those most tested by app developers.

3. 1 2012 Device & Testing Trends

4. Top 20 Android devices in 2012 & which are also the most tested
 5 of the top 20 Android devices in 2012, also entered the list of top 10 devices tested by
app developers that year.
 Out of the top 10 devices, only 3 are among those most tested.
Top 20 Android Devices 2012
Xiaomi One Plus 2.42%
Samsung GT-S5830 2.13%
Samsung GT-I9100 2.06%
Huawei C8650 1.65%
Top HTC Incredible S 1.64%
10 Samsung GT-I9300 1.44%
Huawei C8812 1.36%
ZTE U880 1.28%
Motorola MB525 1.10%
Samsung GT-S5830i 1.08%
Lenovo A60 1.05%
Sony Ericsson LT18i 1.02%
ZTE V880 0.96%
HTC Desire S 0.95%
Samsung GT-I9100G 0.87%
Samsung GT-S5660 0.84%
Samsung GT-N7000 0.77% Included in Top 10 devices tested by
app developers
Xiaomi 1S 0.74%
Xiaomi-MI-ONE1 0.72%
Samsung GT-i9220 0.69% Data Source： www.umeng.com

5. Top 10 Android devices tested by app developers in 2012
The 10 devices most tested by app developers, mostly rank within the top 40 Android
devices for 2012.
* The same device may be tested multiple times to ensure app compatibility with different OS versions.
Top 10 Devices Tested by App Developers 2012
17 Samsung GT-N7000
三星GT-N7000 2.16%
11 联想A60
Lenovo 2.13%
8 中兴U880
ZTE U880 2.09%
26 魅族M9
Meizu M9 1.99%
Samsung i9000
三星i9000 1.89%
31
40 HTC A510e 1.76%
37 Samsung i9250
三星i9250 1.72%
>100 摩托罗拉ME860
Motorola ME860 1.71%
1 小米M1
Xiaomi M1 1.49%
Ranking by Umeng
device data
5 HTC S710e 1.26%
Data Source: www.iTestin.com

6. Brand market share highly effects app developers testing choices
Android users and app developers followed big brands such as Samsung, HTC, Huawei,
Motorola & Lenovo in 2012. Over 1.5 million tests were run in 2012 on Samsung, HTC &
Motorola devices.
Android Brand Distribution 2012 Tested Devices Brand Distribution 2012
三星
Samsung 三星
Samsung
HTC
HTC HTC
Samsung,
华为
Huawei 摩托罗拉
Motorola
Samsung, [值]
联想
Lenovo 联想
Lenovo
[值]
other, 25.3% 中兴
ZTE HTC, 17.0% 中兴
ZTE
other, 58.9%
摩托罗拉
Motorola 索爱 Ericsson
Sony
OPPO, 2.2% 小米
Xiaomi Motorola, [值] 华为
Huawei
HTC, 13.5%
Coolpad, [值]
索爱 Ericsson
Sony OPPO
Sony Ericsson,
酷派
Coolpad lenovo, [值]
[值] Huawei, [值] 酷派
Coolpad
Meizu, [值]
Xiaomi, [值] OPPO
OPPO Meizu
魅族
ZTE, [值]
Coolpad, [值]
Motorola, [值] Lenovo, [值] other
Other Sony Ericsson, other
other
OPPO, 6.0%
ZTE, [值] Huawei, [值] [值]
Data Source: www.umeng.com Data Source: www.iTestin.com

7. Second half of 2012:
Significant growth in Android 4.0 market share, most tests still target older versions.
 By Nov. 2012 Android 4.0 (ICS) reached a market share of 32%. At the same time, only 16% of tests
targeted devices running Android 4.0 or above.
 29% of tests targeted devices running versions 2.1 & 2.2 which only have 11% market share.
 App developers should spend less resources on older less used versions and focus on newer ones.
Android Users OS Version Distribution App Testing OS Version Distribution
July-Nov 2012 July-Nov 2012
Android 2.1 Android 2.2 Android 2.3 Android2.1 Android2.2 Android2.3
Android 4.0 Android 4.1 other Android4.0 Android4.1 other
100% 100%
90% 90%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20%
20%
10%
10%
0%
0%
July
7月 August
8月 September
9月 October
10月 November
11月 July August September October November
7月 8月 9月 10月 11月
Data Source: www.umeng.com Data Source: www.iTestin.com

8. Most common resolutions are also the most tested in 2012
 Devices with resolutions 480*800 and 320*480 were the most common and also the most tested
in 2012.
 240*320 devices experienced a decrease, while 1280*720 devices showed an increase in market
share. (these latter devices are not displayed in the testing data as they are equipped with a self-
testing function and not widely represented on the Testin platform).
Distribution by Resolution
854*480 320*240 1280*720
other 480*320 800*480
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
2012年3月2012
Mar. 2012年7月
Jul. 2012 Nov.2012年11月
2012
Data Source: www.umeng.com Data Source: www.iTestin.com

9. 4.0 Inch is the most commonly tested screen size in 2012
According to over 5 million tests run by Testin, 4.0 inch is the most commonly tested screen
size. However, as evidenced in the large variety of screen sizes, fragmentation still presents
developers with a challenge in compatibility testing.
3.3 inch
3.4 inch
4.2 inch
3.6 inch
10.1 inch
3.1 inch
2.8 inch
4.5 inch
3.8 inch
3.0 inch
Other
7.0 inch
3.7 inch
4.3 inch
3.2 inch
3.5 inch
Data Source: www.iTestin.com
4.0 inch

10. 2 Error Analysis & Testing Trends Nov. 2012

11. November 2012:
Top Android devices display high error rates. Only 15% of problematic devices are among
those most tested by app developers.
 55% of the top 20 Android devices for Nov. 2012 displayed the highest error rates that month.
 Only 15% of devices with highest error rates are among those most tested by app developers.
Devices with highest error rates Nov. 2012 Top 20 devices tested Nov. 2012
Samsung 三星GT-I9300
GT-I9300 ZTE U880
中兴U880 1.21%
3.82%
Samsung 三星GT-I9100
GT-I9100 Samsung CT-I9108
三星GT-I9108 1.04%
3.68%
Xiaomi MI-ONE Plus Samsung GT-S5830
三星GT-S5830 0.98%
小米MI-ONE Plus 2.49%
Samsung GT-I9100G Samsung GT-I9000
三星GT-I9000 0.92%
三星GT-I9100G 2.14%
Huawei华为C8812
C8812 Samsung I9023
三星I9023 0.91%
2.13%
Samsung 三星GT-N7000
GT-N7100 Motorola XT800
摩托罗拉XT800 0.91%
2.10%
Xiaomi 1S HTC A510e
HTC A510e 0.89%
小米1S 1.60%
Samsung CT-I9108 Samsung GT-I9003
三星GT-I9003 0.89%
三星GT-N7100 1.48%
HTC Incredible S Samsung 三星GT-I9008L
GT-I90008L 0.89%
三星GT-I9108 1.40%
Sony Ericsson LT26iS Motorola ME525+
摩托罗拉ME525+ 0.87%
HTC Incredible 1.37%
Meizu MX HTC Z715e
HTC Z715e 0.86%
索爱LT26i 1.22%
Samsung GT-I9220
摩托罗拉A953
Motorola A953 0.86%
魅族MX 1.18%
摩托罗拉MT870
Motorola MT870 0.86%
Meizu M9
三星GT-I9220 1.17%
三星GT-N7000
Samsung GT-N7100 0.85%
Sony Ericsson LT18i
魅族M9 1.09%
摩托罗拉Droid2 Global
Motorola Droid2 Global 0.83%
Xiaomi MI-ONE C1
索爱LT18i 1.07%
三星I589
Samsung I589 0.83%
Meizu M032
小米MI-ONE C1 0.92%
摩托罗拉ME860
Motorola ME860 0.82%
Samsung 魅族M032
Galaxy 0.85%
三星GT-S5570
Samsung GT-S5570 0.82%
Nexus
三星Galaxy Nexus 0.84%
华为T8300
Huawei T8300 0.82%
Samsung三星GT-S5830i
GT-S5830 0.80%
三星GT-I9100
Samsung GT-I9100 0.80%
Samsung 三星GT-I9308
GT-I9308 0.80%
Data Source: www.umeng.com Data Source: www.iTestin.com

12. November 2012:
Higher error probability in newer OS versions
 Android version market share distribution, compared with error percentage analysis, shows higher
error probability in version 4.0 and above.
 Version 4.1 with only 2.3% market share accounts for 4.8% of all errors, while version 4.0 with 29.4%
market share accounts for as much as 34.9% of all errors.
Error Percentages by Market Share Distribution Error Percentages by Android Version
2.3 4.0 2.2 4.1 2.1 other
2.1 4.1 2.2 4.0 2.3
2.1, 1.2% other, 1.4%
60.0%
4.1, 4.8%
2.3
2.2, 6.2%
Error Percentage
40.0%
4.0
20.0%
4.1
2.2 4.0, 34.9% 2.3, 51.5%
0.0% 2.1
0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0%
Market Share Distribution
Data Source: www.umeng.com Data Source: www.umeng.com

13. November 2012: Android Devices with highest error rates
Summary of Android devices with highest error rates in Nov. 2012, with error percentages by version.
App developers can refer to this list for making better informed decisions on which devices and version to
focus on, in their application testing process.
Error Percentages for Android Version 2.3 4.0 4.1
Samsung GT-I9300 8.1% 23.5%
Samsung GT-N7100 26.3%
Xiaomi MI 1S 6.4%
Xiaomi MI-ONE Plus 3.7% 2.4%
Huawei C8812 3.8%
Sony Ericsson LT26i 2.6%
Sony Ericsson LT18i 2.4%
Samsung GT-I9100 2.4%
Samsung GT-S5830i 2.2%
Samsung GT-I9308 2.0%
HTC T328w 1.9%
Samsung GT-S5830 1.8%
Huawei C8650 1.7%
Xiaomi MI-ONE C1 1.4%
Samsung GT-N7000 1.4%
Lenovo A60 1.3%
HTC Incredible S 1.3%
Lenovo A65 1.1%
Data Source: www.umeng.com

14. About this Report
 Definition of Terms
Devices: All devices in this report refer to active devices covered by Umeng
platform that has launched at least one app session within the stipulated time
frame.
 Release Date
January 2013
 Data Sources
1. Over 65,000 Mainland Android & iOS apps from Umeng platform. Data was
collected between the period of Nov. 2011 and Nov. 2012.
2. Over 5 million tests run on 321 market leading Android devices hosted on the
Testin platform between Nov. 2011 to Nov. 2012.
 Statement
Above data belongs to Umeng & Testin platforms. It is for reference only and does
not constitute investment or purchase advice. The information can be used free of
charge provided that Umeng & Testin are quoted as the original source.

15. Umeng & Testin Product Overview
 Umeng Analytics Platform
Umeng App Analytics Platform is the leading and largest provider of mobile app
analytics and developer services in China. Umeng offers enterprise-class analytics
to thousands of mobile app developers in over 65,000 apps across iOS, Android
and Windows Phone platforms.
 Testin
Testin is a cross platform provider of cloud based automated testing solutions,
aimed at companies and app developers worldwide. Our cloud platform offers a
wide selection of global or market-specific REAL devices accessible for testing
online. With literally thousands of Android and iOS devices on the market, testing
is a time consuming and often expansive task. Testin presents a cost-effective and
time-efficient solution to device fragmentation. With just a few clicks developers
can test mobile apps and games in real time on hundreds of handsets and tablets,
of all versions and screen sizes, thru different locations and networks. For every
app tested we provide a detailed report, including screenshots, logs and
performance statistics, enabling developers to see how their app runs, find the
problems before the users and release the best app to the market.

16. Umeng, a Beijing-based startup founded in April 2010, is the leading and
largest provider of mobile app analytics and developer services platform in
China. Umeng offers enterprise-class analytics to over 65,000 apps across
iOS, Android and Windows Phone platforms. Umeng has since raised more
than USD10 million from Matrix Partners and Innovation Works.
The team is working around the clock to build better solutions for mobile
app developers.
www.umeng.com
report@umeng.com

17. Testin is the first cross platform provider of cloud based automated testing
solutions, aimed at companies and app developers worldwide. Tesin received an
investment of more than 10 million dollars from IDG VC in 2011, then
participated in Microsoft cloud accelerator in Jul. 2012 and IBM GEP in Aug. 2012.
In Nov. 2012, Testin completed 5 million automated app tests on real devices for
mobile internet app developers and companies, including most domestic large
third party app markets, testing every app used by Chinese smart phone clients.
Testin’s partners and clients include Intel, Umeng, Youku, LG, Lakala ,Lenovo etc.
Testin has recently launched the international Testin platform, supporting global
as well as market specific devices, and providing cost effective & efficient testing
solutions to app developers and publishers worldwide.
info@itestin.com
www.iTestin.com
@iTestin