Where Neev can help? A few Use Cases Why Neev as an Independent Testing Partner? Capabilities Functional Testing (Web / Mobile / Cloud) Non-Functional Testing Testing Tools (Web / Mobile) Agile Testing Expertise Case Studies

1. Neev Independent Testing Services
Seeing the Forest and the Trees

2. The Agenda
• Where Neev can help? A few Use Cases
• Why Neev as an Independent Testing Partner?
• Capabilities
I.
Functional Testing (Web / Mobile / Cloud)
II.
Non-Functional Testing
III.
Testing Tools (Web / Mobile)
• Agile Testing Expertise
• Case Studies
• About Neev
• Summary

3. Where Neev can help? A few Scenarios
•
•
•
•
•
•
Pre-Release Testing: Have a release coming up in a month? Would you like an
Independent Testing Team to test the application/product thoroughly and
come back with suggestions?
Agile Test Partner: Looking for an independent testing partner that can
rigorously test your sprint increments, Sprint by Sprint, and maintain an
automated test suite at a test coverage of over 70%?
Pre-Launch Multi-Platform Mobile App Testing: Looking for a Testing partner
who understands the nuances of the Mobile Ecosystem and get your Apps
store-ready?
Long Term Testing Partner: Looking for a Testing partner that can help you get
your Regression Tests on the Cloud and run them on-demand?
Pre-Release Scale Testing: Want to test if the application can scale as per your
expectations.
Tool Centered Testing : Looking for a Testing partner specializing in tools.
Neev – A Partner for your Everyday & Mission-Critical Testing Needs

4. Why Neev as an Independent Testing Partner?
•
•
•
•
•
•
Fast Go-to-market: Hundreds of start ups have worked with Neev to go live with
their version 1.0 of their product., eg., InMobi, Redbus, Apalya Myplex.tv
Wide Expertise in Tech Ecosystems: Neev understands the Web, Mobile, Cloud
ecosystem in a way that few companies do.
Process Orientation: Strong in Agile, Scrum processes – Sprint planning,
retrospectives, product backlog grooming, etc.
Tools & Test Automation: Comprehensive experience in Test Automation and
Load Test Tools.
Strong Partnerships – A strong ecosystem of partners – Amazon Web Services,
AppDynamics, Splunk, Sauce Labs.
Strong Domain Expertise: Neev has expertise in handling Testing projects across
multiple domains - eCommerce, Mobility, Education, Healthcare, Social Media.
All Round Expertise with excellent Tools / Partners ecosystem

5. Perform
ance
Testing
Automa
tion
Testing
Regression
Tests
followed by
Sanity Testing
Neev Testing Capabilities

6. Functional Testing Capabilities at a Glance
Automated & Regression Testing
Interface & Usability Testing
SDK Testing
User Acceptance Testing
Component Testing
Manual Testing
Black Box and White box Testing
Automation/Tool based Testing
Unit Testing
Smoke/Sanity Testing
System Testing
Integration Testing
Installation Testing
Pre User Acceptance Testing
Experience across diverse Testing needs.

7. Non-Functional Testing Capabilities at a Glance
Experience across diverse Testing needs.

8. Tools Expertise for Web Application Testing
QA Activity
Tools Used
Test Management
Visual Studio 2010, Fitnesse, RedMine, Test Link
Test Automation Tools (Open
Source)
Selenium RC, WebDriver, Watir, Watij, SauceLabs, Sahi, Canoo
Functional Testing Tools (Open Fit, FitNesse, Cucumber, RSpec
Source)
Unit Testing Frameworks
JUnit, NUnit, SpringUnit, GrailsUnit Test, PHPUnit
Issue Tracking
BugZilla, RedMine, TRAC, JIRA
Code Management
CVS, Git, SVN, VSS, TFS
Build Automation
Continuum, Maven, Make, Ant, Cruise Control, Cruise Control.NET
Performance Test Tool
Apache JMeter, WebLoad
Expertise in Best-in-class Testing tools

9. Tools Expertise for Mobile Application Testing
QA Activity
Tools Used
Test Management
Redmine, testlink
Test Automation Tools
Robotium, Appium, monkeyrunner
Unit Testing Frameworks
JUnit, OCUnit
Issue Tracking
BugZilla, JIRA, Trac
Code Management
SVN, GIT
Build Automation
Hudson, ANT
Performance Test Tool
Apache JMeter, LoadRunner, memory profiling
through xcode
Expertise in Best-in-class Testing tools

10. Key Challenges & Best Practices for Mobile Testing
Key
challenges
Best practices followed
•Write unit test cases
Device diversity
•Early testing using emulators
•Create acceptance environment by prioritizing the target OS & devices
•Create automated test scripts for smoke & regression testing
•Use of paid services such as “deviceanywhere”
OS fragmentation
•Create continuous integration system
•Perform testing using various devices
Network environment
•Perform testing using WiFi, 3G network
•Perform usability testing
•Perform security testing
•Perform random testing
Mobile Testing Best Practices distilled

11. Agile Testing Expertise

12. Agile Testing Best Practices
•
•
•
•
•
•
Test Driven Development : Use of Rspec, Cucumber, Selenium, Sauce Labs, Unit Test frameworks (jUnit,
TestNG, spork and watchr) to make the code more maintainable, robust and bug free.
Continuous Integration:
– Use of Teamcity CI server to help prevent integration problems.
– Git for source control
Code Metrics and Performance benchmarks:
– Measure quality of code to provide better insights into the code quality.
– Use of tools like rubocop, rails_best_practices, metric_fu,mini_profiler and brakeman to benchmark
the page loads and optimize them to the fullest.
Agile Project Management Tools:
– Use of Agile project management tools like Redmine to track and manage our agile projects and
ensure delivery.
– Follow Scrum practices.
UI Test Automation: Use of Selenium / Sauce based Test Automation frameworks to automate end user
testing
Cloud best practices: AWS Consulting partner with a great understanding of cost drivers on the Cloud.
Agile is in our DNA

13. Agile Testing Process
Agile is in our DNA

14. Progressive Regression
Regression suite development cycle will always be one step behind the product
development cycle and it will ensure that existing product features are not
impacted by the current development.
Agile is in our DNA

15. A Typical QA Environment
Development
QA Sandbox
•Unit Testing
Manual testing of
•Features
•Bug fixes
•Patches
•Hotfixes
Regression
& Load Test
Regression test
•Features
•Components
•Functionalities
Detailed Load Test
Security Test
Pre-production
environment
Regression test with
•Existing configuration
•Existing data
Minimal Load Test
Isolation of Test Environments and Well-defined Gates
Production

16. Tools / Technologies
QA Activity
Tools Used
Test Management
Mercury Test Director, Rational Test Manager, Visual
Studio 2010, Borland Caliber RM, Quality Center,
StarTeam.
Test Automation Tools (Std / Commercial)
QTP, WinRunner, LoadRunner, Visual Studio Tests,
SilkTest, Rational Test
Test Automation Tools (open source)
Selenium, Watir
Functional Testing Tools (open source)
Fit, FitNesse, Cucumber
Unit Testing Frameworks
JUnit, NUnit, SpringUnit, GrailsUnit Test, PHPUnit
Issue Tracking
BugZilla, Rational ClearQuest, JIRA, Visual Studio TFS
Code Management
CVS, PVCS, SVN, Rational ClearCase, VSS, MS TFS, Git,
Perforce
Build Automation
Continuum, Maven, Make, Ant, Cruise Control, Nant,
Cruise Control.NET, Visual Studio TFS
Performance Test Tool
Apache JMeter, LoadRunner, Visual Studio Load
Testing, WebLoad, SilkPerformer, OpenSTA

17. Automated Testing using Selenium
and other Innovative Frameworks

18. Selenium Automation Experience
• Actively deployed Selenium as automation tool of choice across 75% of our
•
•
•
•
EDCs.(Extended Development Centers)
Strong Java/J2EE based test automation experience.
Developed our own Selenium-based automation framework using Selenium,
TestNG, jUnit, ANT integrating all best practices.
Java Developer resources assigned to Selenium development with experience
in OOAD, Agile development, etc.
Integrated Selenium into:
• Continuous Integration servers
• Build, QA and Release processes.
• Daily email alerts and notification system.
We have developed our own Selenium-based automation framework

19. Selenium + TestNG Based Automation - Key Highlights
• Modularized Test Suites and Test
•
•
•
•
Scripts with automated test bed
set up.
Backed by Selenium RC Server
for Test scripting in standard
languages like Java, Python,
Ruby.
Integrated with TestNG, Junit for
easy grouping of test suites and
test scripts.
Integration for automated build
of the entire Test Automation
Project.
Automated generation and
mailing of the HTML reports.
Automation with Selenium + TestNG
Release
Candidate

20. Innovative Testing Framework using Fitnesse, Xebium & Monkeytalk
•
The idea was to create an environment where a Business
Analyst can understand what a Test Engineer is testing
and so can the customer. To create an environment
where customers or Business Analysts should be able to
create their own acceptance test cases with little or no
help from the test engineer.
•
We found out that most of the components were
already in place and just needed a glue to fit them
together. Fitnesse, Xebium and Monkeytalk were what
we bumped into.
•
More information in our blog here.
Automation with Fitnesse, Xebium & Monkeytalk
Release
Candidate

21. Comprehensive Independent Testing Capabilities
We have invested in People, Processes, Tools & Partnerships to provide
comprehensive, ROI-oriented, Independent Testing Services that meets your
stakeholder needs

22. Case Studies

23. Case Study – AppDynamics EDC
An Application Performance Management Product
•
AppDynamics is an application performance measurement tool,
monitoring JVM's(Java) and CLRs(.NET) in production.
•
Supports applications across a wide range of technologies and platforms.
•
The solution helps to reduce mean-time-to-resolution by up to 90%.
•
Started in 2008 in California, AppDynamics is a funded start-up.

24. AppDynamics EDC - The Customer Need
Performance Testing
Functional Testing
• The Product's one of the many USP's is the very low
overhead(2%). Measurement of the performance of any
new build is immensely important.
• The product has to support applications on a
combination of technologies. Each and every
functionality need to be tested before the release.
Automation Framework
Development
• A large pool of test cases has been created till date. An
automation framework has to be developed that will
incorporate testing on these test cases.
Proof of Concept
Applications
• To gain confidence of the customer, a proof of concept
demonstrating the capabilities of the product has to be
created.

25. AppDynamics EDC - The Solution … (1)
Performance Testing
• The Product's one of the many USP's is the very low
overhead it has(2%). Measurement of the performance
of any new build is immensely important.
Automation Framework
Development
• The product has to support applications on a
combination of technologies. Each and every
functionality need to be tested before the release.
Neev created an automation
framework that is used to obtain the
•overhead addedtestagents has been created till date. An
A large pool of by cases running
on JVM’s and CLR’s.
automation framework has to be developed that will
incorporate testing on these test cases.
Proof of Concept
Applications
• To gain confidence of the customer, a proof of concept
demonstrating the capabilities of the product has to be
created.
Functional Testing

26. AppDynamics EDC -The Solution …. (2)
Performance Testing
Functional Testing
• The Product's one of the many USP's is the very low
overhead it has(2%). Measurement of the performance
of any new build is immensely important.
• The product has to support applications on a
combination of technologies. Each and every
functionality need to be tested before the release.
• A large pool of test cases has been created till date. An
Neev
applications
a
Automation Framework created test framework has using developed that will
to be
combination automation
of technologies. These applications
Development
incorporate testing on these test cases.
are employed on a daily basis to perform a
rigorous test on the product features. For
instance, an To gain confidence ofJava customer, a proof of concept
• application to test the Messaging
Proof of Concept
Service, which would run onthe capabilities of the product has to be
demonstrating Jboss with Cassandra
Applications back-end created.
as

27. AppDynamics EDC - The Solution …. (3)
• The Product's one of the many USP's is the very low
A section
focused on
overhead
Performance Testing of Neev teamitishas(2%). Measurement of the performance
building a framework, which iswould
of any new build immensely important.
facilitate the automation of test cases.
This brought down the sanity &
• The product has to support applications on a
regression testing period significantly.
combination of technologies. Each and every
Functional Testing
functionality need to be tested before the release.
Automation Framework
Development
• A large pool of test cases has been created till date. An
automation framework has to be developed that will
incorporate testing on these test cases.
Proof of Concept
Applications
• To gain confidence of the customer, a proof of concept
demonstrating the capabilities of the product has to be
created.

28. AppDynamics EDC - The Solution …. (4)
Performance Testing
• The Product's one of the many USP's is the very low
overhead it has(2%). Measurement of the performance
of any new build is immensely important.
Neev develops an application specific to a
potential • The product has to support applications on a
customer. The idea is to simulate
the
combination of technologies. Each
Functional Testing production environment of the and every
customer, functionality need to be tested before the release.
and then demonstrate the
product's prowess and capabilities in that
environment.
of test cases has
Automation Framework • A large pool framework has tobeen created till date. An
automation
be developed that will
Development
incorporate testing on these test cases.
Proof of Concept
Applications
• To gain confidence of the customer, a proof of concept
demonstrating the capabilities of the product has to be
created.

29. AppDynamics EDC - A typical day for the Neev team
Performance
Testing
POCs as
& when
required
Automation
Testing
Regression Tests
followed by Sanity
Testing

30. AppDynamics EDC - Our journey so far …

31. Case Study – eMids
Selenium Automation Intervention
eMids was looking for QA partner to automate Regression Tests for an application which they
were developing for a reputed health-care organization.

Constraints – Cost, Improve Coverage, Reduce turnaround time, Predictable build quality,
Scalable framework, Reliable regression test runs.

Neev deployed its Selenium framework with Java / TestNG for automation which was
completely Open Source compared to other solutions which were License based.


Neev covered all the 7 modules of the application by automating more than 300 test cases.

In the process of automation Neev uncovered more than 30 new bugs.
The process improved the turn around time of QA and in return improved the productivity by
60%.

No. Of Modules
No. of Test Cases
Time to
Automate
Duration of Automated
Test Run
7
300+
4 weeks
50 mins

32. eMids EDC Team Structure
Offshore
Onsite
Project
Sponsor
(Client)
Project
Manager
Onsite
Project
Coordinator
QA Lead
QA 1
(Selenium)
QA 3
(Selenium)
QA 2
(Selenium)
QA 4
(Selenium)

33. Case Study – eMids
Key Challenges
•
Short Term Intervention Program


Application was in production. No major feature changes were expected. Customer wanted to reduce
the periodic regression test cycle time by at least 50%.

•
Focused Short Term Regression Test Automation intervention program.
7 key modules were identified. Close to 300 test cases were automated within a short period of time.
No documentation


•
Detailed Documentation of the application feature description was not available.
For the 7 modules identified as candidates for automation, the team performed a thorough analysis
and documented all key test cases. The test cases and scenarios were signed off by the customer.
Zero Prior Automation

As there were no automated cases, the team started by developing an Automation Framework using
Selenium and jUnit, that can be flexible, extensible and maintainable.

Test Cases were organized into a comprehensive suite which can be triggered using an ANT target
during build time. Thus, every time a new build was generated, the entire automation suite was
executed and the results were recorded and analyzed.

34. Cloud-based Mobile Testing for Tripflick
Solution Highlights
• 'TripFlick' is a Singapore-based tourist
information services company aspiring to
become a global leader in the information
services market for the tourism industry.
• Perfecto Mobile is a global provider of cloudbased testing, automation and monitoring
solutions for mobile applications and websites
utilizing a wide selection of REAL and emulated
mobile devices.
• The mobile market is extremely fragmented
and dynamic. At any point in time, there are
dozens of devices which are relevant to the
target market. Thus, we had to test on a
number of devices.
• Neev utilized services of Perfecto Mobile for its
client 'TripFlick' to ensure the quality of their
mobile app before launching.
• Neev integrated services of Perfecto mobile for
'TripFlick' and tested Tripflick app in 30+
Devices.

35. Testing a Data Encryption Software to Perfection
Solution Highlights
• The client, based in the US, is a provider of data
encryption solutions for customer-sensitive data.
It has provided security solutions to many
Fortune 1000 companies.
• The encryption software was complex and had
multiple features and ran on multiple versions of
databases
and
operating
systems.
Comprehensive, efficient and “streamlined”
automation test scripts were required for
debugging.
• 11 different flavors of Microsoft Windows
OS, more than 30 versions of SQL, FoxPro, MSAccess Databases and 8 different algorithms were
used by Neev in the rigorous testing of the
encryption software. These scenarios were then
translated into automation test scripts which
simulate actual user experience. Neev modified
the test scripts so that the dynamic parameters
were isolated in a separate script and the actual
functionality retained in the main script.

36. About Neev
Web
Mobile
Magento eCommerce
SaaS Applications
Video Streaming Portals
Rich Internet Apps
Custom Development
iPhone
Android
Windows Phone 7
HTML5 Apps
Cloud
AWS Consulting Partner
Rackspace
Joyent
Heroku
Google App Engine
Key Company Highlights
250+ team with
experience in managing
offshore, distributed
development.
Neev Technologies
established in Jan ’05
User Interface Design and User Experience Design
VC Funding in 2009 By
Basil Partners
Performance Consulting Practices
Part of Publicis Groupe
Quality Assurance & Testing
Outsourced Product Development
Member of NASSCOM.
Offices at Bangalore and
Pune.

37. Neev Project Methodology
Project Management Tools
Redmine
Jira/Trac
Deployment Tools
Jenkins
Emma/Cobertura
QA Tools
Selenium
Jmock
Knowledge Capture Tools
Neev Hub
QA to Staging to Production
environments
Daily Stand-ups

38. The Neev Edge
• End-to-end
consultative
approach
for
software
solutions
through
needs
assessment, process consulting and strategic advice.
• Internal QMS are ISO 9001-2008 certified and CMM level 3 compliant.
• Continuous process and service level improvements through deployment of best-ofbreed processes and technologies.
• International Standards and best practices on Project Management including PMI, ISO
and Prince-2.
• Proven EDC Model of delivery to provide predictable results.
• Scrum based Agile development methodology.

39. A few Clients

40. Partnerships

41. sales@neevtech.com
Neev Information Technologies Pvt. Ltd.
India - Bangalore
India - Pune
The Estate, # 121,6th Floor,
#13 L’Square, 3rd Floor
Dickenson Road
Parihar Chowk, Aundh,
Bangalore-560042
Pune – 411007.
Phone :+91 80 25594416
Phone : +91-64103338
For more info on our offerings, visit www.neevtech.com