Metamorphic testing-for-software-quality assessment a study of search engine
1. #13/ 19, 1st Floor, Municipal Colony, Kangayanellore Road, Gandhi Nagar, Vellore – 6.
Off: 0416-2247353 / 6066663 Mo: +91 9500218218
Website: www.shakastech.com, www.shakastech.weebly.com,
Email - id: shakastech@gmail.com, info@shakastech.com
METAMORPHIC TESTING FOR SOFTWARE QUALITY ASSESSMENT: A STUDY
OF SEARCH ENGINES
ABSTRACT:
Metamorphic testing is a testing technique that can be used to verify the functional
correctness of software in the absence of an ideal oracle. This paper extends metamorphic testing
into a user-oriented approach to software verification, validation, and quality assessment, and
conducts large scale empirical studies with four major web search engines: Google, Bing,
Chinese Bing, and Baidu. These search engines are very difficult to test and assess using
conventional approaches owing to the lack of an objective and generally recognized oracle. The
results are useful for both search engine developers and users, and demonstrate that our approach
can effectively alleviate the oracle problem and challenges surrounding a lack of specifications
when verifying, validating, and evaluating large and complex software systems
EXISTING SYSTEM:
MT does not focus on the verification of each individual output, but instead checks the
relationships among the inputs and outputs of multiple executions of the program under
test.
The present research extends metamorphic testing into a quantifiable approach for
software quality assessment, which includes, but is not limited to, the verification and
validation of software correctness.
DISADVANTAGES OF EXISTING SYSTEM:
It is imperative that search engines provide the desired result according to the queries
entered.
It is, however, extremely difficult to assess some key qualities of these search engines.
For instance, owing to the sheer volume of data on the Internet, it is very difficult to
2. #13/ 19, 1st Floor, Municipal Colony, Kangayanellore Road, Gandhi Nagar, Vellore – 6.
Off: 0416-2247353 / 6066663 Mo: +91 9500218218
Website: www.shakastech.com, www.shakastech.weebly.com,
Email - id: shakastech@gmail.com, info@shakastech.com
verify or validate the correctness of the software systems or to evaluate the accuracy and
completeness of the search results.
Also, given the obvious subjectivity of different judges, objective assessment of search
result relevance and ranking quality is very difficult.
PROPOSED SYSTEM:
We applied our approach to alleviate the oracle problem for the testing and quality
assessment of (web) search engines. Search engines are software systems designed to
search for information on the World Wide web, and are the main interface through which
people discover information on the Internet; web searching is one of the most popular
functionalities of the Internet, second only to email.
This paper addresses the above problems using MT, and consequentially demonstrates
new dimensions of the usefulness of MT. A series of empirical studies have been
conducted to compare the software qualities of four major search engines, namely,
Google (www.google.com), Bing (www.bing.com), Chinese Bing (Bing for Chinese
users, www.bing.com.cn), and Baidu (www.baidu.com).
In this paper, we present a testing approach that alleviates the difficulties in search engine
verification, validation, and quality assessment.
ADVANTAGES OF PROPOSED SYSTEM:
A search is always performed in the context of a particular scenario, and involves certain
specific functions, which are only a very small set of all functions offered by the search
engine. Therefore, the user does not need to understand the system in its entirety in order
to validate the search engine; instead, he/she only needs a testing technique that tells
him/her whether or not the few functions directly involved in the search can deliver what
he/she wants.
When the test fails, it can either indicate a fault in the implemented software system or a
deficiency in the algorithm(s) chosen by the search engine developer—for validation
purposes, the user does not need to distinguish between these two cases.
3. #13/ 19, 1st Floor, Municipal Colony, Kangayanellore Road, Gandhi Nagar, Vellore – 6.
Off: 0416-2247353 / 6066663 Mo: +91 9500218218
Website: www.shakastech.com, www.shakastech.weebly.com,
Email - id: shakastech@gmail.com, info@shakastech.com
SYSTEM ARCHITECTURE:
SYSTEM REQUIREMENTS:
HARDWARE REQUIREMENTS:
System : Pentium Dual Core.
Hard Disk : 120 GB.
Monitor : 15’’ LED
Input Devices : Keyboard, Mouse
Ram : 1GB.
SOFTWARE REQUIREMENTS:
Operating system : Windows 7.
Coding Language : JAVA/J2EE
Tool : Netbeans 7.2.1
Database : MYSQL
4. #13/ 19, 1st Floor, Municipal Colony, Kangayanellore Road, Gandhi Nagar, Vellore – 6.
Off: 0416-2247353 / 6066663 Mo: +91 9500218218
Website: www.shakastech.com, www.shakastech.weebly.com,
Email - id: shakastech@gmail.com, info@shakastech.com
REFERENCE:
Zhi Quan Zhou, Shaowen Xiang, and Tsong Yueh Chen, “Metamorphic Testing for Software
Quality Assessment: A Study of Search Engines”, IEEE TRANSACTIONS ON SOFTWARE
ENGINEERING, VOL. 42, NO. 3, MARCH 2016.