SlideShare a Scribd company logo
1 of 4
Image recognition using TestComplete™
                 Testcomplete™ can be used to automate testing of Web & windows applications. Although
                 TestComplete™ supports major standard controls, windows and objects in a wide variety of
                 applications, there are some controls and windows that cannot be recognized by Test
                 Complete directly. For example cells in few grid controls, buttons in some flash applications
                 may not be accessible by TestComplete™. Handling TestComplete™ during such conditions
                 makes automation little challenging.

                 It is possible to overcome these kinds of difficulties by using a low-level recording approach
                 to test such applications. The main drawback of such an approach is that the script will
                 require several changes even for a simple UI change in the application. So, creating and
                 maintaining a stable script with this method is also not possible. Low-level Recording will be
                 usually used in TestComplete™ for automating Testing in browsers other than IE and
                 Firefox. Any application that needs to be tested in other browsers (such as Google Chrome
                 or Opera) using TestComplete™ automation needs to approach low level recording
                 technique.

                 You can also look at utilizing Image recognition feature of TestComplete™. Let‟s consider a
                 test application containing a button which is unfortunately not recognized by
                 TestComplete™. In this situation, it is possible in TestComplete™ to capture the image of
                 this button and give it as an input for testing. TestComplete™ will search for this button
                 using its image & recognize the button as a rectangular image object. Now we can get the
                 position of the button and calculate X-Y coordinates of the center point of this object. By
                 getting these coordinates, the action CLICK can be performed to trigger the click action of
                 the mouse.

                 To click a button,




Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
To enter value into a Textbox




                How to find an Image in an object?

                One needs to use the method named „Regions.Find‟ inorder to find the image of object
                (which is not auto recognized by TestComplete™). Following is the syntax for this method

                         Regions.Find(PictureTosearchin, PictureToSearchFor)

                This method searches for an image on other image or object. And it returns the identified
                rectangular image object. It has two required parameters.

                         PictureToSearchin – Page or Window object, in which the object is located.

                         PictureToSearchFor – This is the image name of the Test Object. This image
                         should have been stored in Regions Items of Testcomplete™.

                Consider an example to explore usage of Image Recognition in TestComplete™. The
                following screenshot shows an Add-on that needs to be installed from Google Chrome. User
                needs to click button “Add to Chrome” inorder to install add-on from Google Chrome




Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
browser.



                Since Google Chrome is not currently supported by TestComplete™, we can make use of
                image recognition feature available in TestComplete™ to trigger the Button click action
                automated from Google Chrome browser, by identifying the position of the button and
                triggering click action on it

                     1) Store the rectangular image of this button in Region items of test complete project.
                        In the below example, Image name is stored as „Add_To_Chrome‟




                     2) To find & click this image object on chrome window, we can use the following script.




Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
3) This button clicks on the center position of the button.




                        Hence using the above script, TestComplete™ can automate the test for clicking
                        button „Add to Chrome‟ executed from Google Chrome browser. Using the same
                        method, it is possible find any unrecognized object and then can perform any actions
                        on the recognized images.




Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER

More Related Content

Viewers also liked

TestComplete 7.50 New Features
TestComplete 7.50 New FeaturesTestComplete 7.50 New Features
TestComplete 7.50 New FeaturesVlad Kuznetsov
 
social prez - mpcc - mholterhaus
social prez - mpcc - mholterhaussocial prez - mpcc - mholterhaus
social prez - mpcc - mholterhausmholterhaus
 
Keyword Driven Testing using TestComplete
Keyword Driven Testing using TestCompleteKeyword Driven Testing using TestComplete
Keyword Driven Testing using TestCompletesrivinayak
 
Web Service Testing using TestComplete
Web Service Testing using TestCompleteWeb Service Testing using TestComplete
Web Service Testing using TestCompletesrivinayak
 
Keyword-driven Test Automation Framework
Keyword-driven Test Automation FrameworkKeyword-driven Test Automation Framework
Keyword-driven Test Automation FrameworkMikhail Subach
 

Viewers also liked (6)

Test Complete
Test CompleteTest Complete
Test Complete
 
TestComplete 7.50 New Features
TestComplete 7.50 New FeaturesTestComplete 7.50 New Features
TestComplete 7.50 New Features
 
social prez - mpcc - mholterhaus
social prez - mpcc - mholterhaussocial prez - mpcc - mholterhaus
social prez - mpcc - mholterhaus
 
Keyword Driven Testing using TestComplete
Keyword Driven Testing using TestCompleteKeyword Driven Testing using TestComplete
Keyword Driven Testing using TestComplete
 
Web Service Testing using TestComplete
Web Service Testing using TestCompleteWeb Service Testing using TestComplete
Web Service Testing using TestComplete
 
Keyword-driven Test Automation Framework
Keyword-driven Test Automation FrameworkKeyword-driven Test Automation Framework
Keyword-driven Test Automation Framework
 

Recently uploaded

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 

Recently uploaded (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 

Image Recognition Automated QA - TestComplete™

  • 1. Image recognition using TestComplete™ Testcomplete™ can be used to automate testing of Web & windows applications. Although TestComplete™ supports major standard controls, windows and objects in a wide variety of applications, there are some controls and windows that cannot be recognized by Test Complete directly. For example cells in few grid controls, buttons in some flash applications may not be accessible by TestComplete™. Handling TestComplete™ during such conditions makes automation little challenging. It is possible to overcome these kinds of difficulties by using a low-level recording approach to test such applications. The main drawback of such an approach is that the script will require several changes even for a simple UI change in the application. So, creating and maintaining a stable script with this method is also not possible. Low-level Recording will be usually used in TestComplete™ for automating Testing in browsers other than IE and Firefox. Any application that needs to be tested in other browsers (such as Google Chrome or Opera) using TestComplete™ automation needs to approach low level recording technique. You can also look at utilizing Image recognition feature of TestComplete™. Let‟s consider a test application containing a button which is unfortunately not recognized by TestComplete™. In this situation, it is possible in TestComplete™ to capture the image of this button and give it as an input for testing. TestComplete™ will search for this button using its image & recognize the button as a rectangular image object. Now we can get the position of the button and calculate X-Y coordinates of the center point of this object. By getting these coordinates, the action CLICK can be performed to trigger the click action of the mouse. To click a button, Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
  • 2. To enter value into a Textbox How to find an Image in an object? One needs to use the method named „Regions.Find‟ inorder to find the image of object (which is not auto recognized by TestComplete™). Following is the syntax for this method Regions.Find(PictureTosearchin, PictureToSearchFor) This method searches for an image on other image or object. And it returns the identified rectangular image object. It has two required parameters. PictureToSearchin – Page or Window object, in which the object is located. PictureToSearchFor – This is the image name of the Test Object. This image should have been stored in Regions Items of Testcomplete™. Consider an example to explore usage of Image Recognition in TestComplete™. The following screenshot shows an Add-on that needs to be installed from Google Chrome. User needs to click button “Add to Chrome” inorder to install add-on from Google Chrome Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
  • 3. browser. Since Google Chrome is not currently supported by TestComplete™, we can make use of image recognition feature available in TestComplete™ to trigger the Button click action automated from Google Chrome browser, by identifying the position of the button and triggering click action on it 1) Store the rectangular image of this button in Region items of test complete project. In the below example, Image name is stored as „Add_To_Chrome‟ 2) To find & click this image object on chrome window, we can use the following script. Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER
  • 4. 3) This button clicks on the center position of the button. Hence using the above script, TestComplete™ can automate the test for clicking button „Add to Chrome‟ executed from Google Chrome browser. Using the same method, it is possible find any unrecognized object and then can perform any actions on the recognized images. Visit IVESIA’S WEBSITE Follow us at LINKEDIN and TWITTER