1. Call on 01202 237799
Welcome
How Search Engine Crawlers Work
2. Call on 01202 237799
What is Search Engine Crawler?
• Website's best friend in terms of search rankings
• Known as a spider, robot, bot, crawler
• Software that scans the World Wide Web in a
systematic and automated way
3. Call on 01202 237799
Use of Web Crawling or Spidering
• Gathering information to be later indexed in central
directories
• Used for website maintenance tasks such as validating
HTML code or checking links
4. Call on 01202 237799
Main Function of a Search Provider
• Search for information on the web and in available
databases and open directories
• Operates by web crawling, indexing and searching by
using one or more spiders
• It gathers information about web pages
5. Call on 01202 237799
Different Ways of Indexing
• Search providers index all or just a part of the searched web
page
• Search companies index every word of every page their
crawlers find
• Search companies use predefined and categorized listing of
keywords determined by humans
6. Call on 01202 237799
Thank you
www.123webdesignbournemouth.co.uk
01202 23 77 99