2. web pages already indexed Do a “site:http://domain” search in Google (leave out the quotation marks) returns a message saying “Your search - site:http://domain/ - did not match any documents” it means Google has not found any of your web pages yet
4. 1) Your Robots.txt file restricts Google bots from crawling your website. two possible reasons why your website is not yet indexed
5. Google follows whatever is in your Robots.txt file. If Google sees User-agent: * Disallow: / it will not bother to crawl in your website.
6. Explaining the Robot.txt User-agent: * “user agent” means the robots (i.e. search engine crawlers or spiders) “ * ” means all. So the first line means: “All robots” Disallow: / what is disallowed to be crawled “/” means the root directory simply means: disallow all files in the entire site.
7. To allow Google bots and other robots to crawl all your files in the root directory simply remove “/” the code should be: User-agent: * Disallow:
8. “PC Robot.txt” A WordPressplugin Allow you to edit your Robots.txt file Install the plugin and activate it
9. 2) Your website is newly built. two possible reasons why your website is not yet indexed
10. There are billions of web pages on the Internet. If there are no backlinks pointing to your web pages Google and search engines might take a while to discover your site. Image: Salvatore Vuono / FreeDigitalPhotos.net http://www.freedigitalphotos.net/images/view_photog.php?photogid=659
11. Things to do Sign-up with Google Webmaster tools submit your Sitemap URL if website is using the WordPress platform, install an XML Sitemap plugin Add your website in major search engines
12. It is recommended to do proper On-Page SEO to your web pages. When Google or other search engines crawl your website they find out as much as possible about your site.