 |
The problem most folks run into though is how do you know it is there? Some forum and blogging scripts come with better ways to track bots as they comb through your pages. What about everyone else though? Well this is where these scripts come in. All you need is to be able to parse PHP through your Web site and you too can track the Googlebot even better.
I am not totally sure who wrote these PHP scripts up first, but I have not seen it talked about many places at all. Hopefully this will a handy tool for you to use.
Easy Version
With this version of the script you need to replace the "yourdomainname.com" with your own domain name and replace "you@youremail.com" with your E-mail address.
<?
if(eregi("googlebot",$HTTP_USER_AGENT))
{
mail("you@youremail.com", "Googlebot detected on yourdomainname.com", "Google has crawled yourdomainname.com");
}
?>Expert Version
This version is a little more advanced. Here all you need to do is replace "you@youremail.com" with your E-mail address. The script will do the rest of the work. It will let you know which page date and time it was crawled as well.
<?
if(eregi("googlebot",$HTTP_USER_AGENT))
{
if ($QUERY_STRING != "")
{$url = "http://".$SERVER_NAME.$PHP_SELF.'?'.$QUERY_STRING;}
else
{$url = "http://".$SERVER_NAME.$PHP_SELF;}
$today = date("F j, Y, g:i a");
mail("you@youremail.com", "Googlebot detected on http://$SERVER_NAME", "$today - Google crawled $url");
}
?>Hopefully this will be of some use to people working on their Web sites who want to keep a better eye on where the Googlebot is looking at.
 |  | |
About the Author:
Mitch Keeler is a guy who likes to help people out in his owncharismatic and odd way. Instead of showing somebody how to dosomething, he much more enjoys having people see the problem and thesolution through his own eyes. Mitch has worked as an article andcontent writer for various Web sites around the globe.
Mitch Keeler is also a former Customer Service Director and CustomerService Manager for a large Web hosting company. Please feel free to contact Mitch or look over his impressive resume of accomplishments.
Mitch Keeler is a guy who likes to help people out in his owncharismatic and odd way. Instead of showing somebody how to dosomething, he much more enjoys having people see the problem and thesolution through his own eyes. Mitch has worked as an article andcontent writer for various Web sites around the globe. Mitch Keeler is also a former Customer Service Director and CustomerService Manager for a large Web hosting company. Please feel free to contact Mitch or look over his impressive resume of accomplishments.
Related Articles
- The Google Trap: A WarningIf you happen to use Googles proprietary meta tag: the search results pages will only display your web pages ti...
- It Really Is Simple RSSI have Googlebot coming to my site every day since a month ago I put up my first news feed, since then I have put up yet another. I never used to see Googlebot much before, so it goes to show that if you want to be noticed by the search engines, you need to put up a news-feed.
- Tracking Your Articles ProperlyWriting articles related to your business is a great way to build your link popularity and also to provide more content for your site and other sites. Not too mention its always nice when someone finds your site and uses it within their newsletter...
- The proper way to use the robots.txt fileWhen optimizing your web site most webmasters don
- The Google Sandbox ExplainedThe Google Sandbox is a metaphorical term to explain why most new websites have very poor rankings in Google Search Engine Results Pages (SERPS).
- Disabling Google And Other Search Engines From Crawling A SiteIf I disable Google to my Web site, its possible Google.com erase or drop down my Web site for his directory?
- How RSS Improve my Site Rankings?This article provides basic information about RSS feeds syndication. With this information you may decide to install the RSS feed of your content, with links, to your reader/subscribers worldwide. RSS not only better distributes your arti....
- Creating a Robots.txt fileSome people believe that they should create different pages for different search engines, each page optimized for one keyword and for one search engine. Now, if you do decide to create such pages, there is one issue that you need to be aware of...
- Title Tag Tips for SEOPicture thousands of tiny Google Robots scouring the web for relevant content to match up with millions of searches. When Googlebot finds your website, the most important information it collects, are the Page Titles.
- SEO Overhauls with CSS: If You Rebuild It They Will ComeAs an SEO one of the most common things I find when I sit down to analyze an existing web site is that it was built either a long time ago or with aging techniques. The situation is different every time, but I almost invariably find myself suggesting to the client that some coding changes are in ord...