novice57
Site Admin
User is Offline
Joined: 23 Nov 2006
Posts: 390
Location: Nebraska
Posted: Wed Mar 28, 2007 10:28 pm Post subject: Be the bot · Quote · Edit · Delete · IP
--------------------------------------------------------------------------------
Did you ever do a Google or Yahoo search for a subject and click on the most promising looking link only to discover that it leads to a paid site, or a sign up page that requires registration? You can always use a throw away mail address or one of those temp address sites to register, but what about the paid sites? Why did Google return such a high rating for a paid site?
When Google or Yahoo navigate to a site they are identified as a web crawler bot and many sites will open up their full content to examination to achieve that rating when they recognize the crawler. Now you can have the advantage that Google and Yahoo web crawlers have. By copying the URL of the site and entering it at "Be The Bot" you will get the same royal treatment that the search engines enjoy. This is a feature that is coded into the sites header, so don't feel that it is hacking or illegal in any way. You are just taking advantage of the site's own deceptive practices.
http://www.avivadirectory.com/bethebot/_________________
"Right now I'm having amnesia and deja vu at the same time. I think I've forgotten this before."
Back to top · Profile · PM · Email
--------------------------------------------------------------------------------
janewm
Moderator
User is Offline
Joined: 01 Dec 2006
Posts: 1377
Location: Florida
Posted: Wed Mar 28, 2007 10:52 pm Post subject: · Quote · Edit · Delete · IP
--------------------------------------------------------------------------------
I will use hat as I had that problem recently.
Thanks for the site.
Jane
_________________
"If you cannot find the Truth right where you are, where else do you expect to find it?" Dogen
Back to top · Profile · PM · Email · WWW · MSN
--------------------------------------------------------------------------------
Rike
Site Admin
User is Offline
Joined: 23 Nov 2006
Posts: 864
Location: WA, AZ
Posted: Wed Mar 28, 2007 10:55 pm Post subject: · Quote · Edit · Delete · IP
--------------------------------------------------------------------------------
Wow, Keith, that sounds awesome. Isn't the web great: the cheater cheats the cheater who cheats the cheater with a cheater....
Thanks for the link. Very useful!
Rike
_________________
Rike
"Time is what prevents everything from happening at once."
John Archibald Wheeler -
Back to top · Profile · PM · Email · WWW
--------------------------------------------------------------------------------
Repa
Site Admin
User is Online
Joined: 26 Nov 2006
Posts: 1843
Location: North Carolina
Posted: Wed Mar 28, 2007 11:54 pm Post subject: · Quote · Edit · Delete · IP
--------------------------------------------------------------------------------
Thank you, Keith. Now I can get some answers that were only at paid sites or where you had to register to get the information.
Portal 
Subject: Be the Bot 
