Foo - Google "Spiders"

Bikeforums.net is a forum about nothing but bikes. Our community can help you find information about hard-to-find and localized information like bicycle tours, specialties like where in your area to have your recumbent bike serviced, or what are the best bicycle tires and seats for the activities you use your bike for.



PDA

View Full Version : Google "Spiders"

DnvrFox
02-28-04, 07:36 PM
If you click on the ## Currently Active Users (http://64.191.20.129/online.php?) at the bottom of the main page, it brings up a list of what everyone is viewing. There are always 5 or more Google "Spiders" lurking in the neighborhood.

So, you web experts, what do they do (I assume they are giving information to Google on topics, etc.), how come so many? and it would seem that Google must have millions of these things sneaking around the web if 5 are located in just this one site.

I also see a few spiders from other search engines at times.

spazegun2213
02-28-04, 08:01 PM
try this
http://www.searchengineworld.com/spiders/google.htm
DnvrFox
02-28-04, 08:14 PM
As I type this, there is a "Google Spider" viewing the thread "Google Spiders"

Eerie!

cycletourist
02-28-04, 09:32 PM
Search engine spiders used to crash my old forum. They would show up to index the whole site, following every link in order to index all the content, and get lost in a never ending loop of links that led back and forth within the same pages till it bogged down the server and CRASH. I eventually devised a work-around that solved the problem.
Guest
02-28-04, 10:44 PM
As I type this, there is a "Google Spider" viewing the thread "Google Spiders"

Eerie!

It's also eerie that you're sitting here on a Saturday night pondering this...

;) :D

Hehehehehehehe...

:lol:
Chris L
02-29-04, 02:03 AM
It's also eerie that you're sitting here on a Saturday night pondering this...

It's even more eerie that the time next to the above post says 3.44pm. I know you guys are having winter right now, but they must be short days, particularly in view of the fact that we're only a couple of weeks from the equinox!
Guest
02-29-04, 04:07 AM
Nah... packing dude... just packing. I can't ever get out on time, and I can't ever seem to finish packing until I leave out. :(

Koffee
Chris L
03-03-04, 02:28 AM
How Ironic. I just had a quick cursory glance of "Who's Online". There was a Google Spider viewing this very thread. I'm almost (but not quite) tempted to now go and do a google search for "Google Spider" and see what comes up. :p
Joe Gardner
03-03-04, 07:48 AM
Not only do the Google spiders index the content for the google search engine, a good portion of the google spiders that are constantly online, and matching the adwords to the threads. You can tell the difference between the two by there IP addresses.