How Many Spiders Does Google Have?

1
Vote

How Many Spiders Does Google Have?

Posted by thexyz (#3) 1205 days ago (http://www.thexyz.org)

Google has posted a short but interesting video to its Webmaster Central YouTube channel. A user asked the question, "How many bots/spiders does Google currently have crawling the web?" and Google's Matt Cutts gave his answer.

"It's important to realize that it's not really actual robots or actual spiders out there...instead, it's banks of machines ...at Google's data centers who open up an HTTP connection and request a page and then get it back," he says. "So any bank of machines (even 50 machines) could easily be requesting a bunch of different content."

Discuss | Bury | Add To