twitter上面的链接google不来爬啊

金关村村长

184.72.46.206 - - [26/Jul/2011:18:30:05 +0800] HEAD /technology-09-93892.html HTTP/1.1 200 0 - Mozilla/5.0 (X11; U; Mac OSX; it; rv:1.9.0.7) Gecko/2009030422 Firefox/3.0.7 -
166.90.142.9 - - [26/Jul/2011:18:30:05 +0800] GET /technology-09-93892.html HTTP/1.1 200 15476 - Voyager/1.0 -
50.18.121.47 - - [26/Jul/2011:18:30:05 +0800] HEAD /technology-09-93892.html HTTP/1.1 200 0 - Mozilla/5.0 (X11; U; Mac OSX; it; rv:1.9.0.7) Gecko/2009030422 Firefox/3.0.7 -
199.59.149.166 - - [26/Jul/2011:18:30:05 +0800] GET /technology-09-93892.html HTTP/1.1 200 6590 - Twitterbot/1.0 -
204.236.161.173 - - [26/Jul/2011:18:30:05 +0800] GET /technology-09-93892.html HTTP/1.1 200 15476 - JS-Kit URL Resolver, http://js-kit.com/ -
204.236.254.109 - - [26/Jul/2011:18:30:07 +0800] HEAD /technology-09-93892.html HTTP/1.1 200 0 - PostRank/2.0 (postrank.com) -
199.59.149.10 - - [26/Jul/2011:18:30:09 +0800] HEAD /technology-09-93892.html HTTP/1.1 200 0 - Twitterbot/0.1 -

发了大约一百条，来爬的爬虫有twitterbot还有不知名的或者可能采集者的bot

google的没来










twitter刺激收录？怎么我的不行，娘亲的

hepac

"

你已被识别为SPAMMER

qianli

你sb了吧