I've noticed that when you tweet a link, there are a number of bots that almost immediately follow the url, without subsequently loading the page assets. As an informal test, I posted a link and took a look to see how long it took them to jump on the link. The tweet had a link, but no hashtags.
Bot | Time to Act on Link in Tweet |
---|---|
MetaURI API/2.0 +metauri.com | 3 seconds |
Twitterbot/1.0 | 3 seconds |
Someone's HTMLParser/2.0 Scraper | 3 seconds |
TweetmemeBot/4.0; +http://datasift.com/bot.html | 4 seconds |
? (nslookup failed) | 4 seconds |
Google-HTTP-Java-Client/1.17.0-rc (gzip) | 4 seconds |
Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp | 4 seconds |
backend@getprismatic.com | 9 seconds |
Kraken/0.1; http://linkfluence.net/; bot@linkfluence.net | 24 seconds |
topsy.com | 30 seconds |
A sole HEAD curl from compute-1.amazonaws.com | 31 seconds |
Something from vodafonedsl.it | 43 seconds |
Something from trendmicro.com | 49 seconds |
topsy.com | 97 seconds |
Nothing big here, just curious to take a look at some of the quick watch-bots out there at the moment.
No comments:
Post a Comment