After you post that tweet!!!

Hello Internet readers,

Just dropping a note to show an interesting observation! We posted this tweet on 9 Feb 2013 at 10:06am.

https://twitter.com/BinaryTaskforce/status/300304788782985218

After the tweet, we browsed our web server log and records showed numerous bots visited our tweeted URL (our photo journal page) practically right after the tweet is posted. Amazing!

Here are a list of bots that visited us in the 1st minute.

Twitterbot

UnwindFetchor (gnip.com) – http://gnip.com/

NING – http://ca.ning.com/

lab.topsy.com/butterfly – http://topsy.com/

TweetmemeBot/3.0 – http://tweetmeme.com

JS-Kit URL Resolver – http://js-kit.com

166.90.142.9 – http://whois.domaintools.com/166.90.142.9

RebelMouse/0.1 – https://www.rebelmouse.com/

PaperLiBot/2.1 – http://support.paper.li/entries/20023257-what-is-paper-li

In summary, here is what we learned.

In this particular case, Internet web access to our Tweeted URL (http://www.binarytaskforce.com/photojournal.php) requires 37 independent requests and roughly 270KB of data. Assuming, at least 10 bots accessing the site after a tweet is posted, that is 2.7MB. Of course, some readers will argue that these bots may not capture the entire content provided by the web server. However, this is something for all webmasters to consider when measuring bandwidth and web server performance.

Cheers

Team BTF.

Leave a Reply

Your email address will not be published. Required fields are marked *