Hello Internet readers,
Just dropping a note to show an interesting observation! We posted this tweet on 9 Feb 2013 at 10:06am.
After the tweet, we browsed our web server log and records showed numerous bots visited our tweeted URL (our photo journal page) practically right after the tweet is posted. Amazing!
Here are a list of bots that visited us in the 1st minute.
UnwindFetchor (gnip.com) – http://gnip.com/
NING – http://ca.ning.com/
lab.topsy.com/butterfly – http://topsy.com/
TweetmemeBot/3.0 – http://tweetmeme.com
JS-Kit URL Resolver – http://js-kit.com
126.96.36.199 – http://whois.domaintools.com/188.8.131.52
RebelMouse/0.1 – https://www.rebelmouse.com/
PaperLiBot/2.1 – http://support.paper.li/entries/20023257-what-is-paper-li
In summary, here is what we learned.
In this particular case, Internet web access to our Tweeted URL (http://www.binarytaskforce.com/photojournal.php) requires 37 independent requests and roughly 270KB of data. Assuming, at least 10 bots accessing the site after a tweet is posted, that is 2.7MB. Of course, some readers will argue that these bots may not capture the entire content provided by the web server. However, this is something for all webmasters to consider when measuring bandwidth and web server performance.