Tuesday, March 21, 2006


The Eureka! moment has just occurred! I now have a spider that returns quotes from an insurance website without the need for a web browser. This will give me more than a few advantages, chief among them being:

  1. 1. A large efficiency boost as there is no pesky web-browser in the way trying to interpret what comes back from the web server

  2. 2. The ability to host spiders without needing dedicated servers - they can now be installed as dlls in a bog standard hosting account - leading to a massive cost saving!

I'm such a nerd... and thanks for the kind words of encouragement, DB!