We currently do only provide custom tailered versions of WebSpider on a Professional Services basis.
Provides a framework for running your own spiders with as less effort as possible.
The WebSpider server takes care about downloading the target URL, parsing the content depending on its type and then delegates control to your code to decide what to do next with the information contained in it. Your code can easily create new jobs and place them in the server's job queue. The WebSpider Enterprise server manages this queue and distributes the jobs between multiple threads or even across multiple nodes in your network.