C# Web Crawler

This is an utterly pointless app that basically attempts to crawl its way around the internet. Enter a URL and it will follow any links it finds. I still need to fix a few things, but it is strangely compelling to watch.

It is now slightly more sophisticated in the way it chooses which links to follow. It will follow links from a different domain before links from the same domain. This means it tends to hit more sites, rather than getting stuck in one site.

Download the .NET 1.1 EXE, DLLs and C# source here.

Download the .NET 2 EXE, DLLs and C# source here.