How to crawl a website from C# asp.net

http://www.codeproject.com/Articles/13486/A-Simple-Crawler-Using-C-Sockets

http://www.thecodinghumanist.com/Content/HowToWriteAWebCrawlerInCSharp.aspx

http://keyoti.com/kb/Default.aspx?ToDo=view&questId=70&catId...