The WebCrawler Sample

Links: Up

The F# code in script.fsx shows how to interactively crawl the web. Fetch requests can have delays (latency). The script shows how to generate fetches both synchronously and asynchronously.