orbweaver. A simple webcrawler, orbweaver prints out the URLs it finds on your site, crawling pages in parallel for speed. Can also simulate many separate website visitors at once, as a load-testing tool.

github.com/boutell/orbweaver

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.