Rare find

distributed-web-crawler. The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler

github.com/tonywangcn/distributed-web-crawler

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.