Rare find

scaleable-crawler-with-docker-cluster. a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

github.com/tonywangcn/scaleable-crawler-with-docker-cluster

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.