web_crawler_framework. 一个基于Python的通用网络爬虫框架,旨在通过外部配置文件驱动,实现对不同网站和API的自动化、周期性数据采集与存储。

github.com/Choimoe/web_crawler_framework

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.