search_engine_spider. This is a Django project that includes a web crawling utility using a Spider class. It allows you to crawl web pages, extract information, and store results in the database. The project also provides a Django management command to initiate the crawling process. there is also Django templates UI to allow search in the scraping data.

github.com/Eng-Elias/search_engine_spider

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.