search_engine_spider.This is a Django project that includes a web crawling utility using a Spider class. It allows you to crawl web pages, extract information, and store results in the database. The project also provides a Django management command to initiate the crawling process. there is also Django templates UI to allow search in the scraping data.