Rare find

markdown-crawler. A multithreaded πŸ•ΈοΈ web crawler that recursively crawls a website and creates a πŸ”½ markdown file for each page, designed for LLM RAG

github.com/paulpierre/markdown-crawler

Vaya's read on this project

Problem, audience, market, and the verdict β€” sign in to see it.

Updates

No recent activity.