Rare find

Scrape It Now. A tool that visits websites and saves their content as clean text files.

github.com/clemlesne/scrape-it-now

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

December 2024
  • Release —scrape-it-now v3.0.4
  • Merge branch 'develop'
  • dev: Reuse venv folder at each install
  • Release —scrape-it-now v3.0.3
  • Merge branch 'develop'
  • quality: Fix lint with new ruff version
  • perf: Move to uv from pip
  • security: Upgrade CodeQL pipeline to Ubuntu 24.04
November 2024
  • dev: Enhance debug logging
  • feat: Add option "--with-deps" to install scraping system deps
  • security: Upgrade deps
  • chore: Remove dead deps
  • Release —scrape-it-now v3.0.2
  • Merge branch 'develop'
  • quality: Code lint
  • dev: Log displays contextual data
  • chore: Delete dead code
  • Release —scrape-it-now v3.0.1
  • Merge branch 'develop'
  • fix: .env load from current path
  • fix: Version print to console
  • Release —scrape-it-now v3.0.0
  • Merge branch 'develop'
  • breaking: Deploy to PyPi instead of the executable
  • quality: Lower the chance of being fingerprinted
  • Release —scrape-it-now v2.1.3
  • Release —scrape-it-now v2.1.2
  • Release —scrape-it-now v2.1.1
  • Release —scrape-it-now v2.1.0
October 2024
  • Release —scrape-it-now v2.0.3