Stack Scraper. A tool that visits websites and saves information from them, even complicated ones.

github.com/jeresig/stack-scraper

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

November 2023
  • Fix entrypoint.
  • Fix call to express.
  • Ignore tests files in the build bundle.
  • Update deps.
April 2023
  • Update libraries.
November 2017
  • Start to reimplement and modernize stack-scraper.
  • Update packages.json. Bump version.
September 2014
  • Tweak the sample scraper a bit.
August 2014
  • Add in some more overview details.
  • Add in an example scraper.
  • Add in a sample Mongoose schema and some more details about the featu…
  • Add support for && multi selectors.
  • Add in more information about the properties that you would pass in t…
  • Add in the CLI arguments and options.
  • Start to work on Readme documentation.
May 2014
  • Strip out all comments before attempting to process the HTML (to avoi…
April 2014
  • Fix missing braces.
  • Re-write merging, seems to work really well now.
  • Work-in-progress fixing deleting data from a model on update.
  • Remove extra savedFile property before saving/updating.