Lead developer and creator of @webrecorder Passionate about web archiving technologies and open source
webarchiveplayer. NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.page for latest tool for viewing web archives directly in the browser or on the desktop.
203cdx-index-client. A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
203webarchive-indexing. Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
46browsertrix. (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automation
38pywb-webrecorder. Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io
38certauth. Simple CertificateAuthority and host certificate creation, useful for man-in-the-middle HTTPS proxy
25cc-index-server. Deployment of pywb as a CommonCrawl Index Server
22proxy-wabac. Proof-of-Concept Proxy Mode wabac.js replay
7memento-reconstruct. Cross-Archive Web Replay Using Memento
7client-replay-wayback. A test configuration for eventual client-side replay wayback deployment
7pywb-proxy-demo. Demo of pywb usage as HTTP/S Proxy for Web Replay
7pywb-warcbase. pywb support for warcbase
6warcprox. WARC writing MITM HTTP/S proxy
5warcsigner. CLI tools for signing / verifying compressed archive files with an RSA key pair.
5pywb-samples. Sample Archived Content for pywb
5pywb-ipfs. Experimental recording and replay of WARCs to/from IPFS (https://ipfs.io/)
5webrec-platform. Webrecorder Platform Components
4via. https://via.hypothes.is (pywb + hypothes.is annotations)
4earlybrowserreborn. Automatically exported from code.google.com/p/earlybrowserreborn
3spice-chrome. Experiment with OWT Chrome 60 and Spice protocol
3docker-pywb. Docker image for pywb
3pywb-ia. pywb setup for Internet Archive web archives
3ipfs-url-index. Experimental URL->CID index using b trees (chunky-trees from @mikeal)
2js-ipfs-in-memory-repo. Create an in-memory only js-ipfs repo
2stream-zip. Python function to construct a ZIP archive on the fly - without having to store the entire ZIP in memory or disk
2pywb-opensearch-cdx. Experimental module for reading CDX from OpenSearch XML
2http-range-dat. Experiment Proxying HTTP Range Requests to DAT random access
1loadzip. JavaScript
1oai-solr-tools. Webapp that supports the OAI-PMH protocol driven by a Solr index
1accordionbasstool. Automatically exported from code.google.com/p/accordionbasstool
1