This is your work, valued
Reader in Critical Infrastructure Studies King's College London. Co-Founder @PublicDataLab. Research Associate @digitalmethodsinitiative @medialab.
data-journalism-courses. List of data journalism courses and programmes from universities and higher education institutions around the world
★ 76awesome-data-journalism. List of publicly available, free/open source and open access resources for learning and doing data journalism.
★ 68datanotfound. data not found is a dataset of datasets that were sought but not found on data portals around the world.
★ 8yt_url_analysis. Python
★ 1memespector. A simple script for using Google's Vision API that will possibly develop into an actual tool.
★ 1RankFlow. A tool for visualizing changes in ranked lists over time.
★ 1mastodon-sts. simple web app for bulk following list of accounts on mastodon: https://jwyg.github.io/mastodon-sts/
★ 1playhtml. interactive, collaborative html elements with a single data attribute
★ 448image-explorer. A set of browser-based tools for the visual exploration of image collections.
★ 2i-ching-cli. Consult the I-Ching directly from the Command Line. This app programmatically generates each hexagram using the traditional coin toss method. Developed in Javascript.
★ 21dmi_service_manager. DMI Service Manager: server to run services on request
★ 9p5.js. p5.js is a client-side JS platform that empowers artists, designers, students, and anyone to learn to code and express themselves creatively on the web. It is based on the core principles of Processing. Looking for p5.js 2.0? http://beta.p5js.org
★ 24ktrane. a lispy livecoding environment
★ 56awesome-terminal-recorder. 🎥 Curated list of outstanding terminal recording tools to enhance your CLI demonstrations and tutorials.
★ 252bearutils. Utility to process Bear notes.
★ 17portedplugins. A collection of plugins for the SuperCollider sound environment, all of which are ported / remixed from elsewhere
★ 13libdoge. wow such good doge
★ 57olm-convert. The free, open-source, online OLM convertor. Use OLM Convert online to convert an Outlook for Mac archive, that can only be opened with Outlook for Mac, to standard .html or .eml file formats, viewable in your browser.
★ 45ditherit. Vue
★ 263twitter-explorer. A framework for observing Twitter through interactive networks.
★ 75maccy-backup. tool to backup Maccy clipboard entries to a csv to keep track of your clipboard history over time
★ 22infinite-video-fall-2023. Syllabus and materials for "Infinite Video" a 10-week course at the School for Poetic Computation
★ 50opensanctions. An open database of international sanctions data, persons of interest and politically exposed persons
★ 779normality. A tiny library for Python text normalisation. Useful for ad-hoc text processing.
★ 158dhcc-toolkit. Digital Humanities and the Climate Toolkit (draft), Digital Humanities Climate Coalition (DHCC)
★ 21google-play-scraper. Simple Google Play Store scraper
★ 13yt-vid-grid. JavaScript
★ 3flowershow. 💐 Publish markdown (and html) websites, docs, wikis and websites in seconds. Integrates with your AI.
★ 1.1kKaitiakitanga-License. Repository for the development of the Kaitiakitanga License
★ 57awesome-data-journalism. List of publicly available, free/open source and open access resources for learning and doing data journalism.
★ 68urlExpander. 🌬️urlExpander is a Python package for expanding shortened links (urls).
★ 76links-as-data. This is an example of using Links as data
★ 6opendataday. Open Data Day website
★ 100pw-term. Personal terminal-like website.
★ 11terminal. Terminal style website
★ 1.6kAwesomeCSV. 🕶️A curated list of awesome tools for dealing with CSV.
★ 942marp. The entrance repository of Markdown presentation ecosystem
★ 12kn.a.g. net.art.generator ver5b
★ 7academics-on-mastodon. A list of various lists consisting of academics on Mastodon
★ 973pyktok. A simple module to collect video, text, and metadata from Tiktok.
★ 4622017-04-fake-news-ad-trackers. Data and analysis supporting portions of the BuzzFeed News article, "Fake News, Real Ads," published April 4, 2017.
★ 5youte. Command-line utility to help researchers collect video metadata from Youtube API
★ 32beepbox. An online tool for sketching and sharing instrumental melodies.
★ 1.2kmonome.github.io. HTML
★ 8norns. norns is many sound instruments.
★ 730DataPortalExplorer. Python
★ 4airbnb-data-collection. Data collection for Airbnb listings.
★ 490climate-request. A new project at Open Knowledge Foundation allowing users to request climate data.
★ 6diskonaut. Terminal disk space navigator 🔭
★ 3.1kTwitterAPI. Minimal python wrapper for Twitter's REST and Streaming APIs
★ 950twitter-carto. Mapping Twitter landscapes with networks
★ 4tv. 📺(tv) Tidy Viewer is a cross-platform CLI csv pretty printer that uses column styling to maximize viewer enjoyment.
★ 2.2kdmi-amazon-recscraper. Amazon Recommendation Scraper
★ 10placplac. TypeScript
★ 5word_cloud. A little word cloud generator in Python
★ 11kmemespector. A simple script for using Google's Vision API that will possibly develop into an actual tool.
★ 13missing-datasets. An overview and exploration of the concept of missing datasets.
★ 500oed. Extraction and Interface for Oxford English Dictionary (OED) 1st Edition
★ 23tao-te-ching. Some English interpretations of Lao Tzu's Tao Te Ching.
★ 496collectionbuilder-csv. CollectionBuilder-CSV is a "stand alone" template for creating digital collection and exhibit websites using Jekyll and a metadata CSV.
★ 42solar. Pelican theme for solar powered version of lowtechmagazine.com
★ 504pypdf. A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
★ 10ktabulator-py. Python library for reading and writing tabular data via streams.
★ 236paris-agreement-entry-into-force. Data Package of ratification status of the Paris Climate Agreement and the emissions shares used for entry into force
★ 14giant. Platform for journalists to search, analyse, categorise and share unstructured data
★ 59wwd2017. Python for social scientists: University of Amsterdam "Working with data" 2017
★ 6zotxt. zotxt: a Zotero extension for text
★ 379zotsite. Export Zotero to a stand-alone web site
★ 390gutenberg-dammit. I wanted all of plaintext Project Gutenberg in an easy-to-use format, so I made this
★ 235gutenberg-poetry-corpus. A corpus of poetry from Project Gutenberg
★ 218gutenberg. A simple interface to the Project Gutenberg corpus.
★ 333internet-as-form. JavaScript
★ 27html2text. Convert HTML to Markdown-formatted text.
★ 2.8kvideogrep. automatic video supercuts with python
★ 3.5kscrapism-spring-2022. Python
★ 88digital-gardeners. Resources, links, projects, and ideas for gardeners tending their digital notes on the public interwebs
★ 4.8kdvt. Distant Viewing Toolkit for the Analysis of Visual Culture
★ 114awesome-web-scraping. List of libraries, tools and APIs for web scraping and data processing.
★ 8ksigma.js. A JavaScript library aimed at visualizing graphs of thousands of nodes and edges
★ 12kbibliograph. A tool to create and explore bibliometrics graphs
★ 9minet. A webmining CLI tool & library for python.
★ 372google-sheets-hugo-bookmarks. JavaScript
★ 5hugo-academic-bookmarks. Bookmarks content section for the Academic theme (Hugo framework).
★ 2youtubegrep. makes supercuts from youtube searches (alpha)
★ 12youtube-comment-downloader. Simple script for downloading Youtube comments without using the Youtube API
★ 1.2kyt_url_analysis.
★ 1memespector. A simple script for using Google's Vision API that will possibly develop into an actual tool.
★ 1RankFlow. A tool for visualizing changes in ranked lists over time.
★ 1sfpc-scrapism. 7-week class at SFPC, Fall 2018
★ 85Instagram-API-python. Unofficial instagram API, give you access to ALL instagram features (like, follow, upload photo and video and etc)! Write on python.
★ 28zeeschuimer. A browser extension to collect social media data with.
★ 392misc. Repository for general purposes.
★ 4rawgraphs.github.io. RAWgraphs official website
★ 19rawgraphs-charts. A curated selection of charts provided through RAWGraphs interface
★ 130rawgraphs-core. RAWGraphs core library
★ 71climaps-platform. A global issue atlas of climate change adaptation
★ 4sprints-experiments. All the experiments made during the EMAPS sprints
★ 1OpenRefine. OpenRefine is a free, open source power tool for working with messy data and improving it
★ 12kRecipes. A gathering of digital methods recipes for research, teaching and collaborations from across the Public Data Lab.
★ 114cat. The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.
★ 400twarc-hashtags. Report on hashtags in tweet data.
★ 3twarc-cloud. An AWS-friendly wrapper for Twarc.
★ 8twarc. A command line tool (and Python library) for archiving Twitter JSON
★ 1.4kchrome-shots. A docker compose configuration that uses headless chrome with puppeteer to generate full page screenshots for a given set of urls and devices.
★ 30catalog. A simple catalog of Twitter ID Datasets
★ 28twitter-archive-utils. Tools for working with twitter archive data from Twarc or TCAT
★ 1twarc-csv. A plugin for twarc2 for converting tweet JSON into DataFrames and exporting to CSV.
★ 31getting-started-with-the-twitter-api-v2-for-academic-research. A course on getting started with the Twitter API v2 for academic research
★ 618publicbodies. A database of public bodies such as government departments, ministries etc.
★ 76opendataportalssurvey. Python
★ 5adobe-illustrator-scripts. A collection of Illustrator scripts
★ 9tabler-icons. A set of over 6100 free MIT-licensed high-quality SVG icons for you to use in your web projects.
★ 21kdmi-instascraper. A GUI for Instaloader to scrape users and hashtags with on Instagram
★ 29qstep-socialmedia. Files for the social media masterclass delivered March 2019
★ 6lecat. LE-CAT is a Lexicon-based Categorization and Analysis Tool developed by the Centre for Interdisciplinary Methodologies in collaboration with the Media of Cooperation Group at the University of Siegen.
★ 9datafreeze. Dump (freeze) SQL query results from a database into a selection of file formats
★ 92dataset. Easy-to-use data handling for SQL data stores with support for implicit table creation, bulk loading, and transactions.
★ 4.9kinstaloader. Download pictures (or videos) along with their captions and other metadata from Instagram.
★ 13kYouTube-Data-Tools. YTDT is a collection of simple tools for extracting data from the YouTube platform via the YouTube API v3.
★ 132usenet-import. Imports Usenet archives as SQLite database
★ 2tesselle. an image annotation and publication tool
★ 28code-for-research. A collaborative space for the creation, re-purposing and use of code in the context of social and cultural research.
★ 14csvw. Documents produced by the CSV on the Web Working Group
★ 169citron. A script to extract data from http://citron.virt.ch.bbc.co.uk/
★ 2minivan. Web interface for network analysis.
★ 21codespeakkit. CSS
★ 11gephi. Gephi - The Open Graph Viz Platform
★ 6.6kcomma-chameleon. A desktop CSV editor for data publishers
★ 287crowd-bib. php website for crowdsourcing of bibliographic data in various scientific fields.
★ 7gazouilleur. IRC bot for collaborative use and monitoring of Twitter
★ 19wiki. Wiki for Notes from the Influence Mappers Group
★ 7bigbang. Scientific analysis of collaborative communities
★ 158datafortaxjustice. SCSS
★ 5datapackage_pipelines_od4tj. Open Data for Tax Justice scraping pipelines and processors
★ 6various. Various single purpose scripts
★ 6dmi-tcat. Digital Methods Initiative - Twitter Capture and Analysis Toolset
★ 371sciencescape. sciencescape
★ 16controversy-mapping. Controversy Mapping Archive
★ 2drive-in. publish a simple website from a public google drive folder
★ 20manylines. Explore networks and publish narratives.
★ 52iwanthue. Colors for data scientists.
★ 688table2net. JavaScript
★ 20gazouilloire. Twitter stream + search API grabber
★ 108ricardo. RICardo Project, Historical Trade Database
★ 14graph-recipes. Online experimental network tinkering
★ 20hyphe-topic-datascape. A prototype datascape to explore the content of a Hyphe corpus where topics have been added to web pages
★ 1hyphe. Websites crawler with built-in exploration and control web interface
★ 384dataportals.org. Open Data Portals and Sites around the world
★ 169rawgraphs-app. A web interface to create custom vector-based visualizations on top of RAWGraphs core
★ 9kpdfextract. MOVED TO https://gitlab.com/crossref/pdfextract
★ 509x-cli. A command-line power tool for Twitter.
★ 5.6kfdi-tax-evasion. how big are the flows of tax evasion in foreign direct investments
★ 1aime-core. Core engine of the AIME project serving its harmonized database.
★ 15spendb. Next-gen web application for public finance data warehouses, formerly OpenSpending
★ 57d3. Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:
★ 113knomenklatura. Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources
★ 259ddjbook. Data Driven Journalism Handbook
★ 24kartograph.org. website for kartograph mapping library
★ 279kartograph.py. UNMAINTAINED! Renders beautiful SVG maps in Python.
★ 997demos. deprecated: find demos in kartograph.org website instead
★ 11pybossa. PYBOSSA is the ultimate crowdsourcing framework (aka microtasking) to analyze or enrich data that can't be processed by machines alone.
★ 760kartograph.js. UNMAINTAINED Open source JavaScript renderer for Kartograph SVG maps
★ 1.5ktextus. A toolbox and web application for working with and presenting textual material from Shakespeare to Schopenhauer, and letters to literature.
★ 148bookreader. The Internet Archive BookReader
★ 1.2k