Jason Michael Baumgartner

api. Pushshift API

telegram. Pushshift Telegram Ingest

tiktok. Module to access TikTok Private API

reddit_sse_stream. A Server Side Event stream to deliver Reddit comments and submissions in near real-time to a client.

zreader. Read compressed NDJSON .zst files easily

rinzler. A high performance indexing and search system for managing big data

Parallel-NDJSON-Reader. Parallel NDJSON Reader for Python

Reddit-Bot-Detector. Script to extract highly probable bots for further analysis

imdb_to_json. Fetch movie data from IMDB and output in JSON format.

tradier. Tradier API Examples

google_bigquery.

trump_tweets. Code example and data for all available Trump Tweets

python-zstandard-compression-test. Python script to test the zstandard module

token_manager. Code to handle multiple Twitter user access tokens when making requests

ndjson_processor. High Speed multiprocessing ndjson processor

tiktok-scraper. TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.

US_Election_Data. Code to grab election data from CNN's election data API

extract_json_from_html. This script will make it much easier to extract a JSON object from HTML (e.g. getting Tiktok data)

gab_mastodon. Ingest scripts and Elasticsearch Mapping for Gab's new Mastodon Site

Big-Data-Scripts. Miscellaneous Python and Perl Scripts for working with Big Data files that are new-line delimited JSON Objects

tweet-id_components. Go program to extract tweet id components

Docker-Reddit-Sphinxsearch. Docker container for sphinxsearch -- used for adding Reddit comments for search

snowflake2time. Converts twitter snowflake ids to UTC timestamps (unix epoch seconds or milliseconds) and back in php and python

ps_proxy_manager. Pushshift Proxy Manager

realdonaldtrump. Archive of tweets from the @realdonaldtrump Twitter account

ap_story_fetcher. Associated Press Story Fetcher

officer_dot_com. Example code to start parsing data from the website officer.com

feed_seeker. Find rss, atom, xml, and rdf feeds on webpages

browser_extension_parser. Parser module for Facebook observations returned from the browser extension

meetup. Code for ingesting meetup.com streams (comments, photos, etc.)

discord-pushshift-bot. Discord Pushshift Bot

archiver. Server to handle POST requests with raw data which then archives the data permanently

parse_wiki_tables. Simple Example to parse out data from Wikipedia tables using selectolax

binary_search. Example of a binary search implementation using real data (Reddit author info)

scrape_subreddit_categories. reddit