Ian Cook

arrow-adbc. Database connectivity API standard and libraries for Apache Arrow

duckdb-adbc-client. ADBC Client for DuckDB

adbc-jni-demo. Quick demo of using ADBC with Java and JNI.

community-extensions. Shell

vega-loader-arrow. Data loader for the Apache Arrow format.

columnar-cookbook. Recipes for database connectivity and data interchange with Apache Arrow and ADBC

singlestore-adbc-connector. C

adbc-cobol. ADBC interface for COBOL

setup-dbc. Github Action for dbc CLI

roborev. Continuous background code review database for agents, work faster and smarter with accountability for every line of generated code.

validation. A framework for validation testing of ADBC drivers.

databow. A command-line tool for querying databases

skills. Agent Skills for ADBC and dbc

cuplyr. GPU powered dataframes in R

universal-driver. Universal driver

name-mappings. Canonical Name Mappings for ADBC Drivers

adbc_clickhouse. (Work-in-progress) Official ClickHouse driver for Arrow Database Connectivity (ADBC)

trino. ADBC driver for Trino. Not affiliated with Trino.

duckdb-adbc-jdbc. Comparing ADBC and JDBC query result transfer with DuckDB in Java

dbc-polars-test. Testing `dbc` integration with `polars`

dbc. dbc is the command-line tool for installing and managing ADBC drivers

snowflake. ADBC drivers for Snowflake

mysql. ADBC driver for MySQL. Not affiliated with MySQL or Oracle.

mssql. ADBC Driver for Microsoft SQL Server

redshift. ADBC Driver for Amazon Redshift

databricks. ADBC drivers for Databricks

adbc-drivers.org. Website for adbc-drivers.org

adbc-quickstarts. Simple examples showing how to use ADBC with various databases, query engines, and data platforms

bigquery. ADBC drivers for BigQuery

duckdb-snowflake. A powerful DuckDB extension that enables seamless querying of Snowflake databases using Arrow ADBC drivers with runtime loading capabilities.

xorq. Executable memory system for tabular data that works in your harness.

vortex. An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

duckdb-nanoarrow. C++

quacfka. Go library to stream Kafka protobuf messages to DuckDB

quacfka-service. High throughput streaming of Protobuf data from Kafka into DuckDB

TabPFN. ⚡ TabPFN: Foundation Model for Tabular Data ⚡

duck-takes-flight. A high-performance data streaming system using DuckDB and Apache Arrow Flight.

pantab. Read/Write pandas DataFrames with Tableau Hyper Extracts

slatedb. A cloud native embedded storage engine built on object storage.

dataframe. A fast, safe, and intuitive DataFrame library.

duckdb-substrait-extension. C++

arrow-go. Official Go implementation of Apache Arrow

spark-connect-proxy. A reverse proxy server which allows secure connectivity to a Spark Connect server

duckdbneo. New Bindings for the DuckDB Database Management System

duckdb. DuckDB is an analytical in-process SQL database management system

incubator-xtable. Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

arrow-experiments. Apache Arrow Development Experiments

dbt-ibis. Write your dbt models using Ibis

pgpq. Stream Arrow data into Postgres

2023-11-21_arrow-over-http-scratchpad. Python

ibis-birdbrain. portable Python ML-powered data bot

ibis-ml. IbisML is a library for building scalable ML pipelines using Ibis.

python-bigquery-dataframes. This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/bigframes

data. Overture Maps Data

arkouda. Arkouda (αρκούδα): Interactive Data Analytics at Supercomputing Scale :bear:

QLArrow. WIP QuickLook plugin for Apache Arrow and Parquet

velox. A composable and fully extensible C++ execution engine library for data management systems.

arrow. Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

jdot. JSON minus Notation plus Macros

tablesaw. Java dataframe and visualization library

substrait. A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

steampipe. Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

numbsql. Run Numba compiled functions in SQLite

arrow-cookbook. Apache Arrow Cookbook

tpchr. TPCH R package

legate.pandas. An Aspiring Drop-In Replacement for Pandas at Scale

homebrew-core. 🍻 Default formulae for the missing package manager for macOS (or Linux)

dataframe_sql. A Python package that parses SQL and interprets it as methods that act upon existing pandas (or other types of) DataFrames that have been declared and registered

sql_to_ibis. A Python package that parses sql and converts it to ibis expressions

rextendr. An R package that helps scaffolding extendr-enabled packages or compiling Rust code dynamically

extendr. R extension library for rust designed to be familiar to R users.

arrow-flight-client-examples. Java

ParquetSharp. ParquetSharp is a .NET library for reading and writing Apache Parquet files.

radian. A 21 century R console

ynabr. Analyze and visualize your You Need A Budget (YNAB) data. YNAB meets R programming language.

go-py-arrow-bridge. Bridge between Go and Python to facilitate zero-copy using Apache Arrow

BlackHole. BlackHole is a modern macOS audio loopback driver that allows applications to pass audio to other applications with zero additional latency.

Soundflower. MacOS system extension that allows applications to pass audio to other applications. Soundflower works on macOS Catalina.

desk. :arrow_up_down: A height-adjustable desk controlled by Siri using Homekit

python-camtasia. Python API for Camtasia projects.

git-webui. A standalone local web based user interface for git repositories

cdp-instructions-aws. Instructions for setting up a CDP Environment on AWS

edge2ai-workshop. Edge2AI Workshop

applied-ml. Code and Resources for "Applied Machine Learning"

revdepcheck. R package reverse dependency checking

dtplyr. Data table backend for dplyr

disk.frame. Fast Disk-Based Parallelized Data Manipulation Framework for Larger-than-RAM Data

spleeter. Deezer source separation library including pretrained models.

hex-stickers. RStudio hex stickers

koalas. Koalas: pandas API on Apache Spark

Databases. CRAN Task View: Databases with R

impala-odbc-docker. Shell

rta_2019. Talk with Research Triangle Analysts on 2019-08-20

cliclick. macOS CLI tool for emulating mouse and keyboard events

urbnmapr. State and county maps with Alaska and Hawaii

Gifski. 🌈 Convert videos to high-quality GIFs on your Mac

gifski. GIF encoder based on libimagequant (pngquant). Squeezes maximum possible quality from the awful GIF format.

impala-udf-samples. Sample UDF and UDAs for Impala.

clusterssh. Cluster SSH - Cluster Admin Via SSH

zeppelin_notebook_to_script. Converting a zeppelin notebook in single programming language to respective script

thriftr. R

impala-get-json-object-udf. A UDF for Cloudera Impala ( hive get_json_object equivalent )

groundcontrol. An R package to generate data-only R packages of flight data, like nycflights13, but with a choice of airport(s) and year(s).

lime. Lime: Explaining the predictions of any machine learning classifier

anchor. Code for "High-Precision Model-Agnostic Explanations" paper

ibis. the portable Python dataframe library

here. A simpler way to find your files

dbplot. Simplifies plotting of database and sparklyr data

PythonDataScienceHandbook. Python Data Science Handbook: full text in Jupyter Notebooks

meetupr. R interface to the Meetup API

ggjoy. Deprecated. Please use ggridges.

devtools. Tools to make an R developer's life easier

osrm. Interface between R and the OpenStreetMap-based routing service OSRM

osmdata. R package for downloading OpenStreetMap data

osmprob. R package for probabilistic routing

dbplyr. Database (DBI) backend for dplyr

dbtest. Automates testing of vector expressions of SQL translations for dplyr

reprex. Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

implyr-example. Example repository of implyr

sparkavro. Load Avro data into Spark with sparklyr

rwebhdfs. R Package for WebHDFS REST API

dplyr. dplyr: A grammar of data manipulation

dplyrimpaladb. R dplyr connector for ImpalaDB

teleprompter. Browser-based TelePrompter with Remote Control

sparklyr. R interface for Apache Spark

sf. Simple Features for R

represtools. Reproducible Research Tools

jquery.isinview. Detects if elements are in view - inside of the viewport, an iframe, or other containers. Very fast.

testthat. An R 📦 to make testing 😀

googlesheets. Google Spreadsheets R API

gpac. GPAC Ultramedia OSS for Video Streaming & Next-Gen Multimedia Transcoding, Packaging & Delivery

ivona-speechcloud-sdk-java. IVONA SpeechCloud SDK for Java

useR2015. tutorial on the spatstat package at useR! conference 2015

AAU2015. Course material for spatstat workshop at Aalborg University

awesome-R. A curated list of awesome R packages, frameworks and software.