Raphael Hagen

lazymerge. Lazily merge geospatial Zarr arrays using Cubed.

geoparquet-overviews. One GeoParquet file a web map previews instantly and a SQL engine reads in full. Draft convention, reference converter, and live viewer.

radar-data-availability. Helpful figures for thinking about polar radar sounder data availability

duckdb-zarr. Query Zarr stores with SQL directly from DuckDB

zarr-python-planning. Plans for zarr-python

healpix-ts. HEALPix (Hierarchical Equal Area isoLatitude Pixelization) implementation in TypeScript

drought-monitor. Historical water balance data with an experimental 6-month forecast

GeoLibre. A lightweight, cloud-native GIS platform for visualizing, exploring, and analyzing geospatial data. It runs in the web browser, on the desktop, on mobile, and inside Jupyter notebooks.

cubed-lithops-runtime-builder-template. Dockerfile

ZarrDatasets.jl. A high-level interface for Zarr datasets

warp-rs. Rust

rayzon. Python

rayzin. Ray-backed nearest neighbors for embeddings in Zarr or COG

lazycogs. Lazily load COG assets from STAC items into xarray DataArrays using async-geotiff

intake-virtual-icechunk. An intake plugin for building and reading Icechunk stores from existing esm-datastores via VirtualiZarr and intake-esm. Admins: @charles-turner-1 @rbeucher

virtual-stores-feasibility-report. Information to support NASA's adoption of virtual stores

async-geotiff. Fast, async GeoTIFF and COG reader for Python

protospec. Design and specification prototype documentation for the cylf ecosystem

vzviz. Explore file structures with VirtualiZarr

pySnowClim. python version of the SnowClim model

async-tiff. Async TIFF reader for Rust and Python

rasi-icechunk. Batch virtualization of the RASI dataset

healpix-geo. healpix for the geo-sciences

cubed-batch. Python

virtualizarr-data-pipelines. AWS infrastructure for managing Virtualizarr data pipelines.

burla. The simplest way to scale Python.

unsafe. A package for adding parametric uncertainty to the national structure inventory and estimating flood losses with uncertain depth-damage relationships

wind-layer. :flags: :rocket: wind-layer | a openlayers && maptalks && amap && bmap && leaflet && mapbox-gl && maplibre-gl extension like windy.com for weather visualization

xbitinfo. Compress xarray datasets based on their bitwise information content

lux. A Redis-compatable key-value store. Up to 10x faster. Native vector support.

explore-site. Explore Overture Maps data themes on an interactive map

MarsRetrieval. Python

topozarr. Create multiscale Zarr stores for visualization

stac-3dep-1m. Static STAC Catalog for 3DEP 1m DEMs

freestiler. A Rust-powered vector tile generator for R, Python, and DuckDB.

async-hdf5. Experimenting with a Zarr proxy for HDF5, backed by Rust

nz. The NetCDF Zarr convention (NZ) defines a structural interoperability layer for array-oriented scientific data on top of the Zarr v3. Similar to the "NetCDF Users Guide", it defines a shared vocabulary of structural concepts, a typed data model, naming rules, and a small set of reserved attributes for use of NetCDF on Zarr V3.

geozarr-toolkit. Tools for creating, exploring, and validating GeoZarr data

prek. ⚡ A fast Git hook manager written in Rust, designed as a drop-in alternative to pre-commit, reimagined.

icechunk-js. TypeScript

yosegi. Yosegi - Pyramid (Geo)Parquet Generator

obspec-utils. Utilities for interacting with object storage, based on obspec

deck.gl-raster. Client-side, WebGL2 GeoTIFF & Zarr visualization in deck.gl

zarr-datafusion-search-examples. Dataset examples for zarr-datafusion-search.

radar-datatree. Jupyter Notebook

webgl-wind. Wind power visualization with WebGL particles

weather-maps. experimenting with maplibre-gl-js custom layers to visualize weather data

repo2docker-action. A GitHub action to build data science environment images with repo2docker and push them to registries.

zarr-layer. flexible zarr rendering for maplibre and mapbox maps

metaarrays. Jupyter Notebook

cloud-tensor-storage-benchmarks. Earthmover's benchmark notebooks for cloud tensor storage libraries

VERT. The next-generation file converter. Open source, fully local* and free forever.

duckdb-tileserver. A lightweight MVT (Mapbox Vector Tile) tileserver for DuckDB with the duckdb-spatial extension

zarr-datafusion-search. Exploration of Zarr + DataFusion

proj. Datum and coordinate reference system convention

interpn. N-dimensional interpolation methods in Rust and Python, no-std compatible

hypergrib. Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray

multiscales. Domain-agnostic Zarr convention for encoding multiscale pyramid information

marray. Masked versions of array API compatible arrays

xarray-array-testing. testing framework for testing duck array compatibility with xarray

marray. Masked versions of array API compatible arrays

marray-xarray. xarray integration library for marray

sedona-spatialbench. A benchmark for assessing geospatial SQL analytics query performance across database systems

xpublish-tiles. Tile router for Xpublish

gdal. Rust bindings for GDAL

sedona-db. A single-node analytical database engine with geospatial as a first-class citizen

nldas-icechunk. NLDAS3 daily data virtualization using icechunk

upstream-delineator. Python scripts for watershed delineation including sub-basins

xMIP. Analysis ready CMIP6 data in python the easy way with pangeo tools.

xmitgcm. Read MITgcm mds binary files into xarray

data-model. EOPF Sentinel Zarr Explorer Data Model

zarr-sparse. packed sparse array storage with zarr

workshop-cng-2025-zarr. Zarr, Icechunk, & Xarray for cloud-native geospatial data-cube analysis

earthkit-regrid. Python

aifs-demo. Demo for running ECMWF AIFS in the cloud

icon-ch-vzarr. VirtualiZarr parsers for MeteoSwiss GRIB data from ICON

hrrr-parser. Virtualizarr parser for HRRR

data.source.coop. Source Cooperative Data Proxy

lithops. A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

titiler-cmr. Dynamic tiles from CMR queries

just. 🤖 Just a command runner

pangeo-forge-esgf. Using queries to the ESGF API to generate urls and keyword arguments for receipe generation in pangeo-forge

zarr-vis. Fast, scalable methods for visualizing Zarr-based multidimensional data directly in the browser.

overturemaps-py. Overture's Python CLI

zarrs_icechunk. icechunk store support for the zarrs Rust crate

Better-Known-Binary.

async-pmtiles. Asynchronous PMTiles reader for Python

oxbow. Oxbow makes genomic data ready for high-performance analytics.

test-scripts. Uv scripts for testing out random ecosystem functionality

reformatters. Reformat weather datasets into Zarr

flux-web-demo. TypeScript

infrastructure. Infrastructure for configuring and deploying our community JupyterHubs.

xarray-for-bio. Jupyter Notebook

numcodecs-rs. numcodecs Rust API for buffer compression

noaastormevents. explore noaa storm database

pudl. The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

stac-geoparquet-pmtiles. Expriment linking stac-geoparquet and pmtiles

zappend. Robustly creating and updating Zarr data cubes from smaller subsets

xdggs. Xarray extension for DGGS

vortex. An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

ty. An extremely fast Python type checker and language server, written in Rust.

obspec. A Python protocol for interfacing with object storage.

stac-collection-discovery. Tool for searching for collections across multiple catalogs

open-data. Open-Meteo on AWS Open Data

gpq. Utility for working with GeoParquet

numeric-data-layer. TypeScript

rasterix. raster tools for xarray

ocr. Open Climate Risk Platform

gis-history. A list of key events in the history of Geographic Information Systems (GIS) and spatial data processing.

fastplotlib. Next-gen fast plotting library running on WGPU using the pygfx rendering engine

geoparquet-io. A collection of tools for GeoParquet, built on DuckDB, GDAL & Obstore

file-uploader. Python

jupytergis. JupyterGIS - Collaborative GIS editor in Jupyter

stac-js. JS drop-in classes with utilities for STAC

rusterize. Extremely fast rasterization tool built in 🦀 Rust for 🐍 Python & R

data. Overture Maps Data

exactextract. Fast and accurate raster zonal statistics

async-tiff. Async TIFF reader for Rust and Python

raquet. RaQuet is a specification for storing and querying raster data using Apache Parquet.

exactextractr. R package for fast and accurate raster zonal statistics

jupyterhub-home-nfs. In-cluster NFS server for JupyterHub home directories with usage quota enforcement

zenodo_get. Zenodo_get - a downloader for Zenodo records

spatially-partitioned-geoparquet. Exploring spatially-partitioned GeoParquet

FROST. Decentralized global data catalog protocol for all scientific data

presentations. My presentations

deepsd. DeepSD Super-resolution for Climate Downscaling in KDD 2017

geozarr-validator. This document aims to provides a geospatial extension to the Zarr specification. Zarr specifies a protocol and format used for storing Zarr arrays, while the present extension defines conventions and recommendations for storing multidimensional georeferenced grid of geospatial observations (including rasters).

umoria. Moria: a roguelike Dungeon Crawler game | Umoria Source Code

zarr-obstore-performance. Performance testing of Zarr using ObjectStore (obstore)

grid-weights. Fast and scalable computation of regridding weights.

grid-indexing. Fast and scalable indexing of grids

titiler-pgstac. TiTiler + PgSTAC

xradio. Xarray Radio Astronomy Data IO

virtual-tiff. Produce and explore virtual Zarr with TIFFs

cf-codecs. Encoding and decoding of data using CF conventions

ndquirk. expose quirkiness in n-dimension datasets

heystac-frontend. [WIP] A curated geospatial asset discovery experience™

zarrs-python. A CodecPipeline for zarr-python backed by the zarrs Rust crate

icechunk-nasa. Icechunk Pilot for NASA IMPACT

quirky-data-checker. Jupyter Notebook

geo-index. A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.

cdsapi. Python API to access the Copernicus Climate Data Store (CDS)

PMTiles. Pyramids of map tiles in a single file on static storage

xagg. Aggregating gridded data (xarray) to polygons

Catalog-To-Xpublish. This repository enables one to spin-up a FastAPI/Xpublish server from an Intake or STAC catalog.

xpublish-wms. WMS router for xpublish

maplibre-gl-js. MapLibre GL JS - Interactive vector tile maps in the browser

angle_grinder. Zarr + Redis + TileServer = fast custom geospatial maps

ome-zarr-py. Implementation of next-generation file format (NGFF) specifications for storing bioimaging data in the cloud.

cloud-optimized-icesat2.

xarray-units. :zap: xarray extension for handling units

odc-geo. GeoBox and geometry utilities extracted from datacube-core

pydata_global_2024. Material for "akimbo: vectorized processing of nested/ragged dataframe columns"

xstac. STAC from xarray

fugue. A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

geoarrow. Specification for storing geospatial data in Apache Arrow

xproj. Xarray extension for managing geospatial coordinate reference systems

odc-tools. Useful tools and libraries for working with Open Data Cube

zarr.js. Javascript implementation of Zarr

redis-fsspec-cache. A redis based filesystem cache for fsspec

geoarrow-rs. GeoArrow in Rust, Python, and JavaScript (WebAssembly) with vectorized geometry operations

virtualize-nex-gddp-cmip6. Python

calibre-web. :books: Web app for browsing, reading and downloading eBooks stored in a Calibre database

cmip6-downscaling. Climate downscaling using CMIP6 data

benchmark-maps. benchmarks for web maps

stac-asset. Read and download STAC Assets, using a variety of authentication schemes

rgis. Performant, cross-platform (web, desktop) GIS app written in Rust

xhydro. Hydrological analysis library built with xarray.

obstore. The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.

rustac. The power of Rust for the STAC ecosystem

chirps_feedstock. Feedstock for Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS)

icechunk. Open-source, cloud-native transactional tensor storage engine

ecoscope. Conservation data analytics

duckdb. DuckDB is an analytical in-process SQL database management system

zarrs. A Rust library for the Zarr storage format for multidimensional arrays and metadata

xcube. xcube is a Python package for generating and exploiting data cubes powered by xarray, dask, and zarr.

biobear. Work with bioinformatic files using Arrow, Polars, and/or DuckDB

arro3. A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate

warp-resample-profiling. Exploring all the Python resampling/reprojection options

pangeo.io. Pangeo Website

raster_tools. RMRS Raster Utility Project

rivamap. an automated river analysis and mapping engine

cookiecutter-uv. A modern cookiecutter template for Python projects that use uv for dependency management

titiler-multidim. TiTiler application for NetCDF/Zarr datasets

BigChunkus. Python

docker-stacks. Ready-to-run Docker images containing Jupyter applications

3d_animations. A collection of all my work that involves 3D visualization

uv. An extremely fast Python package and project manager, written in Rust.

geovista. Cartographic rendering and mesh analytics powered by PyVista 🌍

opt_einsum. ⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.

geofileops. Python toolbox to process large geospatial vector files faster.

cross-cloud-transfer-feedstock. Testing different methods to move data between object storage in different clouds

pydmr. Python

pynhd. A part of HyRiver software stack that provides access to NHDPlus data through web services

aglime-swap-cdr. Jupyter Notebook

xarray-tutorial. Xarray Tutorials

climate-risk-comparison. analysis of risk scores from climate analytics companies

pixi. Powerful system-level package manager for Linux, macOS and Windows written in Rust – building on top of the Conda ecosystem.

greenland-supraglacial-lake-depths-figures. Figures for ICESat-2 and Sentinel-2 based supraglacial lake depth determination over the Greenland Ice Sheet

rust-python-interoperability. A self-paced course to write Python extensions in Rust, one exercise at a time.