XR + ML research @worldmaking, @icosa-foundation, @LightningArtist, @nytm, @wavelab, @googlecreativelab, @framestore, @eyebeam | Best Animated Short @sxsw
AEToolbox. JS automation for After Effects; also a great template for any ScriptUI project.
80OpenPoseRig. Using OpenPose in a 3D animation pipeline. Based on the work of @CMU-Perceptual-Computing-Lab, @una-dinosauria, @ArashHosseini, and @keel-210.
67ViveTrackerExample. Use the Vive tracker without a headset.
65PShaderToy. ShaderToy boilerplate for Processing 3, Unity
64ManosOsc. (Eyebeam #13 of 13) Output OSC, MIDI, and After Effects/Maya animation scripts from the Leap Motion controller.
59KinectToPin. (Eyebeam #1 of 13) Developed with @FakeGreenDress. Record, stream, and export Kinect mocap data to After Effects puppet pins. Record directly from the Kinect or over OSC. Compiling or running from source requires SimpleOpenNI.
45opencv-kinfu. The MS Azure Kinect kinfu example, with dlls compiled for Windows x64 (to save us all the trouble of wrangling its 25GB of dependencies for a 35MB app).
34ITP_OpenSourceAnimation. NYU ITP Open Source Animation course materials, 2012-2014
31SixFeatures. Variables, functions, conditionals, loops, arrays, and classes--the six core features of almost any programming language--demonstrated in C++, C#, Java, JavaScript, Python, and Swift.
27Telidon. TelidonP5: a JS encoder and decoder for NAPLPS vector graphics files (originally developed for Telidon hardware, later used throughout the BBS era).
26deep3d. Automatic 2D-to-3D Video Conversion with CNNs
24drawing_methods. Stroke drawing examples for Unity, Unreal, Processing, processing.py, openFrameworks, p5.js, paper.js, and three.js.
22MayaToolbox. Comprehensive intro to Maya Python.
18pseudoscience_stereo2depth. Archived versions of Josh Gladstone and Timotheos Samartzidis' Stereo2Depth, from the 6DoF reddit forum.
17AEwriter. (Eyebeam #2 of 13) Record realtime procedural keyframe data, output a JS script for After Effects or a Python script for Maya.
16AEwriterjs. Created for Tribeca Hacks at GAFFTA in 2013. Generate procedural keyframe data using Processing.js, output a JS script for After Effects or a Python script for Maya. Development continues at:
15latk_blender. Read and write Latk files, read Tilt Brush files, and use PyTorch and ONNX models in Blender Grease Pencil. Tested in Blender LTS 3.6 and 4.2. SIGGRAPH 2024: https://doi.org/10.1145/3664221
15Pointcloud_Render. (Eyebeam #10 of 13) Convert a grayscale depth map image to a point cloud; save in formats including OBJ, PLY, ASC.
15C4DToolbox. Simplifies keyframe creation using Cinema 4D's complex Python API.
13motion-interpolation-for-glitch-aesthetics. Drag-drop ffmpeg shell scripts for glitching mp4s, based on the work of @hellocatfood. Also a great reference for any kind of drag-drop script.
11awesome-3d-drawing. Using motion-tracked controllers in XR to create art and animation, combined with ML processing and rendering.
11OpenPoseUnity. tf-openpose and unity IK
10tilt-brush-unity-examples. Additional Unity examples for the Tilt Brush Toolkit.
10yellowtails. Ports of Golan Levin's Yellowtail
9RealSenseSDK2.0. RealSense Unity plugin as submodule. Tested with Unity 2020, 2019, and 2018.
9max-abstractions. Archive of abstractions for use with Max for Live, begun at CultureHub's CoLab 2013
9StreetMap_UE4. Sample Unreal project for StreetMap plugin.
9JetstreamKinect. Azure Kinect streaming from Jetson Nano
9FaceToPin. (Eyebeam #4 of 13) Generates AfterEffects keyframes using @atduskgreg's version of FaceOSCSyphon.
8ae_k2p_panel. The KinectToPin AE ScriptUI panel, used with:
8UnityPointCloud. Point cloud tools organized as a submodule
7kinect_syphon. Processing app to send Kinect v1 / clone depth map via Syphon or Spout. Requires SimpleOpenNI.
7AnimSprite. (Eyebeam #9 of 13) Sprite class for Processing 3 and p5.js
7LightningLoops. A networked musical instrument you play by drawing in 3D space, trained on 164 MIDI recordings of me playing piano.
6UnityARKitPlugin. Archive of the last ARKit 2 version of Unity's ARKit plugin (pre-ARFoundation), organized as a submodule.
63d-pose-baseline. A simple baseline for 3d human pose estimation in tensorflow. Presented at ICCV 17.
6PuppetOsc. (Eyebeam #11 of 13) Puppets driven by OSCeleton-format Kinect skeletons. Receives on port 61863 by default.
6PiXtionApps. Depth apps for RPi, based on xtionSimple by @gepatto. Tested on Wheezy and Jessie with oF 0.8.4.
6Kinect_justrecord. (Eyebeam #5 of 13) Records Kinect depth maps as 8-bit grayscale images. Use [ https://github.com/N1ckFG/Kinect_justrecord_post ] to fix sync or [ https://github.com/N1ckFG/Pointcloud_Render ] to batch export OBJ files.
6Animata. Source of Kitchen Budapest's Animata 004 puppetry software
6hicetnunc-p5js-template. Development continues at:
6LeapToStereo. Generate depth map from Leap Motion stereo cameras.
5ae-mettle. Example projects using the After Effects Mettle / Immersive Video plugins
5Realtime-GPU-Contours-2. Based on https://github.com/JiangWZW/Realtime-GPU-Contour-Curves-from-3D-Mesh
5DepthImage_UE. Unreal depth map materials; 360, gray, and hue examples. Tested in 5.1.
5UnityMultiCam. Working with multiple windows and camera arrays in Unity, organized as a submodule.
5StreetMap. Import OpenStreetMap data into Unreal. Example project at:
5Drawgrid. (Eyebeam #3 of 13) Use an image as a map for particles, and decide individual particles' behavior.
5SoundEffects. Oscillators, etc. for Unity
4CameraAE. Export Processing's PeasyCam to After Effects
4BRDF_Shader. Collecting BRDF shader examples for Unity.
4JpegMaker. creates a jpeg image full of random data. Processing port of Antonio Roberts' ( hellocatfood.com ) PD patch.
4PixelVision. Pixel effect + LUT for Unity 2017
4LeapBasics. Basic example of how to work with the LeapMotion controller in processing; covers fingers, tools, hands, and 3D
4ISF-Folder. My VDMX ISF folder
4LineRenderer_UE4. Unreal project example for LineRenderer plugin.
4VolumAeTric. Preview volumetric video out of After Effects via Syphon or TCPSyphon. (Pre-Catalina?) Mac only.
3