YOLO + Depth Anything Plugins: Real-Time Tracking & Depth Without Extra Hardware

Patreon links to get the plugins:

1. Yolo Plugin
2. Depth Anything Plugin

(note: tutorials are in the works)

Yolo: Multi-person Pose, Object, face, drone tracking + custom models

This plugin brings Ultralytics YOLOv11 into TouchDesigner with no install needed on Mac + PC, just drag the .tox into your project. Works with any webcam feed or any TOP, letting you track many people, objects, and faces in real-time with persistent IDs across frames. You can also bring in custom-trained models. Use it to build motion-reactive installations, track visitors in floor-based projections, or build custom logic from unique face and body IDs. 

Features:

• Object Tracking – Assigns persistent IDs to tracked objects, allowing you to follow their movement across frames.

• Multi-Person Pose Tracking – Tracks full body keypoints (joints, limbs, etc.) for multiple people at once, with unique IDs. 

• Face Tracking (Nano) – Detects and tracks faces with consistent IDs across frames.

• VisDrone Model Support – Specialized model trained for aerial and security footage, ideal for top-down/floor-based tracking installations.

• Custom Model Support – Load your own YOLOv11 models exported via ONNX (export scripts available on GitHub).

DepthAnything turns any webcam feed and now any TOP into a live depth map, showing how far away things are in the scene, similar to the kind of depth data you'd get from a Kinect or Orbbec camera. No install needed, just drag the .tox into your project. Use it to drive 3D particle systems, instance geometry, perform occlusion(where virtual objects appear correctly hidden behind real-world people or objects), and more.

New Features:

• TOP input support – now works with any video stream in TouchDesigner

• Improved frame sync – sync exact frames or enable smooth interpolation

• Built-in normalization component – for stable, flicker-free rendering

• Windows startup fixes – improved cross-platform reliability