Object Segmentation TOP is a native C++ Custom Operators that runs state-of-the-art transformer-based object-segmentation models fully on GPU.
Connect any TOP and the node outputs a per-instance segmentation overlay plus an instance-id image.
WHAT IT DOES
- Runs state-of-the-art models via CUDA or TensorRT for best possible performance with full FP16 and FP32 support.
- A few milliseconds of inference depending on model variant and GPU.
- Zero-copy GPU pipeline: reads pixels straight from the source TOP via CUDA, runs preprocess + inference + mask compositing on the GPU, no PCIe round-trip.
- Output 0 : an RGBA overlay at the source resolution: your image alpha-blended with a deterministic per-class color wherever an instance covers the pixel.
- Output 1 : a Mono32Float instance-id image (0 = background, otherwise instance index + 1). Fetch it with a Render Select TOP at index 1 to drive picking, masking, or per-instance shaders.
- Soft mask edges + temporal smoothing kill the per-frame shimmer a hard mask cutoff produces, with no extra setup.
- Stable instance ids + detection hysteresis (optional): a cross-frame tracker keeps each object's id attached as it moves and crosses, and a two-threshold gate with miss-tolerance holds objects on screen through brief score dips and one or two-frame dropouts.
- Auto-detects the model's input resolution AND mask resolution from the ONNX supports all model variants (Nano, Small, Medium, Large, XLarge, 2XLarge) without configuration.
- Custom-class support via a simple labels .txt file, plus a class filter to keep only the classes you care about. Default is COCO 8
WHO IT'S FOR
- Interactive installations that mask or cut out people, props, or specific object classes in real time.
- Live shows and performances that need real-time scene segmentation without a Python sidecar.
- Computer-vision-driven generative pipelines (recoloring, per-instance effects, particle emitters seeded from masks, projection mapping onto segmented objects).
Available for download at : https://tdplugins.shop/product/objsegmentationtop
