Tutorial

Custom ChatGPT and Whisper(speech to text) Plugins for TouchDesigner For Beginners

Torin is a freelance creative technologist, real-time graphics artist, and educator focused on creating restorative mixed reality installations, interactive experiences, and open-source creative tools. He is an adjunct professor at the Parsons School of Design teaching at the MFA and BFA programs. His classes include advanced creative coding, foundations of TouchDesigner, and interactive and immersive environments with TouchDesigner. His work explores emerging techniques in real-time graphics pulling inspiration from systems and patterns of emergent behavior in nature. This work has translated into creating large-scale environments for medical professionals to alleviate stress/burnout, for patients in clinical studies aiding in neuroscience research on brain recovery, and for commercial spaces.

Posted on: Mar 12th 2023

Comments

2,949 views

Hey! In this tutorial we'll go over 2 new components I developed to run OpenAI's Whisper (speech to text) and ChatGPT within TouchDesigner. The components work without any setup needed, just add your OpenAI API key. I also show how to extend the functionality of the components so you can use these models in your instillations.

Link to the Project File + Components are on my Patreon: https://patreon.com/blankensmithing
Link to Open AI's Website: https://platform.openai.com/signup

Tutorial link

Experience level

For Beginners

MODE Architectural Builds AI-Driven Interactive Content Engine For GM World

isabelle

Nov 26th 2018

Company Post

General Motors

LED

AI

Artificial Intelligence

Engine

Autonomous

Asset

Here you will find links to TDNeuron and material on how to use the system to implement machine learning Natively in TouchDesigner Why use TDNeuron? There are several deep learning libraries and frameworks available today. Why yet another one, such as TDNeuron? Here are some of the reasons.