I am trying to synchronise live audio with lighting in realtime. I have found touch designer is excellent for analysis of audio to produce effects for lighting and it is working well when timing is not an issue.
I have hit a wall with what I am trying to do. The limit is the audio device in CHOP and latency problem. I cannot reduce latency between touch designer and the audio input to less than 15ms ish. This seems to be because the “audiodevicein CHOP” relies on a link to the touchdesigners FPS, 60Hz which is too slow for real time audio analysis and causes crackling in the audio information.
To use the audiodevicein CHOP effectively, I suspect I need a FPS of around 350ish for close to real time audio analysis which is not realistic.
Can the Audio device chop be changed somehow to allow for proper analysis of audio in real-time? Somehow have this single chop processing at 6 times faster than the set frame rate?
A general question regarding this issue: Would it make sense to use Max/MSP for audio analysis and send the desired values over to TD via OSC, or would TD still overwrite the incoming OSC signals with the fps and cause another delay?