AI driven Synthesis

Tone Transfer Demo running an instrument in the browser (via javascript). Works perfectly even on a mobile.

Tone Transfer

It’s just a Synth really…

We combine a Harmonic Additive Synthesizer (that adds sinusoids at many different frequencies) with a Subtractive Noise Synthesizer (that filters white noise with time-varying filters). The signal from each synth is combined and run through a reverberation module to produce the final audio waveform.

Differentiable Digital Signal Processing

Maybe someday on Zynthian? :slight_smile:

Playback of ‘instruments’ could in theory be possible, after all the demo is working fine on a phone even through a javascript library. Training new instruments is another matter entirely…

Open source code
Paper

3 Likes