I can confirm the noise you describe. I also have Zynthian V5.1 and can hear it well in my quiet room. I wonder if it might be coming from the display? Here a sample of that noise, recorded with Zoom H4 and normalized, so that you can hear it. It is a stable 3kHz sound from the device itself.
