Thanks for your thoughts Manu!
Plugin latency should not affect this as it should be compensated by PDC (Plugin Delay Compensation) in your DAW. Check your settings

(in fact the U-SYNC plugin, in order to be able to send things on time, adds also a bit (7ms) of Plugin latency)