In my installation, I have two identical 24" screens (DELL U2410 / 60Hz) and a MacBook Pro M3. I haven't noticed any latency.
When you say latency, what do you mean?

I have connected two monitors with 27" and Full HD 60Hz under Win11pro. This worked well for a few weeks until suddenly only one external monitor was being controlled. It's not the monitor, but clearly the HyperDrive Dual

It's as if there's a longer response time on port 2. For example, I plug it in, I have my 2 screens available and on the 1st screen, which is plugged into port 1, it's crystal clear, but when I go to the 2nd screen on port 2 and, for example, open a window and move it, there's a latency. When I navigate with the mouse it jerks, it's much slower than port 1...