Alternatively, look in your TV settings for something like "Game Mode" and set it on the input where your PC is connected, if possible.

A lot of TVs do some image correction, and with their relatively miniscule CPUs that takes time. I don't know the HDMI protocol by heart, but could be that the PS4 sends a "low latency, disable all that BS please" signal, and your PC doesn't, so you'll have to switch manually?