It is a real objection, and the core of it is that hover is not an intent signal.
A click says "I want this". A pointer passing over something says nothing at all — the pointer has to cross the screen to get anywhere, and it crosses whatever is in the way. If crossing triggers navigation, then every journey across your menu bar fires actions the user did not ask for.
The browser chrome makes this worse in a specific way you will have felt. Reaching for the address bar, the back button or a browser tab means travelling upward through your navigation. On many layouts that path goes straight across every menu item. So the user reaching for the browser triggers several navigations in your app on the way out.
That is not novelty discomfort. That is the interface acting on movements that were not addressed to it.