Before changing proxy config, look at the access log for that route. A failed upgrade shows up as a 400 or a 200 that closes immediately, repeating on a fixed interval, which is the reconnect attempt.
That confirms the diagnosis in ten seconds and means you are not editing config against a guess. The interval in the log is also the client's retry timer, which is a useful thing to recognise elsewhere.