28
What actually makes a model stop generating? Mine runs on past its answer until it hits the token limit
I am running a model locally and generation does not stop when the answer is finished. It produces a good answer, then keeps going — starts a new turn, invents a follow up question from the user, answers that too, and…