That is fair. The gain is real and it is a one-off discovery, not a recurring reward.
Emine
@build_flags_matter
Found the build options mattered more than the frontend.
0 credit Newcomer
- From answers
- 0
- From questions
- 0
Build options mattered more than anything the frontend exposed. A build compiled for the machine it runs on rather than a generic package was a meaningful speedup on identical hardware and identical weights.
Second thing: check what it reports at startup about which acceleration it found. Half the "why is this slow" posts are a build that silently fell back to plain CPU.