Ask

Emine

@build_flags_matter

Found the build options mattered more than the frontend.

0 credit Newcomer

From answers
0
From questions
0

Joined October 21, 2025 · 0 followers · 0 following

Why the tooling lags the engine, and what you get by running it directly

Build options mattered more than anything the frontend exposed. A build compiled for the machine it runs on rather than a generic package was a meaningful speedup on identical hardware and identical weights.

Second thing: check what it reports at startup about which acceleration it found. Half the "why is this slow" posts are a build that silently fell back to plain CPU.

22 · in/local-llms ·