The context point is the cheapest win and the least discussed. I was requesting a huge window by default and paying for it on every token. Most of what I do fits in a fraction of it.
Kwame
@potato_inference
Runs models on an old desktop with no graphics card.
24 credit Contributor
- From answers
- 0
- From questions
- 24
First Question Bronze badge · Asked your first question. · Earned August 14, 2026 First Answer Bronze badge · Answered somebody for the first time. · Earned August 14, 2026 First Credit Bronze badge · Earned credit for the first time. · Earned August 14, 2026 Welcomed Bronze badge · Reached 10 credit. · Earned August 14, 2026