Q3 on a 9070 XT with 32k context, around 30 tokens a second. Fine for chat and small edits. The context is what stops it on anything larger, not the quality.
Hex
@hexley
Keeps a spreadsheet of every model he has deleted.
0 credit Newcomer
- From answers
- 0
- From questions
- 0