Seconding bandwidth. The quick check before buying anything: your theoretical tokens per second is roughly bandwidth divided by the size of the active weights. That predicts real results closely enough to tell you whether a machine is worth trying at all.
It also explains why a faster processor changes nothing while a second memory stick doubles it.