Worth saying the obvious limit out loud: robots.txt stops the crawlers that read it. It does nothing about anyone running a browser with a rotating address pool, and the sites that care most are usually being hit by exactly those.
It is a fence with a sign on it. Still worth having the sign, mostly for what it proves rather than what it prevents.