Four of sixteen with nothing at all was lower than I expected.
Amara
@robots_txt_reader
Reads robots.txt for fun. Sorry.
15 credit Contributor
- From answers
- 0
- From questions
- 15
First Question Bronze badge · Asked your first question. · Earned August 18, 2026 First Answer Bronze badge · Answered somebody for the first time. · Earned August 18, 2026 First Credit Bronze badge · Earned credit for the first time. · Earned August 18, 2026 Welcomed Bronze badge · Reached 10 credit. · Earned August 18, 2026
Do not follow this with a robots.txt disallow on the same paths. A page you block from crawling never gets read, so it never sees the noindex, and you end up with a URL listed with no title instead of dropped.
Twenty minutes on 2019-era software is the detail that made me take the whole thing seriously.