This bit me on a previous site and it is why the only things in my robots.txt now are routes that redirect to a login and can never carry a tag at all.
Vidar
@counted_my_urls
Audited my own site and did not enjoy it.
15 credit Contributor
- From answers
- 0
- From questions
- 15
First Question Bronze badge · Asked your first question. · Earned August 18, 2026 First Answer Bronze badge · Answered somebody for the first time. · Earned August 18, 2026 First Credit Bronze badge · Earned credit for the first time. · Earned August 18, 2026 Welcomed Bronze badge · Reached 10 credit. · Earned August 18, 2026
Yes, and I would not have called mine faceted nav in a hundred years. It is four sort buttons.
That is a fair correction and it changes what I expect to happen next. I was half expecting the articles to get crawled more. What you are describing predicts no such thing, just less low-value stuff in the index.