I run Xenforo.
I'm considering disallowing:
/posts/
/find-new/
/members/
but have not yet.
Two questions:
1. Should these be disallowed?
2. What should I do if a large amount of threads with /posts/ in the URL are indexed by Google?
Surely removing them will have a negative impact, at least short-term, for posts already indexed. They'll be deindexed, reducing any traffic they were bringing in, and possible GWT errors. On the other hand, can I test if they're being treated as duplicate content?
What would you do? I realize blocking /posts/ is probably best practice and should have been implemented some time ago.
3. What should I be looking at in GWT?
I'm considering disallowing:
/posts/
/find-new/
/members/
but have not yet.
Two questions:
1. Should these be disallowed?
2. What should I do if a large amount of threads with /posts/ in the URL are indexed by Google?
Surely removing them will have a negative impact, at least short-term, for posts already indexed. They'll be deindexed, reducing any traffic they were bringing in, and possible GWT errors. On the other hand, can I test if they're being treated as duplicate content?
What would you do? I realize blocking /posts/ is probably best practice and should have been implemented some time ago.
3. What should I be looking at in GWT?