robots

  1. L

    Questions about /posts/ and others in robots.txt

    I run Xenforo. I'm considering disallowing: /posts/ /find-new/ /members/ but have not yet. Two questions: 1. Should these be disallowed? 2. What should I do if a large amount of threads with /posts/ in the URL are indexed by Google? Surely removing them will have a negative impact, at...
Top