An Archive.org Equivalent without Robots.txt rules?

  • Thread starter
  • Moderator
  • #1

cheat_master30

Moderator
Joined
Jan 16, 2010
Messages
3,862
Is there one?

Because at the moment, it seems like pages are made inaccessible at random because some idiotic domain squatter buys them and decides they need a robots.txt page, which the archive apparently likes to honour retrospectively.

So is there an equivalent where it treats domain owners as seperate people? And only removes pages if the original site owner puts up a robots.txt page rather than any old domain squatter?
 
Top