
Why the Wayback keeps saving Anubis's bot check
Test an Anubis site with the Wayback's save button and it's fine. But volunteer crawlers feed the Wayback too, and its newest copy is often the bot check.
1 post tagged archiving. Or see every tag.

Test an Anubis site with the Wayback's save button and it's fine. But volunteer crawlers feed the Wayback too, and its newest copy is often the bot check.