Back

Log level 'error' should mean that something needs to be fixed

4 days ago utcc.utoronto.ca

Story Summary Story

Last updated: 1 day ago

The page explains why a user is encountering a block message, indicating their browser is flagged as suspicious, often due to being outdated. This measure is a temporary experiment to mitigate high-volume crawling activity prevalent in early 2025, much of which is suspected to be for LLM training data collection. Users encountering this blockage while using a modern browser are encouraged to contact the author with details, including the exact User-Agent string. A separate warning is issued for users accessing the content via archive.* services. These archival sites use tactics—such as deploying old Chrome User-Agents and utilizing confusing IP addresses—that make them indistinguishable from malicious crawlers. The author recommends using archive.org instead, as it is a better-behaved archival service that can successfully crawl the content.

Comments Summary Comments (278)