How crawlers impact the operations of the Wikimedia projects

Our content is free, our infrastructure is not: Establishing responsible use of infrastructure

Wikimedia is not alone with this challenge. As noted in our 2025 global trends report, technology companies are racing to scrape websites for human-created and verified information. Content publishers, open source projects, and websites of all kinds report similar issues.