'Preserving the web is not the problem. Losing it is,' claims the director of the Internet Archive
"The Wayback Machine is built for human readers."
Keep up to date with the most important stories and the best deals, as picked by the PC Gamer team.
You are now subscribed
Your newsletter sign-up was successful
Want to add more newsletters?
Every Friday
GamesRadar+
Your weekly update on everything you could ever want to know about the games you already love, games we know you're going to love in the near future, and tales from the communities that surround them.
Every Thursday
GTA 6 O'clock
Our special GTA 6 newsletter, with breaking news, insider info, and rumor analysis from the award-winning GTA 6 O'clock experts.
Every Friday
Knowledge
From the creators of Edge: A weekly videogame industry newsletter with analysis from expert writers, guidance from professionals, and insight into what's on the horizon.
Every Thursday
The Setup
Hardware nerds unite, sign up to our free tech newsletter for a weekly digest of the hottest new tech, the latest gadgets on the test bench, and much more.
Every Wednesday
Switch 2 Spotlight
Sign up to our new Switch 2 newsletter, where we bring you the latest talking points on Nintendo's new console each week, bring you up to date on the news, and recommend what games to play.
Every Saturday
The Watchlist
Subscribe for a weekly digest of the movie and TV news that matters, direct to your inbox. From first-look trailers, interviews, reviews and explainers, we've got you covered.
Once a month
SFX
Get sneak previews, exclusive competitions and details of special events each month!
The Internet Archive, the site responsible for running the handy archival tool, Wayback Machine, has reportedly seen sites such as Reddit, The New York Times, and The Guardian blocking it from getting access, due to concerns of AI scraping. Internet Archive director Mark Graham thinks "These concerns are understandable, but unfounded."
In a new blog on TechDirt named "Preserving The Web Is Not The Problem. Losing It Is", Graham affirms that "The Wayback Machine is built for human readers." The blog points out why many are wary of AI scrapers, and also notes measures it has put in place to stop said AI bots.
Graham claims the Internet Archive uses rate limiting, filtering, and monitoring to stop large-scale bots from stealing all that data. He also claims that the team watch out for new ways to abuse archival sites, to stop future mass scraping.
He goes on to say, "Whatever legitimate concerns people may have about generative AI, libraries are not the problem, and blocking access to web archives is not the solution; doing so risks serious harm to the public record."
Citing tech policy writer Mike Wasnick, Graham argues that, "blocking preservation efforts risks a profound unintended consequence." He essentially feels that if tools aren't given the ability to archive sites on the internet, it effectively risks tampering with the historical record for future generations.
As well as this, Graham argues that stopping archival sites means "Journalists lose tools for accountability. Researchers lose evidence. The web becomes more fragile and more fragmented, and history becomes easier to rewrite."
One point not mentioned here is that some websites, especially those like The Guardian and the New York Times that have paywalls in place, may want to stop archival tools so readers can't bypass those restrictions. The Wayback Machine may serve as somewhat of a digital library, but there's no limit on the number of books it can lend, and figuring out who claims them is tough work.
Keep up to date with the most important stories and the best deals, as picked by the PC Gamer team.
There's a push and pull here, one where archival tools need access to sites to preserve the history and integrity of the internet, and some sites need paid viewers to continue their work. AI coming in and stealing that work only makes that tension worse, even if the Internet Archive claims it can handle those nasty scrapers.

1. Best gaming laptop: Razer Blade 16
2. Best gaming PC: HP Omen 35L
3. Best handheld gaming PC: Lenovo Legion Go S SteamOS ed.
4. Best mini PC: Minisforum AtomMan G7 PT
5. Best VR headset: Meta Quest 3

James is a more recent PC gaming convert, often admiring graphics cards, cases, and motherboards from afar. It was not until 2019, after just finishing a degree in law and media, that they decided to throw out the last few years of education, build their PC, and start writing about gaming instead. In that time, he has covered the latest doodads, contraptions, and gismos, and loved every second of it. Hey, it’s better than writing case briefs.
You must confirm your public display name before commenting
Please logout and then login again, you will then be prompted to enter your display name.

