The internet is prone to 'bitrot'—the gradual decay or disappearance of digital content. This can happen when a domain expires, a hosting service shuts down, or a site is repurposed for unrelated content, such as online gambling. While many users assume that web archiving is a task reserved for large institutions like the Internet Archive, individuals now have access to tools that allow them to take proactive ownership of the content they value. By creating personal archives, users can ensure that specific webpages, social media profiles, or entire domains remain accessible even after they go offline.
There are several ways to approach personal archiving depending on the scale of the content. For single pages or small collections, browser-based tools offer a low-barrier entry point. The ArchiveWeb.page extension for Chrome allows users to capture a page by simply clicking a button, ensuring that interactive elements are loaded before the save. For larger projects where manual browsing is impractical, web crawlers like Browsertrix can be used. A crawler automates the process by following links across a domain to capture as much content as possible. While Browsertrix is a paid tool on a per-use basis, it provides a comprehensive way to handle large-scale site crawls that would be tedious to perform by hand.
These tools typically save data in standard formats like WARC (Web ARChive) or WACZ, which packages the archive with necessary metadata. These files can be 'replayed' locally, allowing a user to browse the saved content as if it were still live. Furthermore, these archives can be shared privately by sending the file to others or publicly by embedding a replay interface into a blog or website using simple JavaScript. However, these methods face practical limitations: automated crawlers may be blocked by anti-bot mitigations designed to stop scraping, and the rising cost of high-capacity storage can make 'hoarding' large amounts of data more difficult for individual users. Ultimately, personal archiving shifts the responsibility of preservation from a centralized model to a distributed one, where communities can save the specific pieces of the web that matter most to them.
This image illustrates the Browsertrix crawler interface mentioned in the text, specifically showing how users can define the scope of a crawl.