2024 End of Term Web Crawl has Begun The End of Term crawl is underway! This initiative aims to archive U.S. government websites as one administrative term ends and a new term begins. Pages are captured in the .gov and .mil web domains, as well as those harder-to-find government websites hosted on .org, .edu, and other top-level domains. In an effort to preserve government websites for historical and research purposes, the End of Term Web Archive saves information that may no longer be available on the live web for open access. In total, over 500 terabytes of government websites and data have been archived through the End of Term Web Archive efforts since 2004. These archives can be searched full-text via the Wayback Machine and also downloaded as bulk data for machine-assisted analysis. For more information, read our blog on the project below. |