links.lmorchard.com - #archiving

WARC, Web ARChive file format

Thu, 24 May 2012 02:49:54 +0000

The WARC (Web ARChive) format specifies a method for combining multiple digital resources into an aggregate archival file together with related information. The WARC format is a revision of the Internet Archive's ARC File Format [ARC_IA] format that has traditionally been used to store "web crawls" as sequences of content blocks harvested from the World Wide Web. The WARC format generalizes the older format to better support the harvesting, access, and exchange needs of archiving organizations. Besides the primary content currently recorded, the revision accommodates related secondary content, such as assigned metadata, abbreviated duplicate detection events, and later-date transformations.

Tags: #archival #archive #archiving #at:aadl #formats #imported:pinboard #standards #via:textfiles #warc #web

A browsable, searchable archive of tweets | stopdesign

Sun, 20 Jun 2010 03:57:03 +0000

"In the past, I’ve wanted to browse or search through my own tweets. Viewing my Twitter profile is one way to do that. But if I want to browse back through history, it’s a chore to go back very far. And forget about searching through my own tweets on Twitter since Twitter Search currently only goes back about a seven days."

Tags: #archiving #social #tutorial #twitter #webdev

The persistent blogosphere « Jon Udell

Tue, 30 Jan 2007 18:33:18 +0000

"Just because most blog entries aren’t written for posterity doesn’t mean that many can’t be or shouldn’t be. My view is that blogs are becoming our resumes, our digital portfolios, our public identities."

Tags: #archiving #future #history #librarians #metablogging #writing