Hide Notes 

Slide 1: Preservation Rumination Priscilla Caplan, FCLA OCLC DSS February 16, 2005
Slide 2: Preservation Basics
Slide 3: THE NEED FOR DIGITAL PRESERVATION  Number of academic/scholarly journals published online: 15,757  Percent of U.S. federal government publications produced only online in 2003: 65 percent  Estimated percent of U.S. federal government publications available only online by 2008: 90 percent From: California Digital Library http://www.cdlib.org/inside/projects/preservation
Slide 4: The problem of abundance 4500 4000 3500 3000 2500 2000 1500 1000 500 0 LoC Web items (millions)
Slide 5: The problem of ephemerality •Percent of web-based references in scientific articles from 3 major journals inaccessible within 2 years of publication: 21% •Proportion of websites in 1998 gone in 1999: 44% •Life of an average website: 44 days
Slide 6: The problems of media life expectancy and obsolescence
Slide 7: The problem of format obsolescence
Slide 8: General Universal Virtual Computer Typed Object Conversion Virtual Machine Re-engineer Softw are Rosetta Stone Translation Format Standardization Version Migration Persistent Ar chives Object Interchange Format APPLICABILITY Emulation Programmable Chips Specific Viewer Maintain original technology Preserve Technology Preserve Objects OBJECTIVE Source: Thibodeau, 2002.
Slide 9: The problem of rights
Slide 10: Preservation strategies Media management Secure storage Description Capture Selection Renderability Viability Integrity Identity Availability The Preservation Pyramid
Slide 11: Authenticity
Slide 12: Traditionally, preserving things meant keeping them unchanged; however … if we hold on to digital information without modifications, accessing the information will become increasingly more difficult, if not impossible. From: The Paradox of Preservation, Su-Shing Chen
Slide 13: “Preservation metadata ...is the information necessary to maintain the viability, renderability, and understandability of digital resources over the long-term.” OCLC/RLG Preservation Metadata Framework Working Group Understandability
Slide 14: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability Revised Preservation Pyramid
Slide 15: Who is doing preservation? Research Libraries Government Archives Historical Societies Individual Collectors
Slide 16: Who is doing digital preservation? Research Libraries Government Archives Historical Societies Individual Collectors National Libraries Research Centers Public broadcasting
Slide 17: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability DSPACE
Slide 18: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability LOCKSS
Slide 19: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability OCLC Digital Archive
Slide 20: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability LC Minerva
Slide 21: Authenticity Preservation strategies Media management Secure storage Description Capture Selection Understandability Renderability Viability Integrity Identity Availability FCLA Digital Archive
Slide 22: Preservation in Action
Slide 24: State Universities FCLA
Slide 25: •Designed as a “dark archive” •Preservation repository functions only •Based on OAIS functional architecture •“Bit-level” and “Full” preservation •Format migration and normalization
Slide 26: OAIS Functional Architecture P s rv tio P n in re e a n la n g P R O D U C E R D s rip e e c tiv In fo D s rip e e c tiv D ta a In fo Mn g mn aae et 4 .2 -1 In e t gs S IP A IP Aha rc iv l S ra e to g Ac s ces qe s u rie re u s ts s lt e oe rd rs A IP D IP C O N S U M E R A m is tio d in tra n MN GMN AAE ET
Slide 27: DAITSS Functional Architecture L I B R A R Y SIP Ingest Reporting L I B Access Mgmt DB AIP Storage management DIP R A R Y
Slide 28: DAITSS Data Model Information Package Data File (1..n) Bitstream (0..n) Intellectual entity (1)
Slide 29: DAITSS Data File Object D a t a F i le M a r k u p F i le XML SGML T I F F F ile T e x t F i le DTD P D F F ile DAITSS Bitstream Object B it s t r e a m A u d io Im a g e T IF F Im a g e T e xt V id e o J P E G Im a g e
Slide 30: Risk Management •Storing multiple master copies of files •Calculating two message digests •Storing metadata as XML and in RDBMs •Normalizing when possible •Always retaining original •Action plans and background papers
Slide 31: Ingest Functions           METS validation and metadata extraction Virus check and checksum verification File format identification Creation of Data File and Bitstream objects Harvesting of external files Normalization and Forward Migration Technical, relationship and event metadata AIP creation Storage update Data table update
Slide 32: Ingest Example: A simple SIP XML SIP PDF AVI
Slide 33: AIP XML XML XML XML PDF AVI SIP XML TIFF TIFF TIFF XML XML Database
Slide 34: Future Plans  Find partners to install at other places  Finish DAITSS  Release under open source license  Build a community of developers for different formats
Slide 35: References  Priscilla Caplan: www.fcla.edu/~pcaplan, pcaplan@ufl.edu  FCLA Digital Archive: www.fcla.edu/digitalArchive  Terry Kuny, “A Digital Dark Ages?” www.ifla.org/IV/ifla63/63kuny1.pdf  PREMIS Implementation Survey www.oclc.org/research/projects/pmwg/surveyreport.pdf  Roy Rosenzweig, “Scarcity or Abundance?” www.historycooperative.org/journals/ahr/108.3/rosenzweig .html  O’Neil et al. “Trends in the Evolution of the Public Web” www.dlib.org/dlib/april03/lavoie/04lavoie.html  Clifford Lynch, “Authenticity and Integrity in the Digital Environment” www.clir.org/pubs/reports/pub92/lynch.html