Slide 1: Unlock Content™
Enterprise Metadata Catalogs with MarkLogic XML Server
Chris.Biow@marklogic.com Chief Technologist, Federal
Slide Slide Slid
Slide 2: Agenda
Mark Logic Company MarkLogic Server Creating and Using an Enterprise Metadata Catalog
Slide Slide
Slide 3: About Mark Logic Mark Logic Corporation is the provider of the industry's leading XML server
Top-tier customers: DISA, U.S. Air Force METIS, U.S. Army, State Dept., Intelligence Community, JetBlue, United, Lexis-Nexis, Oxford University, JP Morgan, Harvard Business School Publishing Headquarters in San Carlos, California (Silicon Valley) Strong financial backing: Sequoia Capital ~120 employees, ~120 customers Ranked 4th fastest growing tech firm in Silicon Valley, Deloitte, Oct 2008
Slide Slide
Slide 4: Agenda
Mark Logic Company MarkLogic Server Creating and Using an Enterprise Metadata Catalog
Slide Slide
Slide 5: MarkLogic XML Server as Platform
Platform Users don’t know or care what category it falls under Database Database API Query language (XQuery vice SQL) DB for XML Text is a first class citizen Search engine Under the hood Wired up like a search engine Performs like a search engine Built into the database kernel Transactional No latency Content Management System
Slide Slide
Slide 6: MarkLogic XML Server Process
Load
Query
Manipulate
Render
Load
Load content “as-is”, convert as necessary, automatically index
Query
Full text search, XML search, and XQuery
Manipulate
Navigate, merge, update and transform content
Render
Format content for multi-channel delivery
Slide Slide
Slide 7: MarkLogic XML Server Process
Load Built-in Web Interface Services (REST, ATOM, SOAP) or Java/.NET Multiple schemas Query XQuery Across schemas Manipulate Convert schemas Federate with other engines Render Web Service Web Application (XHTML, RSS, KML, GML, OOXML, xyzML)
Slide Slide
Slide 8: Enterprise Metadata Catalog Pilot
Net-Centric Enterprise Services (NCES) …enables information sharing by connecting people and systems that have information (data and services) with those who need information. DoD Discovery Metadata Specification defines discovery metadata elements for resources posted to community and organizational shared spaces. http://metadata.dod.mil/mdr/irs/DDMS/ Derived from Dublin Core Metadata Initiative Extensible by communities Modeling and Simulation Intelligence Community Information Security Markings
Slide Slide
Slide 9: The Schema Change Problem
DDMS history V2.0 (July 17, 2008) V1.4 (July 1, 2007) V1.3 (July 29, 2005) V1.2 (January 3, 2005) V1.1 (July 1, 2004) V1.0 (September 29, 2003) Alternative approaches Wait until everything is migrated into one, stable standard hell freezes over Continual data conversion Typically six-month schema redevelopment cycle Schema agnostic database Load as-is Query, Manipulate, and Redner on-the-fly
Slide Slide
Slide 10: The Schema Extension Problem
Rigid schema enforcement Solves implementation problems Satisfies nobody Extended informally, anyway Title: “Building a better mousetrap” (physical chemistry methods) Extensibility Communities of Interest Modeling and Simulation http://www.gwvi.ncr.gov/resource_discovery.html Joint Strike Command and Communications Assessment Records Management Community Requirements Intelligence Community Information Security Markings
Slide Slide
Slide 11: Agenda
Mark Logic Company MarkLogic Server Creating and Using an Enterprise Metadata Catalog
Slide Slide
Slide 12: Requirements
Web Service Deliverable ATOM Publishing Protocol REST Web Services User permissions for collections RSS feed For any collection For any query Web Application Consume the local REST service Transform to XHTML Looks like any other Web Application User doesn’t know or care what is behind it
Slide Slide
Slide 13: Slide Slide
Slide 14: Slide Slide
Slide 15: Slide Slide
Slide 16: Slide Slide
Slide 17: Slide Slide
Slide 18: Slide Slide
Slide 19: Slide Slide
Slide 20: Slide Slide
Slide 21: Slide Slide
Slide 22: Slide Slide
Slide 23: Slide Slide
Slide 24: Future Directions
Pervasive XML Data source Communication XQuery Application (Service, AJAX, XHTML) Web 2.0+ expectations Schema change and extensibility
Slide Slide