Slide 1: Devoteam Mainland Training Information Security Business Continuity Planning & Disaster Recovery Tini Schuurmans, CISSP
Slide 2: Definition of a Disaster A sudden, unplanned calamitous event that brings about great damage or loss. Any event that creates an inability on the organization’s part to provide critical business function for some undetermined period of time. (Source: Disaster Recovery Journal, 7-9-90) Although a disaster cannot be planned, the business continuity and recovery CAN be planned. 2 Business Continuity Planning & Disaster Recovery
Slide 3: Recovery Planning Definition The advance planning and preparations which are necessary to minimize loss and ensure the availability of the critical information systems of an organization. 3 Business Continuity Planning & Disaster Recovery
Slide 4: BCP vis-à-vis DRP  Business continuity planning • Ensures the continuity of critical business functions • Facilitates rapid recovery measures to reduce overall impact of a potentially disastrous business interruption • Not necessarily IT related  Disaster recovery planning • Procedures for emergency response, extended backup operations & post-disaster recovery when an organization suffers a loss of computer resources & physical facilities • IT related 4 Business Continuity Planning & Disaster Recovery
Slide 5: Agenda  Business Continuity Planning  Disaster Recovery Planning  Disaster prevention 5 Business Continuity Planning & Disaster Recovery
Slide 6: Business Continuity Planning 6 Business Continuity Planning & Disaster Recovery
Slide 7: What’s Involved  Business depends on variety of information systems • • • • • Centralized, general-purpose systems Distributed systems Special-purpose systems Web-based systems Communication systems 7 Business Continuity Planning & Disaster Recovery
Slide 8: Who’s Involved  Executive management staff • Consistent support of planning process • Final approval of the BCP  Senior functional management • Identify & prioritize mission-critical systems  Central BCP program committee • Coordinates representing all organizational elements involved in planning, implementing & monitoring • Corporate auditors 8 Business Continuity Planning & Disaster Recovery
Slide 9: Why Plan  Fortune 100 study • Average hourly loss from outage - $78,000 • Some projected losses up to $500,000 • >65% of businesses losing computing support for >1 week never reopen • Many would fail after 3 days outage  The loss of dollars isn’t nearly as important as the loss of market share  If you’re not able to meet your commitments to clients because you can’t process, they’ll go to someone who can • The competitor is just 1 click down the block 9 Business Continuity Planning & Disaster Recovery
Slide 10: Disaster Recovery Planning 10 Business Continuity Planning & Disaster Recovery
Slide 11: Disaster Recovery Planning  Identify critical computing resources  Determining potential events affecting resources  Planning to respond to events 11 Business Continuity Planning & Disaster Recovery
Slide 12: DRP Objectives  Protect organization if all or a part of its computer services become unusable  Provide a sense of security  Minimize risk of delays in services  Guarantee reliability f standby systems  Provide a standard for testing the plan  Minimize decision-making during a disaster 12 Business Continuity Planning & Disaster Recovery
Slide 13: Disaster Recovery notes  Preparing a full-scale disaster recovery plan can take as long as three year  You don’t see a reward (from money spent on disaster protection). If you don’t use it, it’s like throwing money away. But if need it, it’s priceless.  What is a disaster recovery plan • A comprehensive statement of consistent actions to be taken before, during, and after a disaster that causes a significant loss of information system resources 13 Business Continuity Planning & Disaster Recovery
Slide 14: Generic Recovery Planning Process Project Initiation Business Impact Analysis Recovery Strategy Development Recovery Plan Development Implementation, Maintenance, Testing, Documentation & Training 14 Business Continuity Planning & Disaster Recovery
Slide 15: Project Initiation Phase  Obtaining management support  Staffing considerations • Technical support • Telecommunications specialists  Project scope, funding, management structure, charter  DRP policy development  DRP disaster scenario assumptions 15 Business Continuity Planning & Disaster Recovery
Slide 16: Business Impact Analysis (BIA)  Develop customized BIA materials  Gather qualitative & quantitative impact information  Analyze & interpret impact information  Document BIA results  Prepare and present recommendations for approval 16 Business Continuity Planning & Disaster Recovery
Slide 17: Recovery Strategy Development  Compile resource requirements  Identify recovery alternatives  Document recovery strategy  Prepare recovery recommendations and present for approval 17 Business Continuity Planning & Disaster Recovery
Slide 18: Recovery Plan Development  Develop recovery plan formats  Prepare and formalize recovery plan(s) 18 Business Continuity Planning & Disaster Recovery
Slide 19: Implementation, Maintenance & Testing  Develop & document recovery plan implementation strategy  Develop & document plan maintenance strategy  Develop & document plan testing strategy  Present strategies for management approval 19 Business Continuity Planning & Disaster Recovery
Slide 20: Documentation  Distribute dual hard copies to a limited distribution list on a need-to-know basis  1 for home – 1 for office  Master backup copy off-site, e.g. with backup tapes  Make different versions for different people 20 Business Continuity Planning & Disaster Recovery
Slide 21: Program Elements  Senior-level executive direction  Centralized program management  Enterprise-wide organization for planning  Training and awareness  Regular drills and testing  Interfacing with external groups 21 Business Continuity Planning & Disaster Recovery
Slide 22: Senior-Level Executive Direction  Executive commitment & support most critical element • • • • • • • • Policy statement Management letter Budget Planning Regulatory requirements Organizational vulnerability to interruption Current status of recovery plans Recommended actions, including draft policy statement  Business case must be made to obtain necessary support 22 Business Continuity Planning & Disaster Recovery
Slide 23: Centralized Program Management  Central program management required • Cost, complexity & interrelationship of plans  Program manager responsibilities • Work with executive management to establish policy & schedules • Develop/select planning standards/methodology • Establish, train & support network of planners • Coordinate common requirements • Monitor progress & report to management • Serve as organization representative in dealing with external groups 23 Business Continuity Planning & Disaster Recovery
Slide 24: Enterprise-wide Planning (1)  Plans must be prepared by those who will carry them out  Planning organization will include representatives from all critical business & support units  Business (line) unit planners • Develop plans to restore critical product/service delivery capability • Obtain management approval of milestone deliverables • Manage testing & maintenance activities 24 Business Continuity Planning & Disaster Recovery
Slide 25: Enterprise-wide Planning (2)  Support (staff) unit planners • Develop plans to support critical business functions • Dependent on business unit planners to forward requirements • Responsibilities otherwise similar to those of business unit planners when identifying and assuring the availability of their critical assets 25 Business Continuity Planning & Disaster Recovery
Slide 26: Training & Awareness  Recovery planning staff training • Far easier to reach DRP skills than in-depth knowledge of business • Each organization’s approach will have unique aspects • If using detailed planning methodology, specific training required • Quality training significantly increases interest & commitment  Other staff general awareness training • Heighten appreciation of need & usefulness of DRP • Ultimate recovery capability will depend on may • Emphasize organization’s commitment to employees 26 Business Continuity Planning & Disaster Recovery
Slide 27: Interfacing with External Groups         Customers Shareholders Civil officials Local and national emergency service groups Utility providers The press Industry group coalitions Others 27 Business Continuity Planning & Disaster Recovery
Slide 28: Complications Beyond the Actual Disaster  Media & police  Responsibility to families  Fraud opportunities  Looting & vandalism  Safety & legal problems  Expenses exceeding emergency manager authority  Other 28 Business Continuity Planning & Disaster Recovery
Slide 29: Dealing with Media & Others  Establish unified organization response • Convey by credible, trained, informed spokesperson  Be accessible to media so they don’t go to other sources  Report your own bad news – don’t appear to be covering up  Tell story quickly, openly, honestly • Avoid suspicion & rumors  Determine appropriate clearance & approval processes 29 Business Continuity Planning & Disaster Recovery
Slide 30: Vulnerability Assessment Goals  Understand economic & operational impact of disruption  Determine recovery time-frame for critical systems • Business (line) functions • Support (staff) functions • Network services  Identify most appropriate recovery strategy  Cost-justify recovery planning  Bring disaster recovery planning into normal business decision-making process 30 Business Continuity Planning & Disaster Recovery
Slide 31: Vulnerability Assessment Process  Identify essential business functions  Conduct loss impact analysis • Financial • Operational  Summarize & recommend recovery priorities 31 Business Continuity Planning & Disaster Recovery
Slide 32: Areas BCP Should Address  Facility considerations • Main building, remote facilities incl. Off-site storage & backup site(s)  People • Operations/technical/support community  Hardware • Mainframe/PCs/network/storage/print/communications  Software • Applications/Operating Systems  Supplies & equipment • Paper/forms/typewriters/UPS/HVAC  Procedures 32 Business Continuity Planning & Disaster Recovery
Slide 33: System Backup Alternatives (1)  Reciprocal/mutual aid agreements  Subscription services • Hot site – Fully configured (HW/SW/network/communications/HVAC compatible with client) – Available in hours • Warm site – Hot site without expensive equipment (computers reliable & quickly obtained) – Ready in hours after equipment arrives • Cold site – HVAC & wired – ready for equipment 33 Business Continuity Planning & Disaster Recovery
Slide 34: System Backup Alternatives (2)  Multiple centers • Enterprise co-location  Service bureaus  Other data center backup alternatives • Rolling hot sites • Prefabricated buildings  Distributed systems backup options 34 Business Continuity Planning & Disaster Recovery
Slide 35: Data & Applications Backup Alternatives  Electronic vaulting • Bulk transport of backup media  Remote journaling • Transmission of journal/transmission log data to off-site location  Database shadowing • Using remotely journaled data  Standby services • Operating critical applications at the remote site 35 Business Continuity Planning & Disaster Recovery
Slide 36: Recovery & Restoration planning  Recovery of critical functions  Salvage & repair  Restoration of normal operations 36 Business Continuity Planning & Disaster Recovery
Slide 37: Recovery of Critical Functions  Recovery team to alternate site  Retrieve needed materials from off-site storage  Install needed equipment and communications  Install critical systems, applications and data  Resume critical work 37 Business Continuity Planning & Disaster Recovery
Slide 38: Salvage & Repair  Separate team to return primary site to normal  Identify sources of expertise, equipment, supplies • Cleaning equipment/media after smoke damage • Removal of standing water • Drying out water damaged media/documents  Team includes representative from insurance company 38 Business Continuity Planning & Disaster Recovery
Slide 39: Restoration of Normal Operations  Emergency not over until back in primary site  Return from alternate site also a risk  Planning different from recovery plan • Least critical work back first  Risk reduction considerations • Facility construction & protection systems • Physical and information security measures 39 Business Continuity Planning & Disaster Recovery
Slide 40: Regular Drills & testing  No demonstrated capability until plan  Test exercise all components of plans  Test & drills prepare personnel to carry out emergency duties  Regular test schedule alerts management to changes affecting recovery capabilities 40 Business Continuity Planning & Disaster Recovery
Slide 41: Benefits of Regular Testing  Demonstrates ability to actually recover  Verifies compatibility of backup facilities  Ensures adequacy of team procedures  Identifies deficiencies in existing procedures  Trains team leader, members, & backups  Provides mechanism for maintaining & updating the plan  Include test result in regular management reporting 41 Business Continuity Planning & Disaster Recovery
Slide 42: Plan Testing  Testing types • Checklist • Structured walk-through • Simulation – Role play based on scenario • Parallel – Run at alternate site and compared with actual processing data • Full-interruption – Normal operations shut down 42 Business Continuity Planning & Disaster Recovery
Slide 43: Disaster Prevention 43 Business Continuity Planning & Disaster Recovery
Slide 44: Disaster Prevention Network disasters • • • • Cabling Topology Single point of failure Saving configuration files Server disasters • • • • • • UPS RAID Redundant servers Clustering Tape backup Server recovery 44 Business Continuity Planning & Disaster Recovery
Slide 45: Cabling (1)  Twisted pair • • • • Cheapest. Limited in distance & bandwidth Used within buildings or small areas Easily tapped Electromagnetic interference (EMI) can cause transmission errors, especially if cable is under heavy load 45 Business Continuity Planning & Disaster Recovery
Slide 46: Cabling (2)  Coaxial cable • Allow multiple systems to be attached to same segment of cable – Single point of failure • More expensive & resistant to electromagnetic interference 46 Business Continuity Planning & Disaster Recovery
Slide 47: Cabling (3)  Fiber optics • • • • • • Carries signals as light waves Higher speed, longer distance, many channels Excellent choice for heavy load networks Difficult to tap, resistant to interference Immune to effects of EMI Most expensive 47 Business Continuity Planning & Disaster Recovery
Slide 48: Cabling Security  Install cable in unexposed, protected spaces/ceilings  Pressurized conduit with alarm sensor  Shielded cable  (Armed) Fiber optic cable 48 Business Continuity Planning & Disaster Recovery
Slide 49: Single Points of Failure (1)  Best way to eliminate disasters is to identify single points of failure and build in redundancy  Creating single points of failure is most common mistake made in network design  Examples • Single firewall • Single router • Single leased line or E1 connection 49 Business Continuity Planning & Disaster Recovery
Slide 50: Single Points of Failure (2)  Be careful with consolidated equipment • Chassis hubs • Switches  Take advantage of redundant LAN routes • Multiple paths between routers • Dynamic routing protocols like OSPF • Purchase other routers and network cards for redundancy 50 Business Continuity Planning & Disaster Recovery
Slide 51: Single Points of Failure (3)  Dial backup for WAN connections • Configure routers to fall over to a backup circuit if primary line goes down – Analog line with modems – ISDN • Build systems that are BA, HA, and CA compliant – Basic Availability – High Availability: normally not planned for outages – Continuous Availability: taken care of planned outages 51 Business Continuity Planning & Disaster Recovery
Slide 52: Saving Configuration Files  When network device fails, configuration that has been programmed into it can be lost • Routers, switches, firewalls, etc.  Terminal logging • Allows saving of configuration files • Recording info that passes on terminal screen  TFTP (Trivial File Transfer Protocol) • Most networking devices support TFTP for saving and retrieving information • Single TFTP server can archive configuration files for every device on the network 52 Business Continuity Planning & Disaster Recovery
Slide 53: (Uninterruptible Power Supply)  Provide a source of clean and steady power  Prevents blackouts, brownouts, surges, spikes, etc.  Critical for servers  Consider intelligent UPS systems UPS 53 Business Continuity Planning & Disaster Recovery
Slide 54: (Redundant Array of Inexpensive Disks)  Provides fault tolerance against hard disk crashes • Parity information & disk mirroring Raid  Improves system performance • Multiple disks work together in order to save large files simultaneously  Process of breaking up data across multiple disks is called ‘striping’  Implemented as either hardware or software solution 54 Business Continuity Planning & Disaster Recovery
Slide 55: Redundant Servers  Takes concept of RAID and applies it to entire computer  AKA server fault tolerance  Provide one or more entire systems to be available in case primary one Ethernet crashes Primary Server 100 Mb server link Secondary Server Workstation Workstation Ethernet Workstation 55 Business Continuity Planning & Disaster Recovery
Slide 56: Clustering (1)  Similar to redundant servers except that all systems take part in processing service requests  Cluster acts as an intelligent unit in order to balance traffic load  From a client’s perspective, a cluster looks like a single, yet very fast server 56 Business Continuity Planning & Disaster Recovery
Slide 57: Clustering (2)  If server fails, processing continues, but with a degradation in performance  More attractive than server redundancy because secondary systems actually providing processing time  Boosts fault tolerance and performance 57 Business Continuity Planning & Disaster Recovery
Slide 58: Tape Backup  Protecting or restoring lost, corrupted, deleted information  Safeguarding the information which actually gets stored on server 58 Business Continuity Planning & Disaster Recovery
Slide 59: Tape Backup  Three methods of selecting files • Full backup – Complete archive of every file • Incremental backup – Copies only files that have been changed since a full or incremental backup was last performed • Differential backup – Copies only files that have been changed since a full backup was last performed 59 Business Continuity Planning & Disaster Recovery
Slide 60: Other Backup Media  CD optical media • Recordable • Rewritable  Zip drives  Jazz drives 60 Business Continuity Planning & Disaster Recovery
Slide 61: Hierarchical Storage Management (HSM)  HSM combines hard disk technology with use of low cost/Mb optical and tape juke boxes • Appears to network as infinite drive • Continuous on-line backup package After X days After Y days Server Optical drive Tape drive 61 Business Continuity Planning & Disaster Recovery
Slide 62: Questions 62 Business Continuity Planning & Disaster Recovery
Slide 63: Devoteam Mainland Training Information Security Business Continuity Planning & Disaster Recovery Tini Schuurmans, CISSP