Hide Notes 

Slide 1: Welcome & Project Update Ian Pratt Keir Fraser Xen Summit at Oracle Feb 24-25, 2009
Slide 2: Attendee Profile 100+ Attendees  8+ Countries  36+ Companies  5+ Universities  Xen Summit at Oracle Feb 24-25, 2009
Slide 3: Program Committee Dan Magenheimer – Oracle  Jose Renato Santos – HP  Jun Nakajima - Intel  John Janakiraman – Skytap  Alex Vasilevsky – Virtual Computer  Victor Hugo dos Santos  Sang-bum Suh - Samsung  Hitoshi Matsumoto - Fujitsu  Thanks for putting together a great event! Xen Summit at Oracle Feb 24-25, 2009
Slide 4: Event Information • Breakout Room Available During Event • Room 105 • See handout for Wireless Setup • Lunch – Provided for Registered Attendees at Conference Center • Abstracts & Speaker Profiles at http://www.xen.org/community/xensummit.html Xen Summit at Oracle Feb 24-25, 2009
Slide 5: Evening Event – Tuesday http://www.computerhistory.org/ 6:30 pm – 9:30 pm • Dinner, Wine, Beer, and Sodas • 2 Guides for Private Museum Tours • Directions at Registration Table • Sign-up Sheet for Carpooling Xen Summit at Oracle Feb 24-25, 2009
Slide 6: Xen Summit Gear  Xen Summit Jackets Carabiners for Event Pass  Xen Summit at Oracle Feb 24-25, 2009
Slide 7: Agenda Overview - Tuesday 9:30 – 10:00 am 10:00 – 10:30 am 10:50 – 11:10 am 11:10 – 11:40 am 11:40 – 12:15 pm 1:15 - 1:45 pm 1:45 – 2:05 pm 2:05 – 2:35 pm 2:35 – 3:05 pm 3:30 – 4:00 pm 4:00 – 4:20 pm 4:20 – 4:40 pm Welcome and Project Status Roadmap & Releases Difference Engine PVOPS Status Transcendent Memory on Xen Satori: Enlightened Page-Sharing Paravirtualized USB Support PCI-Pass Through Techniques Status of SR-IOV & VT-D Cross Vendor Migration Power Management in Xen Detecting and Correcting Transient Errors via Xen Xen Summit at Oracle Feb 24-25, 2009
Slide 8: Agenda Overview - Wed 9:00 – 9:30 am 9:30 – 10:00 am 10:00 – 10:30 am 10:45 – 11:00 am 11:00 – 11:30 am 11:30 – 12:00 1:00 – 1:30 pm 1:30 – 2:00 pm 2:00 – 2:30 pm 2:30 – 3:00 pm 3:30 – 4:00 pm 4:00 – 4:30 pm Open Nebula VM Manager Client Virtualization Framework Tralfamadore VM Snapshots Real-time and VMM Nested Page Tables Project Zentific Just Run It 3D Rendering on Xen REFLINK Operation in ocfs2 Achieving 10GB/s Paravirt Drivers Xen Scalability Xen Summit at Oracle Feb 24-25, 2009
Slide 9: Xen Summit Europe at LinuxTAG Xen Summit at Oracle Feb 24-25, 2009
Slide 10: Overview • XenEmbedded • XenClient • HostedXen • Xen Introspection API Xen Summit at Oracle Feb 24-25, 2009
Slide 11: XenEmbedded • Small footprint Xen environment • For embedding into Servers, Desktops, Laptops, Routers, Storage Arrays • buildroot/busybox/uclibc based • 8MB compressed image size • xenvm/xenops embedded toolstack • Simple configuration file • Process per VM with control socket • Fast booting • See xenbits.xen.org/xenclient Xen Summit at Oracle Feb 24-25, 2009
Slide 12: XenClient • Repository for bleeding-edge client related work, feeding in to xen-unstable • Enhanced device pass-through • Intel, ATI, nVidia graphics • Power conservation and suspend • ACPI/SMBIOS virtualization • function keys, battery state, etc • Secure mouse/keyboard routing • Graphics virtualization • Fast boot and measured launch • Enhanced USB emulation • “In-place P2V”, easy to install Xen Summit at Oracle Feb 24-25, 2009
Slide 13: Hosted Xen • Xen engine run as a kernel module to enable hosted (type-2) VMM • Runs on Windows and OSX today • Enables Xen to also compete with other type-2 VMMs • KVM, VirtualBox, Parallels, VirtualPC, VMWare Workstation/ACE/Fusion • Looses the security and isolation benefits of a true type-1 hypervisor, but Xen Summit at Oracle Feb 24-25, 2009 still useful in some scenarios
Slide 14: Hosted Xen • Xen loaded as an ELF module, linked via dispatch table into host kernel • Less than 1000 LOC to plumb Xen module into Windows and OSX • Leverages all of the great feature development, optimization, broad testing that's done on Xen • Latest hardware support, SMP guests, PV drivers etc Xen Summit at Oracle Feb 24-25, 2009
Slide 15: Xen Introspection API • API to enable monitoring and control of VMs by a suitably privileged entity • CPU, memory, disk, network, etc • Enables Security, Forensics, Debugging, System Management • Georgia Tech Xen Access library • Accessing memory, pagetable walking • Shadow/HAP enhancements for trap-on access/write/execute • UofAlaska/UC Davis VIX Xen Summit at Oracle Feb 24-25, 2009
Slide 16: Observations • Security is becoming increasingly important in virtualization • Xen as a true type-1 is well placed • Must continue disaggregation and deprivileging campaign • Must continue to foster academic research on and using Xen • Community must help turn prototypes into production code Xen Summit at Oracle Feb 24-25, 2009
Slide 17: Xen Releases and Roadmap Keir Fraser 02/25/09 Xen Summit at Oracle Feb 24-25, 2009 17
Slide 18: Release plans Current stable releases: 3.2.3 and 3.3.1 Both released in early January Next releases: 3.3.2 and 3.4.0 Both anticipated around Easter time Ongoing strategy: Maintain two stable branches until the later one has matured enough for switchover Quarterly releases from stable branches Six to nine months between major releases Xen Summit at Oracle Feb 24-25, 2009 02/25/09 18
Slide 19: Memory management More efficient heap allocators No separate ‘xenheap’ Better ‘malloc’ Populate-on-demand HVM guest memory Boot an HVM guest with a big memory map But no need to allocate it all up front OS won’t use much memory during boot And then balloon driver can claim large swathes Xen Summit at Oracle Feb 24-25, 2009 02/25/09 19
Slide 20: Page sharing Potential for reducing memory pressure by sharing identical pages across VMs Significant savings in ‘ideal’ cases Rather smaller gains in typical heterogeneous scenarios (10-20%) How to find identical pages? Memory scanning vs. disc block tracking Allows memory overcommit Hence requires demand paging Or don’t give spare pages directly back to guests Xen Summit at Oracle Feb 24-25, 2009 02/25/09 20
Slide 21: Virtual block devices: blktap2 Support VHD storage format Snapshot virtual disks Checkpoints, backups, gold images, etc Live coalescing of snapshots Simplified kernel support Leverage blkback Simpler invocation model More generic, easier test and debug 21 Xen Summit at Oracle Feb 24-25, 2009
Slide 22: Cross-hypervisor compatibility Viridian interface CPUID, hypercalls Actually turn on just a few optimisations And turn off some annoying checks VHD format support Xen Summit at Oracle Feb 24-25, 2009 22
Slide 23: High availability Detect hardware failures Hardware-based: Machine Check Architecture Software-based: e.g., compare replicas React appropriately… CPU/memory offlining Disable the offending hardware Switch to a ‘hot spare’ UBC’s ongoing Remus project Kemari developed at NTT Japan Xen Summit at Oracle Feb 24-25, 2009 23
Slide 24: Network performance Network virtualisation is particularly hard High packet rates; latency sensitive Existing netfront/back drivers have limitations High cost for packet receive Not designed for next-generation NICs Ongoing work on netchannel2 to address this Lazy copy in the guest (reduces dom0 load) Provide guest a copy-only, sub-page, revocable grant Support multi-queue NICs DMA directly to guest buffers Reusable extensible ring architecture Xen Summit at Oracle Feb 24-25, 2009 02/25/09 24
Slide 25: Security Deprivileged service domains Qemu-dm, pvgrub, … Secure boot Measurement and containment Xen Introspection Project Allow guest state to be monitored and dissected Read memory, registers, etc Callbacks when critical state is modified Virus scanners, test/debug, … Xen Summit at Oracle Feb 24-25, 2009 02/25/09 25
Slide 26: Power management Range timers fuzzy deadlines, allowing batched firing and fewer wakeups Selectable PM policy Admin can choose governor to trade off power vs performance Smarter scheduling Further work is ongoing: George Dunlap, Intel, etc Xen Summit at Oracle Feb 24-25, 2009 02/25/09 26
Slide 27: Managing development Use the developer mailing list xen-devel@lists.xensource.com Requests for comments Announcements of dev plans Patches posted for comment, review and checkin Use the wiki http://wiki.xensource.com/xenwiki/XenRoadMap Xen Summit at Oracle Feb 24-25, 2009 27
Slide 28: Welcome & Project Update Ian Pratt Keir Fraser Xen Summit at Oracle Feb 24-25, 2009 1
Slide 29: Attendee Profile 100+ Attendees  8+ Countries  36+ Companies  5+ Universities  Xen Summit at Oracle Feb 24-25, 2009 2
Slide 30: Program Committee Dan Magenheimer – Oracle Jose Renato Santos – HP  Jun Nakajima - Intel  John Janakiraman – Skytap  Alex Vasilevsky – Virtual Computer  Victor Hugo dos Santos  Sang-bum Suh - Samsung  Hitoshi Matsumoto - Fujitsu   Thanks for putting together a great event! Xen Summit at Oracle Feb 24-25, 2009 3
Slide 31: Event Information • Breakout Room Available During Event • Room 105 • See handout for Wireless Setup • Lunch – Provided for Registered Attendees at Conference Center • Abstracts & Speaker Profiles at http://www.xen.org/community/xensummit.html Xen Summit at Oracle Feb 24-25, 2009
Slide 32: Evening Event – Tuesday http://www.computerhistory.org/ 6:30 pm – 9:30 pm • Dinner, Wine, Beer, and Sodas • 2 Guides for Private Museum Tours • Directions at Registration Table • Sign-up Sheet for Carpooling Xen Summit at Oracle Feb 24-25, 2009
Slide 33: Xen Summit Gear  Xen Summit Jackets Carabiners for Event Pass  Xen Summit at Oracle Feb 24-25, 2009 6
Slide 34: Agenda Overview - Tuesday 9:30 – 10:00 am 10:00 – 10:30 am 10:50 – 11:10 am 11:10 – 11:40 am 11:40 – 12:15 pm 1:15 - 1:45 pm 1:45 – 2:05 pm 2:05 – 2:35 pm 2:35 – 3:05 pm 3:30 – 4:00 pm 4:00 – 4:20 pm 4:20 – 4:40 pm Welcome and Project Status Roadmap & Releases Difference Engine PVOPS Status Transcendent Memory on Xen Satori: Enlightened Page-Sharing Paravirtualized USB Support PCI-Pass Through Techniques Status of SR-IOV & VT-D Cross Vendor Migration Power Management in Xen Detecting and Correcting Transient Errors via Xen Xen Summit at Oracle Feb 24-25, 2009 7
Slide 35: Agenda Overview - Wed 9:00 – 9:30 am 9:30 – 10:00 am 10:00 – 10:30 am 10:45 – 11:00 am 11:00 – 11:30 am 11:30 – 12:00 1:00 – 1:30 pm 1:30 – 2:00 pm 2:00 – 2:30 pm 2:30 – 3:00 pm 3:30 – 4:00 pm 4:00 – 4:30 pm Open Nebula VM Manager Client Virtualization Framework Tralfamadore VM Snapshots Real-time and VMM Nested Page Tables Project Zentific Just Run It 3D Rendering on Xen REFLINK Operation in ocfs2 Achieving 10GB/s Paravirt Drivers Xen Scalability Xen Summit at Oracle Feb 24-25, 2009 8
Slide 36: Xen Summit Europe at LinuxTAG Xen Summit at Oracle Feb 24-25, 2009 9
Slide 37: Overview • XenEmbedded • XenClient • HostedXen • Xen Introspection API Xen Summit at Oracle Feb 24-25, 2009
Slide 38: XenEmbedded • Small footprint Xen environment • For embedding into Servers, Desktops, Laptops, Routers, Storage Arrays • buildroot/busybox/uclibc based • 8MB compressed image size • xenvm/xenops embedded toolstack • Simple configuration file • Process per VM with control socket • Fast booting • See xenbits.xen.org/xenclient Xen Summit at Oracle Feb 24-25, 2009
Slide 39: XenClient • Repository for bleeding-edge client related work, feeding in to xen-unstable • Enhanced device pass-through • Intel, ATI, nVidia graphics • Power conservation and suspend • ACPI/SMBIOS virtualization • function keys, battery state, etc • Secure mouse/keyboard routing • Graphics virtualization • Fast boot and measured launch • Enhanced USB emulation • “In-place P2V”, easy to install Xen Summit at Oracle Feb 24-25, 2009
Slide 40: Hosted Xen • Xen engine run as a kernel module to enable hosted (type-2) VMM • Runs on Windows and OSX today • Enables Xen to also compete with other type-2 VMMs • KVM, VirtualBox, Parallels, VirtualPC, VMWare Workstation/ACE/Fusion • Looses the security and isolation benefits of a true type-1 hypervisor, but Xen Summit at Oracle Feb 24-25, 2009 still useful in some scenarios
Slide 41: Hosted Xen • Xen loaded as an ELF module, linked via dispatch table into host kernel • Less than 1000 LOC to plumb Xen module into Windows and OSX • Leverages all of the great feature development, optimization, broad testing that's done on Xen • Latest hardware support, SMP guests, PV drivers etc Xen Summit at Oracle Feb 24-25, 2009
Slide 42: Xen Introspection API • API to enable monitoring and control of VMs by a suitably privileged entity • CPU, memory, disk, network, etc • Enables Security, Forensics, Debugging, System Management • Georgia Tech Xen Access library • Accessing memory, pagetable walking • Shadow/HAP enhancements for trap-on access/write/execute • UofAlaska/UC Davis VIX Xen Summit at Oracle Feb 24-25, 2009
Slide 43: Observations • Security is becoming increasingly important in virtualization • Xen as a true type-1 is well placed • Must continue disaggregation and deprivileging campaign • Must continue to foster academic research on and using Xen • Community must help turn prototypes into production code Xen Summit at Oracle Feb 24-25, 2009
Slide 44: .org Xen Releases and Roadmap Keir Fraser 02/25/09 Xen Summit at Oracle Feb 24-25, 2009 17 17
Slide 45: Release plans Current stable releases: 3.2.3 and 3.3.1 Both released in early January Next releases: 3.3.2 and 3.4.0 Both anticipated around Easter time Ongoing strategy: Maintain two stable branches until the later one has matured enough for switchover Quarterly releases from stable branches Six to nine months between major releases Xen Summit at Oracle Feb 24-25, 2009 02/25/09 18
Slide 46: Memory management More efficient heap allocators No separate ‘xenheap’ Better ‘malloc’ Populate-on-demand HVM guest memory Boot an HVM guest with a big memory map But no need to allocate it all up front OS won’t use much memory during boot And then balloon driver can claim large swathes Xen Summit at Oracle Feb 24-25, 2009 02/25/09 19 Amazon * Mar 1999 HotOS paper on XenoServers * XXX grant application [lessons from the Nemesis experience - the importance of compatibility] [accounting and billing at core (unlike PlanetLab] [speed of light, something fundamental] [struggle for funding] * Aug 2002 Xen development started [pub bet] * [2002 XenoServers project funded] * Oct 2003 SOSP paper "Xen and the Art of Virtualization" [could have stopped, interesting platform, keep going to build something real] [Enterprise software is hard, respect for folk that make stuff work] [resource revocation, 24x7 operation, benchmarks] * Apr 2004 Xen 1.0 released * Jun 2004 First Xen developer's meeting at OLS * Nov 2004 Xen 2.0 released * Dec 2004 XenSource formed * working with CPU and IO hardware vendors * RedHat, Novell, Sun adopt Xen in their OSes * Microsoft and VMware adopt paravirtualziation * Sep 2006 XenEnterprise released [Oct 2007 XenSource acquired by Citrix Systems Inc] * May 2008 XenServer 3.2 embedded in flash memory on Dell and HP servers [proud, part of the platform, ubiquitous, back to the 1970's] 19
Slide 47: Page sharing Potential for reducing memory pressure by sharing identical pages across VMs Significant savings in ‘ideal’ cases Rather smaller gains in typical heterogeneous scenarios (10-20%) How to find identical pages? Memory scanning vs. disc block tracking Allows memory overcommit Hence requires demand paging Or don’t give spare pages directly back to guests Xen Summit at Oracle Feb 24-25, 2009 02/25/09 20 Satori – Enlightened guests detect sharing opportunities and give up memory when sharing breaks Difference Engine – all automatic Tmem – a different plan for spare memory
Slide 48: Virtual block devices: blktap2 Support VHD storage format Snapshot virtual disks Checkpoints, backups, gold images, etc Live coalescing of snapshots Simplified kernel support Leverage blkback Simpler invocation model More generic, easier test and debug 21 Xen Summit at Oracle Feb 24-25, 2009
Slide 49: Cross-hypervisor compatibility Viridian interface CPUID, hypercalls Actually turn on just a few optimisations And turn off some annoying checks VHD format support Xen Summit at Oracle Feb 24-25, 2009 22
Slide 50: High availability Detect hardware failures Hardware-based: Machine Check Architecture Software-based: e.g., compare replicas React appropriately… CPU/memory offlining Disable the offending hardware Switch to a ‘hot spare’ UBC’s ongoing Remus project Kemari developed at NTT Japan Xen Summit at Oracle Feb 24-25, 2009 23 MCA – AMD, Intel, Sun Replication – John Byrne 23
Slide 51: A m a z o n * M a r 1 9 9 9 H o t O S p a p e r o n X e n o S e r v e r s * X X X g r a n t a p p l i c a t i o n Network performance Network virtualisation is particularly hard High packet rates; latency sensitive Existing netfront/back drivers have limitations High cost for packet receive Not designed for next-generation NICs Ongoing work on netchannel2 to address this Lazy copy in the guest (reduces dom0 load) Provide guest a copy-only, sub-page, revocable grant Support multi-queue NICs DMA directly to guest buffers Reusable extensible ring architecture Xen Summit at Oracle Feb 24-25, 2009 02/25/09 24 [ l e s s o n s f r o m t h e 24
Slide 52: Security Deprivileged service domains Qemu-dm, pvgrub, … Secure boot Measurement and containment Xen Introspection Project Allow guest state to be monitored and dissected Read memory, registers, etc Callbacks when critical state is modified Virus scanners, test/debug, … Xen Summit at Oracle Feb 24-25, 2009 02/25/09 25
Slide 53: Power management Range timers fuzzy deadlines, allowing batched firing and fewer wakeups Selectable PM policy Admin can choose governor to trade off power vs performance Smarter scheduling Further work is ongoing: George Dunlap, Intel, etc Xen Summit at Oracle Feb 24-25, 2009 02/25/09 26
Slide 54: Managing development Use the developer mailing list xen-devel@lists.xensource.com Requests for comments Announcements of dev plans Patches posted for comment, review and checkin Use the wiki http://wiki.xensource.com/xenwiki/XenRoadMap Xen Summit at Oracle Feb 24-25, 2009 27