Hide Notes 

Slide 1: First Russian CA meeting
Slide 2: Паша Вотчитцев Белокрылов Александр Александр Белокрылов Филипп Шубин Шубин Алексей Gary Serda Жирнов Миша
Slide 3: Что такое JAVA(SUNW)
Slide 4: Software Servers ™ Network.com Services Storage
Slide 5: The Information Age Has Just Begun! Data Center Application Edge Client
Slide 6: Нельзя организовать сообщество без вложений! java.com Looking Glass JXTA java.sun.com
Slide 7: Процессоры, Серверы и пр. • Niagara 2 • Rock > http://www.sun.com/processors/niagara/ > http://blogs.sun.com/jonathan/entry/rock_arriv ed • Thumper > http://www.sun.com/servers/x64/x4500/
Slide 8: Storage Portfolio SL 8500 L1400 9990 9985 5Xx0 NAS VTL Virtual Storage Manager Tape Drives Encryption Key Management Storage Area Network Switches T9x40 4e/4/5 T10000 Data Mgmt. Software Data Protection Software Library Software
Slide 9: USE IMPROVE EVANGELIZ E
Slide 10: Solaris 10 USE IMPROVE EVANGELIZ E Solaris and GNU/Linux Mozilla Firefox, Mozilla Thunderbird, OpenOffice.org, ... GNOME X Window System GNU utilities UNIX utilities System libraries POSIX+ extensions Linux kernel POSIX Solaris kernel Hardware
Slide 11: Solaris 10 Что я могу делать под Solaris? USE IMPROVE EVANGELIZ E
Slide 12: Solaris 10 Поддерживаемый Sun – Solaris 10 – – ● USE IMPROVE Дистрибутивы Solaris ● EVANGELIZ E Solaris Express Community Edition (каждые 2 недели) Solairs Express Developer Edition (LiveCD x86) (GNU/Opensolaris) (каждые 3 месяца) Community – BeleniX – – – Nexenta Schillix Martux (Sparc LiveCD) ● NEW! Проект Indiana! http://blogs.sun.com/SFilippp
Slide 13: Solaris 10 USE IMPROVE EVANGELIZ E Project Indiana ● ● ● ● .. is what everyone is talking about in OpenSolaris land. Is the promising new OpenSolaris binary distribution Lead by Ian Murdock: The 'Ian' in Debian. Great new features you always wanted in Solaris.
Slide 14: Solaris 10 USE IMPROVE EVANGELIZ E Project Indiana (cont'd) ● ● Network based apt-like binary package management called the Universal Packaging system The cool new Distro-constructor! • • • Simply select packages from repository Customize look and feel and spread your own distribution! ● www.opensolaris.org/os/project/indiana/
Slide 15: Solaris 10 USE IMPROVE Изолированные экземпляры Solaris (> 8000), собственная/разделяемая файловая система, собственный root-вый доступ, собственные настройки сети.... Группирует набор процессов в “пулы”, Управление ресурсами между процессами Способ легковесной виртуализации ОС.... Что такое Зоны? Контейнеры? Zones EVANGELIZ E + Resource Management = Containers
Slide 16: Solaris 10 USE IMPROVE EVANGELIZ E ● ● ● ● ● ● Создание для каждого студента собственной среды Unix для различных экспериментов (с возможностью root-вого доступа) Создание “песочницы” для программистов, для сборки и установки приложений Создание тестовых окружений для новых приложений Разделение вычислительных ресурсов между различными пользователями Объединение нескольких серверов в один Эмуляция нескольких серверов на одном! Что позволяют делать Зоны?
Slide 17: Solaris 10 USE IMPROVE Global Zone 1 Processor Share 192.168.1.128 Демонстрация Solaris Zones/Containers Web Zone 3 Proacessor Shares 192.168.1.150 Software Zone 2 Processor Shares 192.168.1.151 EVANGELIZ E /usr, /platform, /sbin, /lib (r/o) (r/o) /etc, /var /etc, /var (r/w) /etc, /var (r/w) /usr/local /cdrom /usr/local (r/w) /cdrom Pentium Mobile Centrino, Solaris 10 x86 (resource management becomes much more fun on multi-processor machines)
Slide 19: Solaris может все -проект Brandz • Возможность запускать приложения других ОС без перекомпиляции – ядро Solaris эмулирует системные вызовы. • Возможно установить полноценные ОС в зону • Доступные виртулизации: > Linux-зона > Windows > Mac OS X ожидается.... http://www.opensolaris.org/os/community/bra ndz/
Slide 20: Можно запускать не только бинарные Linux – программы, но и установить Linux в зону. Linux-зона Примеры - http://sunhelp.ru
Slide 21: Windows в Solaris =)
Slide 22: Интересные ссылки по виртуализации • Brandz http://www.opensolaris.org/os/community/brandz/ • Crossbow виртуализация сетевых интерфейсов http://www.opensolaris.org/os/project/crossbow/ • Sun'овский вариант Xen и не только: > http://www.openxvm.org/ • Руководство по системному администрированию: контейнеры в Solaris – управление ресурсами и зонами http://docs.sun.com/app/docs/doc/820-2979? l=ru&q=%D0%97%D0%BE%D0%BD%D1%8B • LDOMS – виртуализация by Niagara http://www.sun.com/servers/coolthreads/ldoms/index. xml
Slide 23: Solaris 10 ● USE IMPROVE Dynamic Instrumentation – Zero probe effect when disabled DTrace Features EVANGELIZ E ● Unified Instrumentation – Instrument both kernel and applications – Can follow flow-control across boundaries ● Kernel Instrumentation – Can instrument in-kernel subsystems like virtual memory, synchronization, scheduler Data Integrity – Errors always reported ●
Slide 24: Solaris 10 USE IMPROVE ● ● Arbitrary Actions Predicates – DTrace Features EVANGELIZ E Take action only when condition is met C-like language describes predicates & actions All ANSI C operators (add, subtract, etc) Access to kernel variables and data types ● High-level Control Language – – – ● ● User-defined variables Data aggregation
Slide 25: Solaris 10 USE IMPROVE EVANGELIZ E Sample D-Light screen-shot +267% In 2 Days +35% In an Afternoon +80% In a Day Online Parcel Futures Message Tracking Forecasting Handing System Application Benchmark Source: Sun Microsystems, Inc.
Slide 26: Solaris 10 USE IMPROVE EVANGELIZ E More about D-Light at ● ● Demo of D-Light at http://sunfeedroom.sun.com/linkin g/index.jsp? skin=twoclip&fr_story=FEED ROOM192569 D-Light tutorial at http://blogs.sun.com/solarisdev/en try/project_d_light_tutorial
Slide 27: Solaris 10 USE IMPROVE DTrace Results on Production Systems +300% EVANGELIZ E +267% In 5 Hours In 2 Days +32% +35% In a In an Morning Afternoon Financial Database +80% In a Day Online Parcel Futures Message Tracking Forecasting Handing System Application Benchmark Data Routing Application Source: Sun Microsystems, Inc.
Slide 28: Интересные ссылки по D-trace • Chime - GUI проект для D-trace > http://www.opensolaris.org/os/project/dtrace-chime/ • Коллекция D-trace скриптов > http://www.dtracescripts.com/
Slide 29: Solaris 10 USE IMPROVE EVANGELIZ E Volumes versus ZFS Traditional Volumes ● ● ZFS Pooled Storage ● ● ● ● ● ● Abstraction: virtual disk Partition/volume for each FS Grow/shrink by hand Each FS has limited bandwidth Storage is fragmented, stranded ● ● Abstraction: malloc/free No partitions to manage Grow/shrink automatically All bandwidth always available Pool allows space to be shared FS Volume FS Volume FS Volume ZFS ZFS Storage Pool ZFS
Slide 30: Solaris 10 USE IMPROVE EVANGELIZ E ZFS Administration ● Create a storage pool named “home” # zpool create home mirror disk1 disk2 ● Create filesystems “ann”, “bob”, “sue” # zfs create home/ann /export/home/ann # zfs create home/bob /export/home/bob # zfs create home/sue /export/home/sue ● Add more space to the “home” pool # zpool add home mirror disk3 disk4
Slide 31: Solaris 10 USE IMPROVE EVANGELIZ E ZFS Administration – Cool Features ● Turn on compression for Ann's data # zfs compression=on home/ann ● Limit Bob to a quota of 10G # zfs quota=10g home/bob ● Guarantee Sue a reservation of 20G # zfs reservation=20g home/sue ● Take a snapshot of Ann's filesystem # zfs create home/ann@tuesday
Slide 32: Интересные ссылки по ZFS • Слайды > http://www.opensolaris.org/os/community/zfs/docs/ zfs_last.pdf • Учебные материалы > http://www.opensolaris.org/os/project/dtrace-chime/ • Интересные видео > http://www.infoworld.com/archives/videoTemplate.jsp?I > http://www.youtube.com/watch?v=1zw8V8g5eT0
Slide 33: Интересные ссылки по Solaris • Отличная презентация про Open Solaris • Все необходимое: > http://www.opensolaris.org > http://www.slideshare.net/gnunify/open-solar
Slide 34: NetBeans 6.0
Slide 35: What Is NetBeans? • A comprehensive, modular Java IDE > > > > Out-of-box support for Java SE, Java EE, Java ME Large set of 3rd party modules (plug-in's) Intuitive drag-and-drop development Debugger, Profiler, Refactoring, etc... • Free and open-source based > Open source since June, 2000 > Large community of users and developers • A platform for building applications > Rich client Java applications > Rich framework of windows, menus, tool bars, actions
Slide 36: What's New In NetBeans 6.0? • • • • • • • • • Code editor enhancements Ruby, JRuby, & Ruby on Rails support (*) Easier installation and upgrading Swing GUI data binding (+) Integrated profiling, profiling points (+) Integrated visual web features (*) Mobility graphical game builder (*) SOA & UML enhancements Netbeans platform enhancements (*) Topic of an additional tech demo session (+) Will see later in this tech demo session
Slide 37: Matisse GUI Builder (Demo) Java Desktop Database App • Swing Application Framework • Beans Binding • Java Persistence API • Matisse GUI Builder http://www.netbeans.org/kb/60/ide-gui-db-prev.html
Slide 38: Mobile Visual Game Builder
Slide 39: Out of the Box Java EE 5 Support • • • • • • • • Web application development (+) Java EE 5 Support (+) Debugging, testing, profiling Struts and JavaServer Faces (JSF) JBoss 4, WebLogic 9, WebSphere Web services development (client + service) (+) AJAX app development (Blueprints) EJB application development (+) Will see demo later in this session
Slide 40: Developer Collaboration • Develop applications collaboratively • Code-aware instant messaging • Share entire development environment • Multi-party file editing • Conduct code reviews • Collaborative debugging • share.java.net public collaboration server
Slide 41: Debugging & Profiling • • • • • • • • • Visual debugging (breakpoints, watchpoints) Remote debugging of a process On-the-fly code fixing Debug JSP, Servlets, monitor HTTP Traffic View, suspend, resume threads Monitor thread activity CPU time & visual method call-graph data Object-centric view: # allocated, live, age JVM telemetry: heap usage, garbage collection
Slide 42: Debugging & Profiling (Demo) http://www.netbeans.org/kb/55/profiler-tutorial.html
Slide 43: HPC
Slide 44: Tokyo Institute of Technology 8 42 80+ 360 655 10,480 21 1 Now delivering 47.38 TFLOPS 38.18 TFLOPS in 31 Days 6 Linked sub-clusters using CRS 100+ 77 100+ 100+ 77 100+ 100+ 7 100+ x4500 7 x4600 4 Thumper Galaxy 4 Thumper Galaxy 4 Thumper Galaxy 4 Thumper Galaxy 4 Thumper Galaxy 11 11 11 Infiniband Infiniband Infiniband Tier Infiniband Switch Tier222Switch TierInfiniband Switch TierInfiniband Switch Tier222Switch Tier Switch Infiniband Tier 1 Switch Infiniband Tier 1 Switch Voltaire Infiniband switches Sun Fire x4500 Data Servers Racks Clearspeed FP accelerators Sun Fire x4600 Servers Opteron cores TeraBytes RAM PetaByte storage Sun N1 Grid Engine Sun N1 System Manager Lustre parallel file system Asia's fastest supercomputer
Slide 45: O pteron GH z Flops/clock/core Cores per chip Sockets Cores Gflops M BW(GBps) em M size(GB) em O ff-nodeBW(GBps) Approx w atts N odes/Rack D drives isk Rawstoragesize(TB) StorageBW(GBps) N odes/Rack Com puteN odes Com putecores Tflops Bisection BW(TBps) M BW(TBps) em M size(TiB) em BulkStorenodes Storagesize(TB) StorageBW(TBps) Tota Racks l Approx total Sq feet Approx total M atts w 2 .1 4 4 4 1 6 14 3 2 4 3 2 4 60 0 4 8 4 8 2 4 1 9 Ranger Configuration Details 3,936 Compute nodes in 82 C48 racks 4 sockets x 4 cores Pegasus 4S x 4 flops Opt Blade Opt HT2 CPU Compute node 4 x 4 2-GB DDR2 DIMMs Opt Opt PCIe PCIe 11 other blades in shelf 12blade Shelf 33 ,9 6 6 ,9 6 27 59 2 Ratios 7 .9 0 1 .0 5 B/ F 9 4 08 .1 B/ F 13 0 3 2 .2 B/ F 7 2 12 ,7 8 3 .3 B/ F 0 7 0 01 .0 .0 0 4 B/ F 9 5 23 ,0 7 2 0 Tflops / Ksqft 6 2 .4 2 4 Tflops / M 2 W One 4x DDR HCAHCAHCAHCAHCAHCAHCAHCAHCAHCAHCAHCA IB port per blade (4 GBps) IB leaf 24-port switch switch NEM Four cables per shelf PCIe from each blade Storage Node Magnum switch Magnum switch 2,160 ports 2,160 ports System Opt IB HCA IB HCA 8 SATA drives 8 SATA drives 2 GigE 2 GigE 8 SATA drives Opt 8 SATA drives 8 SATA drives PCI-X PCI-X PCI-X PCI-X PCI-X 2 sockets x 2 cores 48 x 500 GB drives 72 Bulk Storage nodes in 8 racks X4500 (4 RU) 8 SATA drives
Slide 46: Solaris 10 Sun Studio - Integrated Оптимизирующие C/C++/Fortran компиляторы Продвинутый отладчик (dbx) Memory Leak Detection/Analysis (RTC) Аналазитор производительности Поддержка многоядерных и многопроцессорных систем Многопоточные библиотеки Анализатор потоков Поддержка OpenMP 2.5 API, MPI IDE основанное на NetBeans dmake – параллельный и распределенный Сообщество разработчиков, поддержка, треннинги USE IMPROVE Sun Studio Software Sun Studio 12 EVANGELIZ E Официальный релиз с полной поддержкой Платформы: Sparc Solaris, Intel Solaris, Intel Linux (SUSE, RedHat) Sun Studio Express Preview следующего релиза D-Light – удобное, легковесное средство профилирования Все – беслатно для любого использования
Slide 47: Solaris 10 USE IMPROVE Sun Studio – Cool Tools ● ● ● ● ● ● ● ● EVANGELIZ E Графический отладчик и анализотор производительности Memory Leak and Access Detection GCCfss (GCC for Sparc Systems) Data Race Detection Tool (DRDT) ATS – Automatic Tuning System Binary Improvement Tool (BIT) and Link-Time Optimizer Simple Performance Optimization Tool (SPOT) Distribute Make (dmake) Compiler Commentary Automatic Parallelization & Vectorization Native Connector Tool X-Designer GUI Builder ● ● ● ●
Slide 48: Solaris 10 #include <math.h> #include <stdio.h> #define N 10000000 double a[N], b[N], c[N]; double sum = 0.0; void main(void) { int i = 0; loop: a[i] = b[i] = c[i] = sum += sin(i); cos(i); a[i]*a[i] + b[i]*b[i]; c[i]; USE IMPROVE Автоматическое распараллеливание EVANGELIZ E OMP_NUM_THREADS=1 timex ./a.out sum = 10000000.000000 real user sys 39.95 33.14 1.24 OMP_NUM_THREADS=2 timex ./a.out sum = 10000000.000000 real user sys 22.45 33.59 1.10 OMP_NUM_THREADS=4 timex ./a.out sum = 10000000.000000 real user sys 11.19 33.40 1.21 i = i+1; if ( i < N ) goto loop; printf("sum = %f\n", sum); }
Slide 49: Sun Studio 11 против GCC SPECint CPU2000 Performance UltraSPARC III+ 1.0GHz 900 800 700 623 671 873 600 500 467 400 300 200 Comp FPGA Combi Chess ressio Circui natori : n ts al Game 466 412 398 290 226 420 342 300 266 417 342 439 360 46% better Range: 22% -124% 522 414 322 7500 7000 6500 6000 5500 5000 4500 4000 3500 3000 2500 2000 1500 1000 500 0 SPECfp CPU2000 Performance 7506 UltraSPARC III+ 1.0GHz 1501 883 250 Phys ics/C hrom o 1181 1321 741 561 172 151 165 Imag e Reco gniti 545 217 110 Shall ow Wate r M ulti Grid Solv er 98 Seis mic Wav e 235 317 228 112 180 Imag e Proc essi Com putat ional Che Num ber T heo ry 469 377 569 215 133 232 Finit e Elem ent High Ener gy Phys M ete rolog y :pol lutan 352% better Range: 26% 4449% Word Comp Group Datab Comp Simul Proce ute theory ase ressio ated ssing visual & n annea Para 3-D bolic Grap /Ellip hics tic 2500 2250 2000 1750 1500 1250 1000 750 500 SPECint CPU2000 Performance Opteron (2.4GHz) 2322 2078 2118 1873 1650 1534 1413 1245 1178 1185 1101 953 1242 1003 1068 1493 1265 1194 1739 1539 10% better Range: 7% -52% 1358 1214 3600 3350 3100 2850 2600 2350 2100 1850 1600 1350 1100 850 600 2161 SPECfp CPU2000 Performance Opteron (2.4GHz) 3599 2458 2062 1835 1488 1329 1274 1541 1380 999 754 1731 1309 941 1161 45% better Range: 6% -183% 1887 1344 749 640 1466 1400 1217 1236 1146 1140 1096 627 Com FPG GCC Com Che Wor Com PER Gro Data Com Sim pres A bina ss: d pute L up base pres ulate sion Circ toria Gam Proc visu theo sion d Sun Studio11 GCC Phy Shall Multi Para 3-D Imag Seis Imag Com Num Finit High Mete si cs/C ow Grid bolic Grap e mic e puta ber e Ener rolo hro Wat Solv /Ellip hics Reco Wav Proc tiona Theo Elem gy gy :p
Slide 50: Интервалы: расширение для наукоемких задач • Учет дискретности представления аналоговых данных, погрешности аппаратного округления, подсчет суммарной погрешности результата • Различные режими округления дают различные результаты f90 intx.f90 -fround=nearest; a.out 1.0000595 f90 intx.f90 -fround=positive; a.out 1.0001191 f90 intx.f90 -fround=negative; a.out 1.0 • Интервалы дают возможность получить границы погрешности вычисления f90 intx.f90 -xarch=sse2 -xia; a.out [1.0,1.0001191]
Slide 51: N1 Grid Engine Overview • Dynamic Resource Management > Job Scheduling > Resource monitoring > Policy administration > User authentication and access control > Accounting and reporting
Slide 52: User Interfaces Browser (accounting) Graphical Command-line N1 Grid Engine <c/> Programmatic (DRMAA) <java/> Programmatic (DRMAA)
Slide 53: Supported Platforms M st H a er ost Solaris 7, 8, 9, 10 onSPARC Solaris 8, 9, 10 onx86 Solaris 10 onx64 Linux kern 2.4-2.6 on el x86/x64 (an distribution y ) Com u e H p t ost Solaris 7, 8, 9, 10 onSPARC Solaris 8, 9, 10 onx86 Solaris 10 onx64 Linu kern 2.4-2.6 on x el x86/x64 (an distribution y ) Win s 2000/XP Pro, dow 2000/2003 Server Mac OS X onPPC AIX 4.3, 5.1, 5.3 HP-UX 11.x Irix 6.5
Slide 54: More Information • Main product page: > http://www.sun.com/gridware/ • Open source project site: > http://gridengine.sunsource.net/ • Community site: > http://gridengine.info/ • Open source Service Domain Manager site: > http://hedeby.sunsource.net/
Slide 55: Sun Labs http://research.sun.com/
Slide 56: What is Sun SPOT? • A Java platform for developing applications for wireless networks and small devices • Applications such as: > Robotics > Art > Toys > Personal electronics > Commercial Applications > Telemetries
Slide 57: Sun SPOT Device • Basic device has three layers > Battery > Processor Board with Wireless Communication > Sensor Board (add-on card) • Processor Board alone acts as a base-station • User programs the device entirely in Java using Netbeans.
Slide 58: Sun SPOT Hardware • Processor Board > 180 Mhz 32-bit ARM920T core, 512K RAM, 4M Flash > 2.4 Ghz 802.15.4 radio with integrated antenna > USB interface • Sensor board > 2G/6G 3-axis accelerometer > light and temperature sensors > 8 3-color LEDS, 2 momentary switches, 6 analog inputs, 5 GPIO pins and 4 high current output pins and a ADC.
Slide 60: Sun SPOT Resources • Project Sun SPOT http://www.sunspotworld.com/ > Sun SPOT documents and applications notes > Short Video demos > Classroom Curriculum > Discussion Forum • David's Blog: http://blogs.sun.com/davidgs/ > Latest news, other informal information on Sun SPOT • The Squawk Project http://research.sun.com/projects/squawk/ > Sun Microsystems official Squawk research project page
Slide 61: Wonderland http://research.sun.com/projects/mc/mpk20.html http://research.sun.com/projects/dashboard.php?id=85 http://www.projectdarkstar.com/
Slide 62: Другие интересные проекты Sun Labs • Fortress > http://research.sun.com/projects/plrg/Fortress/over • Proximity communications > http://www.bio-itworld.com/newsitems/2005/sept20 • Search in music > http://research.sun.com/projects/dashboard.php?id • Security, Cryptography, and Policy > http://research.sun.com/projects/dashboard.php?id И много других: http://research.sun.com/projects/
Slide 63: Полезные ресурсы • • • • • • • blogs.sun.com blogs.sun.com/jonathan developers.sun.ru developers.sun.com sun.com ru.sun.com sunhelp.ru
Slide 64: О чем мы не упоминали и о чем стоит узнать • Blackbox • Glassfish • JavaFX
Slide 65: Мы • http://developers.sun.ru/ • http://ru.sun.com/research/teachingmaterials.h • /CA Page • http://developers.sun.com/ • http://developers.sun.com/academic • http://www.sun.com/edu/programs/sai/ • java.net, OpenSolaris.org, and NetBeans.org • http://www.educationcommons.org
Slide 66: Что делать кроме презентаций? • Локализация NetBeans • http://www.educationcommons.org/projects /display/CA/Get+Involved