Vertebra

Notes:	Hide Notes

Slide 2: Scaling Ruby from the Inside Out Ezra Zygmuntowicz Slide 3: Does Rails Scale? Slide 4: Does Rails Scale? Of course it does... Slide 5: Does Ruby Scale? Slide 6: Does Ruby Scale? Of course it does... Slide 7: Should you use Rails or Merb? Slide 8: Should you use Rails or Merb? YES! Slide 9: Are you sick and tired of endlessly debating this crap? Slide 10: Are you sick and tired of endlessly debating this crap? Of course you are... Slide 11: Me too, let’s talk about something more interesting... Slide 12: Scaling Ruby from the Inside Out Slide 13: What should we talk about then? Slide 14: What should we talk about then? The weather maybe? Slide 15: Forecast calls for 100% chance of clouds... Slide 16: Cloud Computing Slide 17: Cloud Computing Platforms Abstract/Virtual Resources CPU Memory Storage API Access Slide 18: Cloudy Weather • Amazon EC2 • Engine Yard • Joyent • Mosso • 3terra • Google App Engine • Project Caroline • GoGrid This is only the beginning... Slide 19: There will be many cloud computing platforms in the near future Slide 20: Many virtual machines to manage Slide 21: SSH doesn’t scale... Slide 22: SSH doesn’t scale... Takes time to setup/teardown connections Slide 23: SSH doesn’t scale... Takes time to setup/teardown connections Inherently push only technology Slide 24: Capistrano is an awesome tool Slide 25: Capistrano is an awesome tool but running commands on thousands of machines in parallel is pushing it further then it wants to go Slide 26: How will we manage the complexity? Slide 27: How will we manage the complexity? It’s all about the distribution... Slide 28: We’ve got to think big now! New York, Chicago, LA Slide 29: Introducing Vertebra Next Generation Cloud Computing/Automation Framework Slide 30: Enter XMPP Extensible Messaging and Presence Protocol Slide 31: Enter XMPP Extensible Messaging and Presence Protocol Extensible I like that Slide 32: Enter XMPP Extensible Messaging and Presence Protocol Messaging We want to send messages to our thousands of machines Slide 33: Enter XMPP Extensible Messaging and Presence Protocol We want to know when our machines are online or not and act accordingly Presence Slide 34: XMPP is a realtime messaging protocol built for IM/chat, great for communication between thousands of people, why not machines? Slide 35: Summoning Slices via XMPP Slide 36: Ejabberd Horizontally scalable/federated erlang XMPP/Jabber server High performance even with tens of thousands of connections Forms the backbone of the system Slide 37: Ruby based agents run on every slice/instance/node in the cloud Slide 38: Presence let's us know when agents come online or go ofﬂine Slide 39: Security/Discovery/ Introduction Framework Keeps Agents in Touch with Each Other. Slide 40: Distributed Hierarchal KeyValue Storage System Queried via XMPP Slide 41: State Machine/Workﬂow Engine Coordinates Multiple Agents/Humans Slide 42: Vertebra Slide 43: CREST Slide 44: CREST Cloud-REST Slide 45: CREST Cloud-REST Operations on Resources in the cloud Slide 46: operation:list /cluster/ey05 /node/42 /xen Slide 47: Resource Discovery Slide 48: Resource Discovery Who provides this set of resources? Slide 49: Resource Discovery Who provides this set of resources? Slide 50: Map/Reduce Scatter/Gather Dispatch Slide 51: Map/Reduce Scatter/Gather Dispatch Discover Slide 52: Map/Reduce Scatter/Gather Dispatch Discover Scatter Slide 53: Map/Reduce Scatter/Gather Dispatch Discover Scatter Gather Slide 54: quick demo Slide 55: Not only server automation Slide 56: Ejabberd + Comet + Jsjac == Realtime Web Platform Slide 57: Many Ideas to Experiment With Slide 58: XMPP > HTTP Slide 59: Watch this space... Slide 60: One more thing... Slide 61: One more thing... Introducing: Engine Yard Express http://express.engineyard.com/system/ey_express_v0.1.tar.bz2 Slide 62: Engine Yard Express http://express.engineyard.com/system/ey_express_v0.1.tar.bz2 Slide 63: Questions?