%w(map reduce).first - A Tale About Rabbits, Latency, and Slim Crontabs
Presentation:
%w(map reduce)_first - A Tale About Rabbits, Latency, and Slim Crontabs Presentation
[PDF]
Average rating:
(3.56, 57 ratings)
the talk will present some situations and then the solutions (with code and possible real time demo)
- distribute a big batch of local atomic operation across different ruby processes using queues RabbitMQ and the amqp gem, subtitle make some use of your cpu cores
- effects of the previous approach applied to systems with high latency as an example it will be shown how to load data in parallel streams in Amazon SimpleDB (the dead_simple_db gem will be shown in the example)
- how to convert the time discrete execution dictated by period driven tasks (i.e. *nix crontabs) in a fluid process that consumes entities as soon as they queue and handle smoothly the variance of load this kind of task migt be subject to
Paolo Negri
wooga.com
Opensource enthusiast kind of geek, interested in linux, programming languages.
I did make of my passion my job and I succeeded in keeping the passion during the process.
Comments on this page are now closed.
Comments
Great presentation. It helped me solve a couple of problems!
thanks Paolo… slides are now attached to your session.
slides are now on slideshare:http://www.slideshare.net/hungryblank/wmap-reducefirst-a-tale-about-rabbits-latency-and-slim-crontabs however they should also appear on the conference speaker presentation files section soon.
One of my favorite presentations; great content; dovetailed nicely w/ Ezra’s talk on using Nanite (which requires RabbitMQ). Would like to get a copy of your slides. Thx, again!
Thanks everyone for coming at the presentation, it was great to have so many questions and seeing people so interested.
Excellent presentation!
Excellent presentation. Paolo gave a great introduction to RabbitMQ/Eventmachine and how to use messaging to build as he put it, “the nervous system of your application”. He also gave us resources so we can continue to expand our knowledge on the topic post-presentation and was very capable in answering the audience questions.