Thanks for the great response @Ian_Heggie!
I used ansible to provision our Jenkins box. I prefer it to the others (Chef, Puppet) when I have to go there. railsbox.io looks super useful
I read Project Phoenix a couple of months back. It really is a good book, nice rec.