Regarding speed, getting a plugin that combines all your css and js files is a good start for plugins. Autoptimize is a good one for doing that. I put a link below.
Otherwise, just enabling nginx caching like Eris said is probably the best solution aside from hours of tweaking config files.