Don't speed up troops/collectors
Since you do not want a fifth builder, the best thing to do would be to save them until you have a lot of resources but no free builder open. When that happens you can gem the last couple of hours on an upgrade and start a new one so you don't lose your resources overnight. You can also wait until you are anxious to finish an upgrade and gem the last few minutes :) In short, save the gems until you need a few extra resources, need to start a build fast, or you need a shield.
DO NOT INCREASE PRODUCTION, i'm not exaggerating, it literally ♥♥♥♥♥s you out of gems. See the link below.
Useful links:
Gems -> Resource calculator: http://clashofclans.wikia.com/wiki/Gems
Proof of not to increase production rate: http://forum.supercell.net/showthrea...ixirs-Barracks