I have decided to drop Google fonts and host them locally. I found a pretty neat tool that allows you to download Google fonts and genrate the needed css. The reason is due to privacy concerns and better conrol over caching. I have also adjusted the overall caching of the site from 4 hours to 1 month. I am already using cache busting, so I didn't see any down side. I am a little worried about the effect on images, but right now I don't have any.