Hi,
Yes, the loading times matter for CPA offers and it also matters for your website ranking.
Google does not like sites that take long time to load, and users also won't wait 10 seconds for the CPA offer to load, it's more likely they will go away from your site.
I reccomend using a VPS.