I don't make a habit of BST thread crashing, cas for the most part I don't care, but you say you do millions of links per minute? I just can't see that being true, and would love to see some kind of proof of it.
Assuming the average page is 100kb, and that "millions per minute" is say, 3 million, you'd need a 1.5gbps dedicated guaranteed line at a minimum to do that kinda volume, assuming your failure rate was 0%. Who knows how many tens of servers that'd take, too.
When you think that heavily spammed pages can often go into the MB range, and that a failure rate of 0% is virtually impossible over any reasonable sample size.. You're heading up towards a 10 gbps minimum, before we even think about doing the kind of scraping necessary simultaneously to maintain a healthy number of targets to hit that fast.
If that's not true, what other elements of your sales graphic were made up?