New url scraper for CPV - What do you think?

B

bbrock32

New member
Oct 4, 2008
66
2
0
affexpert.com
Just finished coding a new scraper that can be used to scrape domains for cpv campaigns . It can scrape Google / MSN / Yahoo and sort returned results by alexa / quantcast rank to get a better overview of the results .
I've added also some nice features , like keyword suggestion and domain filtering and several exporting options for the urls.

Have a look at it here :

PPV Url Scraper 1.0

Tell me what you think about it and what features you would like to be added.

Have fun :zzwhip:
 


That's quite a sexy scraper. I will play about with it for a while. Are you going to leave it open or are you going to monetize it?
 
Got a few of these:
cURL error number:0<br><br />cURL error:<br><br />cURL error number:0<br><br />cURL error:<br><br />cURL error number:0<br>

And one of these:
input type="submit" class="submit button" name="submit" value="Scrape urls for these kewords!" size:"20px" id=

But it looks good.

Suggestions would be:

* Export options
* Filter options on results, updating with jquery (like url length, filter by keyword, dynamic live sorting columns etc)
* If you're scraping exclusively server side it might be worth implementing some caching for 24 hours on a keyword basis.
 
Probably it's giving those errors because too many users are trying it at the same time and it's using only 1 ip . It's just for demonstration purposes , when it will be out of beta I will add multiple ips and proxy support. Your suggestions seem good , I will implement them in the next update
 
You must log in or register to reply here.
Top Bottom
Back