Shopping price comparison sites

D

DreamMachine

Extreme Ultra VIP
Aug 3, 2008
496
10
0
Australia
Don't know if this belongs in the newbie section, but it's a newbie question for me anyway..

For those of you (if any) that have started a price comparison niche site, what the easiest way to get the URL product data?

eg. "Fleshlight model 12XXL" is on these 12 URL's and it's the same model/colour/size, etc.

Scraping the price after you have the URL is simple, it's getting the URL data in the first place I'm struggling with.

Is there a better way than a manual comparison? (and a lot of outsourced copy/paste) The quality of my outsourced work is... questionable.
 


I believe a lot of those price comparison websites copy the "descriptions/info" with the help of many thousands of outsourced cheap online labourers.

That, or they have a fairly well written algorithm that scrapes the info and a few quality checkers to look over it at a high rate of speed.

IMHO anyways.
 
Dream, you can get plenty of URLs from datafeeds. Networks often offer datafeeds with deeplinks included, all would take few minutes to customize and download.

To get URLs with item info you may play a bit with ScrapeBox, using custom footprints. All of course depends on your project size etc. Just my thoughts.
 
This isn't something that I know a whole lot about but I'll share what I know from my limited experience. When I worked at a SEM company, one of their services for e-comm businesses was submitting products to major comparison shopping engines. To do that, they'd build a data feed for the sites inventory.

So I'd assume that its something that vendors usually put together and make available if they're not scraped.
 
You must log in or register to reply here.
Top Bottom
Back