I have a yellow page ripper that I have been working on for a project I am working on. I thought that being the giving season I'd offer it up to Wickedfire members.
I'm not going to charge for it, it's free, but there is a catch. This will be available for a limited time, maybe til the end of January. Also, I am not giving this away to the newbies that can't follow simple guidelines and do things like post intro threads in the STS area or mis-use icons. Therefore, the script is available to anyone that PMs or emails me as long as they have a minimum of 100 posts on WF. If you have 25-99 posts (prior to this post) and can show that you have provided useful or informative posts related to the topics of WF you will get it. If you have less than 25 posts here get busy and contribute. All I ask is that you do not re-distribute this.
If you are interested send me your email address by PM me or email me at dewchugr yahoo com and I will email this to you. I probably won't be online tomorrow, but I'll get it out to everyone asap.
Features and such below, but here is a link to the readme and a few CSV exports.
Readme
Illinois search for gocery stores 5247 records
Illinois search movie theaters 276 records
Illinois search for pizza, limited to Chicago, Evanston and Glencoe 727 records
Ilinois search for pizza 4559 records
Here are the main features.
I'm not going to charge for it, it's free, but there is a catch. This will be available for a limited time, maybe til the end of January. Also, I am not giving this away to the newbies that can't follow simple guidelines and do things like post intro threads in the STS area or mis-use icons. Therefore, the script is available to anyone that PMs or emails me as long as they have a minimum of 100 posts on WF. If you have 25-99 posts (prior to this post) and can show that you have provided useful or informative posts related to the topics of WF you will get it. If you have less than 25 posts here get busy and contribute. All I ask is that you do not re-distribute this.
If you are interested send me your email address by PM me or email me at dewchugr yahoo com and I will email this to you. I probably won't be online tomorrow, but I'll get it out to everyone asap.
Features and such below, but here is a link to the readme and a few CSV exports.
Readme
Illinois search for gocery stores 5247 records
Illinois search movie theaters 276 records
Illinois search for pizza, limited to Chicago, Evanston and Glencoe 727 records
Ilinois search for pizza 4559 records
Here are the main features.
- Search by keyword.
- Optionally limit searches to name of business only.
- If your search returns no results auto re-search for name match.
- Grabs name, address, city, state, zip, phone and URL (if available).
- If you rip a category the category name will be included in field one of the CSV.
- Specify State and optionally city to search.
- limit your search results to specific cities.
- Output to screen or CSV file.
- Get categories available in a city/state
- Remove spammy yellow pages URLs
- Config file with default state and array of categories.
- No timeout issues, scrape 5,000 or more entries in one go.
- Oh, did I mention it's FREE?
- It's not the fastest thing in the world, especially when ripping 4 or 5 hundred pages.
- It does US yellow pages only.
- No, it won't do Canada, Australia, the UK or Nigeria.
- It won't rip the whole country at once.
- It won't rip every category of a state at once.
- It may or may not look right in IE. I use Firefox, you should too.
- Make this work for Canada, Australia, the UK or Nigeria, etc? No.
- Add a feature? No.
- Fix this problem? Maybe, but probably not.
- Can you... No.
