In 2012 I periodically spoke about what I'm working on in this thread. Now, I'm planning on turning on an early version for a few people to try out, as some feedback and real world testing is needed. I can't charge for this if it crashes, chews up too much memory, behaves strangely or craps out some other way, and if it has bugs, I'm never going to find them all myself. I need a few others using the system.
The way it works is you get an account with an API key and you control your browser through HTTP calls. It's currently running on Chrome somewhere around version 18, but this will be updated in a couple of months when the next version of the underlying tech is released.
Currently the following functions are supported, but I can (and will be) adding more as needed:
This is *alpha* software. Nobody has used it but me and there's plenty left for me, but I need some people using it. It has full proxy support and I'd prefer you use exclusive/private proxies, not open/public proxies you scraped from somewhere. I'll allow you to not use proxies if you're not doing any "dirty" scraping (CraigsList, Google, etc), but otherwise, proxies are required. If you are using proper exclusive proxies which don't reveal my server IP address, you can scrape whatever the hell you want and I won't give you any grief about it, as long as you're not costing me a bunch of money.
Finally, I'm not going to automatically accept everyone who asks. It would help if I've seen you around on the forum, or if you seem like you legitimately have use for this. It's a waste of my time to issue accounts that never get used, so only ask if you think this is something you'd actually use, or would spend enough time alpha testing to get me some feedback/usage data.
Finally, the scraping is awesome. I have a few finishing touches to put on it, but it essentially allows you to project anything on the page back into your own customised JSON structure, returned with the HTTP response.
Let me know! If I don't know you and you have no established credibility on WF, also let me know why I should pick you.
p.s. Mods; I'm not using this to get email addresses from WF users; I really just need testers. We'll keep feedback in this thread so it stays on WF. When I'm ready to charge, I'll pay for an ad or thread on WF.
The way it works is you get an account with an API key and you control your browser through HTTP calls. It's currently running on Chrome somewhere around version 18, but this will be updated in a couple of months when the next version of the underlying tech is released.
Currently the following functions are supported, but I can (and will be) adding more as needed:
- Open Window
- Load URL
- Take Screenshot
- Click Element (real low level click event)
- Type Text (real up/down keypress events with realistic delays)
- Wait For Text (to allow for unpredictable ajax page wait times)
- Set Field Value (text, checkbox, radio, select)
- Resize Window
- Get Window Info
- Extract Content (ultra powerful/flexible data/content extraction/transformation)
This is *alpha* software. Nobody has used it but me and there's plenty left for me, but I need some people using it. It has full proxy support and I'd prefer you use exclusive/private proxies, not open/public proxies you scraped from somewhere. I'll allow you to not use proxies if you're not doing any "dirty" scraping (CraigsList, Google, etc), but otherwise, proxies are required. If you are using proper exclusive proxies which don't reveal my server IP address, you can scrape whatever the hell you want and I won't give you any grief about it, as long as you're not costing me a bunch of money.
Finally, I'm not going to automatically accept everyone who asks. It would help if I've seen you around on the forum, or if you seem like you legitimately have use for this. It's a waste of my time to issue accounts that never get used, so only ask if you think this is something you'd actually use, or would spend enough time alpha testing to get me some feedback/usage data.
Finally, the scraping is awesome. I have a few finishing touches to put on it, but it essentially allows you to project anything on the page back into your own customised JSON structure, returned with the HTTP response.
Let me know! If I don't know you and you have no established credibility on WF, also let me know why I should pick you.
p.s. Mods; I'm not using this to get email addresses from WF users; I really just need testers. We'll keep feedback in this thread so it stays on WF. When I'm ready to charge, I'll pay for an ad or thread on WF.
