I'm a Ruby guy, I do PHP a lot as well, but anything that doesn't have to be built for a website should not be in PHP in my opinion. So here's something fun for you all to play with.
This script runs through a csv of keywords and searches the Google SERPs for any pages from that domain. It then connects to Yahoo SE for checking inbound links, and then uses this really interesting Page Rank script I found to find the PR really really fast.
The sweet part about this script is that I set it up to use thread pooling, so you can have a bunch of simultaneous threads running at once which greatly speeds this thing up. I was able to check 1000 serps for 60 keywords with backlinks and PR in about a minute with this, pretty awesome.
When it's done, it spits out a csv with 5 columns for you to view the results.
I tried to comment my code as much as possible, so if you're interested in learning some Ruby, download it and check it out. I don't claim to be a Ruby Ninja though, so don't judge me if I didn't use all the fancy Ruby tricks everywhere.
I slapped this together today and figured anyone who can play with Ruby would have some fun playing with it. I programmed it on Ubuntu, with Ruby 1.8.7, so I can't make any guarantees that you can make it work yourself on your machine. If anyone does take the time to download this, grab the gems, and fire it up, post in here so I can see how well this works on other machines.
TO USE IT:
First, you need the following gems:
Second, you need a Yahoo API Key. They're free and easy, it's how you get the backlink analysis. Put that into the variable "yahoo_app_id" in rankings.rb
Third, I built this to use proxies with authorization. If you understood that last sentence and can code Ruby, then go modify googleserps.rb and put your own proxies in there, or strip out the code that deals with proxies if you don't want to use them. It's a really good idea to use proxies though, this thing is (hopefully) fast enough to get your ip banned without them. Just a word of warning.
After that, open up "keywords.csv" and put in your keywords, one per line.
Then from the command line, run "ruby rankings.rb". It should start up and ask your domain (If anyone has some sweet ASCII art, send it my way and I'll plug it in for the splash screen).
It's going to ask your domain, the number of Serp results to dig into (up to 1000), the number of results per page (100), the search delay (in seconds, don't be stupid, at least have it pause for two seconds or something), and the number of threads to run at a time (I haven't benchmarked this to find the right number of threads, so play with it).
After that, it will go beat up Googs and spit out a results CSV file in that same folder. Open that up in a Spreadsheet app and you should be staring at all of your rankings, backlinks, and PR.
Let me know if it works for you all, or if it lights shit on fire or something. Curious to see what others see when using it.
Good luck!
This script runs through a csv of keywords and searches the Google SERPs for any pages from that domain. It then connects to Yahoo SE for checking inbound links, and then uses this really interesting Page Rank script I found to find the PR really really fast.
The sweet part about this script is that I set it up to use thread pooling, so you can have a bunch of simultaneous threads running at once which greatly speeds this thing up. I was able to check 1000 serps for 60 keywords with backlinks and PR in about a minute with this, pretty awesome.
When it's done, it spits out a csv with 5 columns for you to view the results.
I tried to comment my code as much as possible, so if you're interested in learning some Ruby, download it and check it out. I don't claim to be a Ruby Ninja though, so don't judge me if I didn't use all the fancy Ruby tricks everywhere.
I slapped this together today and figured anyone who can play with Ruby would have some fun playing with it. I programmed it on Ubuntu, with Ruby 1.8.7, so I can't make any guarantees that you can make it work yourself on your machine. If anyone does take the time to download this, grab the gems, and fire it up, post in here so I can see how well this works on other machines.
TO USE IT:
First, you need the following gems:
- mechanize
- yahoo-se
- work_queue
Second, you need a Yahoo API Key. They're free and easy, it's how you get the backlink analysis. Put that into the variable "yahoo_app_id" in rankings.rb
Third, I built this to use proxies with authorization. If you understood that last sentence and can code Ruby, then go modify googleserps.rb and put your own proxies in there, or strip out the code that deals with proxies if you don't want to use them. It's a really good idea to use proxies though, this thing is (hopefully) fast enough to get your ip banned without them. Just a word of warning.
After that, open up "keywords.csv" and put in your keywords, one per line.
Then from the command line, run "ruby rankings.rb". It should start up and ask your domain (If anyone has some sweet ASCII art, send it my way and I'll plug it in for the splash screen).
It's going to ask your domain, the number of Serp results to dig into (up to 1000), the number of results per page (100), the search delay (in seconds, don't be stupid, at least have it pause for two seconds or something), and the number of threads to run at a time (I haven't benchmarked this to find the right number of threads, so play with it).
After that, it will go beat up Googs and spit out a results CSV file in that same folder. Open that up in a Spreadsheet app and you should be staring at all of your rankings, backlinks, and PR.
Let me know if it works for you all, or if it lights shit on fire or something. Curious to see what others see when using it.
Good luck!
