I want to discuss something here. Let's say I had 5,000 links I want to index and I have 1,000 twitter accounts to do it. Using 'best practices,' this would indicate the following:
5,000 links
1,000 twitter accounts
10 tweets per account every 24 hours
10,000 total available tweets per day
50 ‘links/tweets’ per task
100 total tasks
10 tweets per account
500 total tweets
20 tasks is 10,000 total tweets
20 tasks per 24 hours
100 tasks is 120 hours
Start a task once every 1.2 hours
Ok so in order to simplify this task there needs to be a way to drip the 'tweets/links' in consistently over a period of time. In this case, it is every 1.2 hours for 120 hours. When your dealing with large amounts of links, I believe this is going to be essential. If I have 5,000 link I want to index, I don't want to have to log in and start up the tasks this often. Automation is key, so I think this is huge.
Also, in order to manage and implement this in a larger scale, there could be a system where you can group tasks together, for instance, the 5,000 links in this case. Also, grouped tasks would need to be assigned to a group of twitter accounts, so grouping twitter accounts and assigning them to grouped tasks could also be added.
This would be to avoid having an account go over 10 tweets per 24 hours as well as simplify keeping track of how many accounts are being tweeted when you scale. If this was done, you could run multiple groups of tasks simultaneously without having to worry about exceeding any limits.
The new feature of being able to name your tasks was a big addition today. I was lost in a sea of tasks and was just starting them up randomly. It should be WAY easier to keep track of everything now.
Also, what is everyone's suspended rate? I started out at about 2k twitter accounts and I'm down to 1,100. The accounts are a few months old and I've used them to index regularly before, so I'm not sure how many were already suspended and how many are being slapped because of my twidexator activities.