I have a website listing doctors in the us. I'm spreading out the posts over 2 years, but I have about 2.8 million doctors to list. Right now I'm adding the post automatically via a custom script, and selecting a random time between now and 2 years from now.
This seems to have broken my cron. There are about 40k scheduled posts, and the cron cell in the database was about 6mb when I exported the single cell for cron.
My cron is now broke, and it may be due to google xml sitemaps plugin. But that's a side effect I believe of the cron table getting too large.
What's the best way to do what I'm trying to accomplish?