Scaling, performance, and plain old bug fixing
What a couple of months this has been! First, some stats on what’s going on in the blogosphere. Technorati is now tracking over 13.3 Million blogs, and 1.3 billion links. We are seeing over 900,000 posts per day on average, which means we’re adding about 10 posts per second. We’re also seeing about 80,000 new weblogs created each day. That’s more weblogs created each day than there were total when I started the service in November 2002. And our search traffic has increased by over 40% month on month for each of the last 4 months. The day of the london bombings we saw over 1.2 Million posts, and had an additional 30% increase in traffic as people turned to weblogs, moblogs, and other citizen’s media for instant updates on events in London, survivor accounts, and sharing of deep feelings on the tragedy.
Recently a number of people have had some pretty public complaints about some of Technorati’s services. Thanks for the terrific feedback and comments. I feel your pain.
We sat down, listened hard to what you were saying, and then got to work. And tonight, we rolled out a raft of bug fixes and performance enhancements that should help most, if not all of the Cosmos (URL) searches you do on Technorati. It will also help with the speed of all searches across the site.
These improvements don’t fix everything – some searches are still slow, and while we pride ourselves on completeness and fast index times, there’s still a long way to go. Performance and scalability improvements are our number 1 priority until this is fixed.
For those of you who have been having problems, we’re working our butts off to win back your trust. I hope that the fixes we rolled out tonight and will roll out over the coming days and weeks will be of service to you. Because, in the end, that’s what this is all about to us – to be of service to all of you.
Thanks again for the great feedback and comments. Keep us on our toes.