Billions of Hits: Scaling Twitter

I’ll present a continuation of lessons learned in the last two years of scaling Twitter to meet high demand, attempting to cover:

• Best practices for deploying Ruby on Rails in production and new ways of deploying Rails with Unicorn and Passenger
• Performance impacts of abuse and why rate limiting is so important
• What to do when your API use overtakes normal web use
• Asynchronous versus Synchronous processing during request lifetime
• Why the real-time web isn’t possible without cheap memory
• Handling large volumes of logs with Thrift, Hadoop and HDFS