The Twitter Engineering Blog

http://engineering.twitter.com/ all sorts of system and software engineering info from Twitter. Also see http://twitter.com/about/opensource

Jon Schutz Technical Notes and Recommendations » Perl client for Facebook’s scribe logging software

http://notes.jschutz.net/2009/04/perl-client-for-facebooks-scribe-logging-software/ Describes how to build thrift (cross-platform service/RCP framework from facebook) modules for scribe client (high-performance async log aggregator server from facebook). Also see Log::Dispatch::Scribe on CPAN

High Scalability - High Scalability - Facebook's Memcached Multiget Hole: More machines != More Capacity

http://highscalability.com/blog/2009/10/26/facebooks-memcached-multiget-hole-more-machines-more-capacit.html also see http://dormando.livejournal.com/521163.html Describing some problems with performance/scalability you may have if you partition/shard your data by hash. ( that’s what memcached does.) You may hit the cpu bound limit from the amount of requests that few very popular keys receive. Currently, there is now common way around this (perhaps because very very few sites scale to the point when this becomes an issue )

Joshua Zhu’s Blog » C10K [how to write C10K server]

http://blog.zhuzhaoyuan.com/category/c10k/ notes about high-performance unix server programming, things like concurrency models, IO types, memory allocation strategies, etc.

Joshua Zhu’s Blog » Nginx Internals (Slides & Video)

http://blog.zhuzhaoyuan.com/2009/09/nginx-internals-slides-video/ very good presentation slides explaining nginx internals, such as main architecture, main event loops, core modules, processing pipelines, etc. Also there is a video of the talk , but it is mandarin, so YMMV :-)