The Twitter Engineering Blog
http://engineering.twitter.com/ all sorts of system and software engineering info from Twitter. Also see http://twitter.com/about/opensource
http://engineering.twitter.com/ all sorts of system and software engineering info from Twitter. Also see http://twitter.com/about/opensource
http://notes.jschutz.net/2009/04/perl-client-for-facebooks-scribe-logging-software/ Describes how to build thrift (cross-platform service/RCP framework from facebook) modules for scribe client (high-performance async log aggregator server from facebook). Also see Log::Dispatch::Scribe on CPAN
http://highscalability.com/blog/2009/10/26/facebooks-memcached-multiget-hole-more-machines-more-capacit.html also see http://dormando.livejournal.com/521163.html Describing some problems with performance/scalability you may have if you partition/shard your data by hash. ( that’s what memcached does.) You may hit the cpu bound limit from the amount of requests that few very popular keys receive. Currently, there is now common way around this (perhaps because very very few sites scale to the point when this becomes an issue )
http://blog.zhuzhaoyuan.com/category/c10k/ notes about high-performance unix server programming, things like concurrency models, IO types, memory allocation strategies, etc.
http://blog.zhuzhaoyuan.com/2009/09/nginx-internals-slides-video/ very good presentation slides explaining nginx internals, such as main architecture, main event loops, core modules, processing pipelines, etc. Also there is a video of the talk , but it is mandarin, so YMMV :-)