http://kindlund.wordpress.com/2007/11/19/configuring-multiple-default-routes-in-linux/

Notes on how to get sane traffic flows for a linux box that has 2 network cards connected to the same network. NOTE: this is a required setup if you are using multiple network cards feature on AWS VPC