Robots.txt - an up-to-date tutorial

Google's official blog has a high quality tutorial on using robots.txt to control search engine indexing: Controlling how search engines access and index your website. A reference to keep!