Tech tips and notes with a bit of commentary. macOS and iOS mostly.
Friday, January 26, 2007
Robots.txt - an up-to-date tutorial
Google's official blog has a high quality tutorial on using robots.txt to control search engine indexing:
Controlling how search engines access and index your website
. A reference to keep!
January 26, 2007
Post a Comment
View web version