A simple library to obey robots.txt files

WWW: http://rubygems.org/gems/robotex
