Online robot.txt checker Link http://www.tardis.ed.ac.uk/~sxw/robots/check/ Language EN Link category SGML, XML, HTML,...
