Unrecognised field. The field Crawl-delay could not be recognised. Whilst the robots.txt standard allows for expansion by the use of undefined fields, it is likely that this line is a mistake in your file
[ Back ]