Robots Generator

directory secured by: index.html, .htpasswd,
robots.txt not found
    /
    ..
 bin
 boot
 dev
 etc
 home
 lib
 media
 mnt
 opt
 perl588installer
 proc
 root
 sbin
 scripts
 selinux
 srv
 sys
 tmp
 usr
 var

comment:



USAGE: Check items for being allowed, uncheck items for being disallowed for user-agent *