robots.txt « htdocs « test « htdig-3.2.0b6 « htdig « debian - extra-dependencies - This contains extra packages required to build TDE under various distros.

summary refs log tree commit diff stats

path: root/debian/htdig/htdig-3.2.0b6/test/htdocs/robots.txt

blob: 1017ea355bf3693949261dfc19d2bfd5338deedf (plain)

User-agent: *
Disallow: /set1/site

User-agent: htdig
Disallow: