#robot.txt for NTP NZ #Date: 17/10/2007 #In this version we want to prevent search engines to index glossary, therapy, articles to prevent #content duplications with NTP AU User-agent: * Disallow: /articles Disallow: /article/ Disallow: /glossary Disallow: /glossary/ Disallow: /therapy Disallow: /therapy/