# robots.txt for atojs.natlib.govt.nz # Block searches: /cgi-bin/atojs?a=q # Block image server: /cgi-bin/imageserver # Block full text pages (to avoid confusion): any URL ending in st=1 # If you want to index the AtoJs Online OCR text please contact # the site administrators for instructions on how to do this gracefully. User-agent: * Disallow: /cgi-bin/atojs?a=q Disallow: /cgi-bin/imageserver Disallow: /*st=1$