User-agent: * Disallow: /*?*limit=all Disallow: /files/*download Disallow: /cgi-bin/