User-agent: * Disallow: /cgi-bin/ # Disallow directory /Media/ User-agent: * Disallow: /Media/ # Disallow directory /Styles/ User-agent: * Disallow: /Styles/ # Disallow directory /direction/ User-agent: * Disallow: /direction/ #This is an example robots.txt file User-agent: TurnitinBot Disallow: /