User-agent: * 
Disallow: /administrator/
Disallow: /administrator1/
Disallow: /cache/
Disallow: /components/
Disallow: /downloads/
Disallow: /editor/
Disallow: /help/
Disallow: /images/
Disallow: /Images/
Disallow: /includes/
Disallow: /includes1/
Disallow: /language/
Disallow: /mambots/
Disallow: /media/
Disallow: /modules/
Disallow: /templates/
Disallow: /installation/
Disallow: /installation1/
Disallow: /cgi-bin/
Disallow: /WebCalendar/
Disallow: /htdig/
Disallow: /stats/
Disallow: /Pages/


# Disallow / would ban all directories

#The robots.txt file should be created in Unix line ender mode! 
#Most good text editors will have a Unix mode or your FTP client *should* do the conversion for you. 
#Do not attempt to use an HTML editor that does not specifically have a text mode to create a robots.txt file. 

#Sometimes you cannot make a /robots.txt file, because you don't administer the entire server. 
#The basic idea is that if you include a tag like: 
#<META NAME="ROBOTS" CONTENT="NOINDEX">
#in your HTML document, that document won't be indexed. 
#If you do: 
#<META NAME="ROBOTS" CONTENT="NOFOLLOW">
#the links in that document will not be parsed by the robot.