on export create a robot.txt if option is selected.
also have a option to exclude or include a single file from search, like how "exclude from menu" is setup.