Robots.txt File

Example of a robots.txt file using YouTube