Ordinarily you'd probably build your personal robots.txt record and place it within the reason for your site documents comprise your website from the server.