Disallow crawling in robots.txt

Disallow all

User-agent: *
Disallow: /

# Comments appear after the "#" symbol at the start of a line, 
# or after a directive
User-agent: * # match all bots
Disallow: / # keep them out