diff options
| author | Jules Laplace <jules@okfoc.us> | 2015-03-27 13:33:34 -0400 |
|---|---|---|
| committer | Jules Laplace <jules@okfoc.us> | 2015-03-27 13:33:34 -0400 |
| commit | f090feb8d4cacce9a1e8ffcda6cb542917c7e1e1 (patch) | |
| tree | 0b4e9df9a05d7adac4abe162d9692b6047d685b1 /public/robots.txt | |
railzZz
Diffstat (limited to 'public/robots.txt')
| -rw-r--r-- | public/robots.txt | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt new file mode 100644 index 0000000..085187f --- /dev/null +++ b/public/robots.txt @@ -0,0 +1,5 @@ +# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file +# +# To ban all spiders from the entire site uncomment the next two lines: +# User-Agent: * +# Disallow: / |