Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
What's new
10
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Sign in
Toggle navigation
Open sidebar
services
T
t3o sites
typo3.org
typo3.org
Commits
7d218ae2
Commit
7d218ae2
authored
Jan 19, 2018
by
Christian Knauf
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
[TASK] Adds robots.txt file
parent
7f974f1e
Pipeline
#3290
passed with stages
in 3 minutes and 15 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
27 additions
and
0 deletions
+27
-0
html/robots.txt
html/robots.txt
+27
-0
No files found.
html/robots.txt
0 → 100644
View file @
7d218ae2
# We do not distinguish between the browsers.
User-agent: *
# Only allow URLs generated with RealURL
Disallow: /*?id=*
Disallow: /*&id=*
# L=0 is the default language
Disallow: /*?L=0*
Disallow: /*&L=0*
# Should always be protected, but you know...
Disallow: /*/Private/*
Disallow: /*/Configuration/*
# Disallow all files in /typo3temp/var/
Disallow: /typo3temp/var/*
# Disallow all files in /typo3/
Disallow: /typo3/
# Disallow all kind of sql files
Disallow: *.sql
Disallow: *.sql.gz
# Sitemap files
Sitemap: https://typo3.org/sitemap.xml
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment