Commit 7d218ae2 authored by Christian Knauf's avatar Christian Knauf
Browse files

[TASK] Adds robots.txt file

parent 7f974f1e
Pipeline #3290 passed with stages
in 3 minutes and 15 seconds
# We do not distinguish between the browsers.
User-agent: *
# Only allow URLs generated with RealURL
Disallow: /*?id=*
Disallow: /*&id=*
# L=0 is the default language
Disallow: /*?L=0*
Disallow: /*&L=0*
# Should always be protected, but you know...
Disallow: /*/Private/*
Disallow: /*/Configuration/*
# Disallow all files in /typo3temp/var/
Disallow: /typo3temp/var/*
# Disallow all files in /typo3/
Disallow: /typo3/
# Disallow all kind of sql files
Disallow: *.sql
Disallow: *.sql.gz
# Sitemap files
Sitemap: https://typo3.org/sitemap.xml
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment