matthieu/dubuval
1
0
Fork 0
Code Releases Activity
722560590c
dubuval/robots.txt

5 lines
79 B
Plaintext
Raw Normal View History

Mise-en-ligne
2016-11-02 19:20:43 +00:00
Sitemap: http://dubuval.dubuget.fr/sitemap.xml
Import initial site
2016-10-16 08:53:19 +00:00
User-agent: *
Nettoyage
2016-11-01 16:47:59 +00:00
Crawl-Delay: 300
Copy Permalink