matthieu
/
dubuval
1
0
Fork 0
Code Releases Activity
dubuval/robots.txt

5 lines
83 B
Plaintext
Raw Normal View History

Nettoyage
2016-11-01 16:47:59 +00:00
Sitemap: http://dubuvaltest.dubuget.fr/sitemap.xml
Import initial site
2016-10-16 08:53:19 +00:00
User-agent: *
Nettoyage
2016-11-01 16:47:59 +00:00
Crawl-Delay: 300