From: Guillaume Pellerin Date: Mon, 5 Jan 2015 14:08:30 +0000 (+0100) Subject: update robots.txt rules X-Git-Tag: 1.5.0rc5~1 X-Git-Url: https://git.parisson.com/?a=commitdiff_plain;h=481a1623e02557b8595ee3faf526ae699f8a8313;p=telemeta.git update robots.txt rules --- diff --git a/example/sandbox/robots.txt b/example/sandbox/robots.txt index 995386ae..5ac75ebe 100644 --- a/example/sandbox/robots.txt +++ b/example/sandbox/robots.txt @@ -1,5 +1,4 @@ User-agent: * -Disallow: /*/download/*$ -Disallow: /*/visualize/*$ -Disallow: /*/analyze/*$ - +Disallow: *.mp3$ +Disallow: */WIDTHxHEIGHT/ +Disallow: */xml/