From: Michael Tremer <michael.tremer@ipfire.org>
Date: Fri, 21 Jul 2023 17:21:25 +0000 (+0000)
Subject: robots.txt: Disallow download files from packages
X-Git-Url: http://git.ipfire.org/cgi-bin/gitweb.cgi?a=commitdiff_plain;h=e85dbb0d3d47af10e2bea7c013740e62a89b781a;p=pbs.git

robots.txt: Disallow download files from packages

Signed-off-by: Michael Tremer <michael.tremer@ipfire.org>
---

diff --git a/src/static/robots.txt b/src/static/robots.txt
index 1f53798b..05ebf2ba 100644
--- a/src/static/robots.txt
+++ b/src/static/robots.txt
@@ -1,2 +1,3 @@
 User-agent: *
-Disallow: /
+# Do not allow to index files from all packages
+Disallow: /packages/*/download