From 2296b357e381a3f17b0b078d26763b3ac5f680c6 Mon Sep 17 00:00:00 2001
From: Gary Holtz <gholtz@gitlab.com>
Date: Wed, 13 May 2020 13:09:25 -0500
Subject: [PATCH] Adding updated scope to robots.text

With some projects falling under the '-' scope, we'll need some updated
robots.txt lines
---
 public/robots.txt | 1 +
 1 file changed, 1 insertion(+)

diff --git a/public/robots.txt b/public/robots.txt
index 6f2396d0869b5e..20cd97a596f52c 100644
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -35,6 +35,7 @@ Disallow: /snippets/*/raw
 User-Agent: *
 Disallow: /*/*.git
 Disallow: /*/*/fork/new
+Disallow: /*/-/archive/
 Disallow: /*/*/repository/archive*
 Disallow: /*/*/activity
 Disallow: /*/*/new
-- 
GitLab