From 07051ce50069b96272d4dd94ea9945075d3f3e54 Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Thu, 20 Jan 2022 17:44:17 +0000 Subject: [PATCH 01/25] Add clearer testing and cost to run of reference architectures --- .../reference_architectures/index.md | 58 +++++++++---------- 1 file changed, 29 insertions(+), 29 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index bd796600564c9b..9285e29a117318 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -83,6 +83,35 @@ to get assistance from Support with troubleshooting the [2,000 users](2k_users.m and higher reference architectures. [Read more about our definition of scaled architectures](https://about.gitlab.com/support/#definition-of-scaled-architecture). +### Validation and test results + +The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/engineering/quality/quality-engineering/) does regular smoke and performance tests for the reference architectures to ensure they remain compliant. + +- Testing occurs against all reference architectures and cloud providers in an automated and ad-hoc fashion. This is done by two tools: + - The [GitLab Environment Toolkit](https://gitlab.com/gitlab-org/quality/gitlab-environment-toolkit) for building the environments. + - The [GitLab Performance Tool](https://gitlab.com/gitlab-org/quality/performance) for performance testing. +- Network latency on the test environments between components on all Cloud Providers were measured at <5ms. Note that this is shared as an observation and not as an implicit recommendation. +- We aim to have a "test smart" approach where architectures tested have a good range that can also apply to others. Testing focuses on 10k Omnibus on GCP as the testing has shown this is a good bellwether for the other architectures and cloud providers as well as Cloud Native Hybrids. +- Testing is done publicly and all results are shared. + +Τhe following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly. + +| Reference
Architecture
Size | Bare-Metal | GCP | AWS | Azure | +|-----------------------------|------------|-----|-----|-------| +| 1k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)1 | - | - | +| 2k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)1 | - | - | +| 3k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/3k)1 | - | - | +| 5k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/5k)1 | - | - | +| 10k | Refer to GCP1 | [Standard - Daily](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/10k)1
[Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k) | +| 25k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/25k)1 | - | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/25k) | +| 50k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/50k)1 | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/50k) | - | + +1. The Standard Reference Architectures are designed to be platform agnostic, with everything being run on VMs via [Omnibus GitLab](https://docs.gitlab.com/omnibus/). While testing occurs primarily on GCP, ad-hoc testing has shown that they perform similarly on equivalently specced hardware on other Cloud Providers or if run on premises (bare-metal). + +### Cost to run + +TBD add same table w/ link to all calculators + ## Availability Components GitLab comes with the following components for your use, listed from least to @@ -192,32 +221,3 @@ In the specific case you have the requirement to achieve HA but have a lower use For more details, [refer to this section in the architecture's documentation](3k_users.md#supported-modifications-for-lower-user-counts-ha). -## Testing process and results - -The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/engineering/quality/quality-engineering/) does regular smoke and performance tests for the reference architectures to ensure they remain compliant. - -In this section, we detail some of the process as well as the results. - -Note the following about the testing process: - -- Testing occurs against all main reference architectures and cloud providers in an automated and ad-hoc fashion. - This is achieved through two tools built by the team: - - The [GitLab Environment Toolkit](https://gitlab.com/gitlab-org/quality/gitlab-environment-toolkit) for building the environments. - - The [GitLab Performance Tool](https://gitlab.com/gitlab-org/quality/performance) for performance testing. -- Network latency on the test environments between components on all Cloud Providers were measured at <5ms. Note that this is shared as an observation and not as an implicit recommendation. -- We aim to have a "test smart" approach where architectures tested have a good range that can also apply to others. Testing focuses on 10k Omnibus on GCP as the testing has shown this is a good bellwether for the other architectures and cloud providers as well as Cloud Native Hybrids. -- Testing is done publicly and all results are shared. - -Τhe following table details the testing done against the reference architectures along with the frequency and results. Note that this list above is non exhaustive. Additional testing is continuously evaluated and iterated on, and the table is updated accordingly. - -| Reference
Architecture
Size | Bare-Metal | GCP | AWS | Azure | -|-----------------------------|------------|-----|-----|-------| -| 1k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)1 | - | - | -| 2k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)1 | - | - | -| 3k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/3k)1 | - | - | -| 5k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/5k)1 | - | - | -| 10k | Refer to GCP1 | [Standard - Daily](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/10k)1
[Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k) | -| 25k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/25k)1 | - | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/25k) | -| 50k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/50k)1 | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/50k) | - | - -1. The Standard Reference Architectures are designed to be platform agnostic, with everything being run on VMs via [Omnibus GitLab](https://docs.gitlab.com/omnibus/). While testing occurs primarily on GCP, ad-hoc testing has shown that they perform similarly on equivalently specced hardware on other Cloud Providers or if run on premises (bare-metal). -- GitLab From 5bbc2bb4147c331ca66314b1dfc1aedd72bedc0e Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Thu, 20 Jan 2022 17:53:02 +0000 Subject: [PATCH 02/25] Add cost to run --- doc/administration/reference_architectures/index.md | 13 +++++++++++-- 1 file changed, 11 insertions(+), 2 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 9285e29a117318..2d92c6f85344c3 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -96,7 +96,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en Τhe following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly. -| Reference
Architecture
Size | Bare-Metal | GCP | AWS | Azure | +| Reference
Architecture | Bare-Metal | GCP | AWS | Azure | |-----------------------------|------------|-----|-----|-------| | 1k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)1 | - | - | | 2k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)1 | - | - | @@ -110,7 +110,16 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en ### Cost to run -TBD add same table w/ link to all calculators +| Reference
Architecture
| Bare-Metal | GCP | AWS | Azure | +|-----------------------------|------------|-----|-----|-------| +| 1k | | | - | - | +| 2k | | [Calulated cost](https://cloud.google.com/products/calculator#id=84d11491-d72a-493c-a16e-650931faa658) | - | - | +| 3k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=ac4838e6-9c40-4a36-ac43-6d1bc1843e08) | - | - | +| 5k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=8742e8ea-c08f-4e0a-b058-02f3a1c38a2f) | - | - | +| 10k | | [Calulated cost](https://cloud.google.com/products/calculator#id=e77713f6-dc0b-4bb3-bcef-cea904ac8efd) | - | - | +| 25k | | [Calulated cost](https://cloud.google.com/products/calculator#id=925386e1-c01c-4c0a-8d7d-ebde1824b7b0) | - | - | +| 50k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=8006396b-88ee-40cd-a1c8-77cdefa4d3c8) | - | - | + ## Availability Components -- GitLab From c3ddd8e73cb2405c46f1ba16deb3c59914800915 Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Thu, 20 Jan 2022 17:57:54 +0000 Subject: [PATCH 03/25] Add cost to run --- doc/administration/reference_architectures/2k_users.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/2k_users.md b/doc/administration/reference_architectures/2k_users.md index 467c64b8279d4f..0a2f9e8ced085e 100644 --- a/doc/administration/reference_architectures/2k_users.md +++ b/doc/administration/reference_architectures/2k_users.md @@ -13,7 +13,7 @@ For a full list of reference architectures, see > - **Supported users (approximate):** 2,000 > - **High Availability:** No. For a highly-available environment, you can > follow a modified [3K reference architecture](3k_users.md#supported-modifications-for-lower-user-counts-ha). -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator#id=84d11491-d72a-493c-a16e-650931faa658) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested daily with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 40 RPS, Web: 4 RPS, Git (Pull): 4 RPS, Git (Push): 1 RPS -- GitLab From e465d74cff4be0e35c2b88e8e41665eba881a215 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 19:51:02 +0000 Subject: [PATCH 04/25] Adding HTML table instead of markdown --- .../reference_architectures/index.md | 86 +++++++++++++++++++ 1 file changed, 86 insertions(+) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 2d92c6f85344c3..c2eadf4febe19c 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -96,6 +96,92 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en Τhe following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly. + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + | Reference
Architecture | Bare-Metal | GCP | AWS | Azure | |-----------------------------|------------|-----|-----|-------| | 1k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)1 | - | - | -- GitLab From f0abba5cd93416ee9694e260f1a943246b927807 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 19:53:49 +0000 Subject: [PATCH 05/25] Fix the table --- doc/administration/reference_architectures/index.md | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index c2eadf4febe19c..6784fee19df902 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -177,10 +177,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - - - - +
Reference
Architecture		GCP Env/ Bare-MetalAWS EnvAzure Env
OmnibusCloud Native HybridOmnibusCloud Native HybridOmnibusCloud Native Hybrid
1k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)
2k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)
3k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/3k)
5k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/5k)
10k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/10k)[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid)[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid)[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
25k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/25k)Omnibus + Cloud SQL (for UBS)
50k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/50k)
| Reference
Architecture | Bare-Metal | GCP | AWS | Azure | |-----------------------------|------------|-----|-----|-------| -- GitLab From 1790b9ac3dbd9393eaca926584948e1f4e8653c7 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 20:08:39 +0000 Subject: [PATCH 06/25] Delete empty lines --- doc/administration/reference_architectures/index.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 6784fee19df902..aaab56874ee820 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -203,7 +203,6 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en | 25k | | [Calulated cost](https://cloud.google.com/products/calculator#id=925386e1-c01c-4c0a-8d7d-ebde1824b7b0) | - | - | | 50k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=8006396b-88ee-40cd-a1c8-77cdefa4d3c8) | - | - | - ## Availability Components GitLab comes with the following components for your use, listed from least to @@ -312,4 +311,3 @@ The reference architectures for user counts [3,000](3k_users.md) and up support In the specific case you have the requirement to achieve HA but have a lower user count, select modifications to the [3,000 user](3k_users.md) architecture are supported. For more details, [refer to this section in the architecture's documentation](3k_users.md#supported-modifications-for-lower-user-counts-ha). - -- GitLab From 629332de88977c2ecaa284e2df964b48d868d541 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 20:50:17 +0000 Subject: [PATCH 07/25] Fix broken anchors --- doc/administration/reference_architectures/10k_users.md | 2 +- doc/administration/reference_architectures/25k_users.md | 2 +- doc/administration/reference_architectures/2k_users.md | 2 +- doc/administration/reference_architectures/3k_users.md | 2 +- doc/administration/reference_architectures/50k_users.md | 2 +- doc/administration/reference_architectures/5k_users.md | 2 +- 6 files changed, 6 insertions(+), 6 deletions(-) diff --git a/doc/administration/reference_architectures/10k_users.md b/doc/administration/reference_architectures/10k_users.md index a5c60af47b183b..f9ff3d49a06a50 100644 --- a/doc/administration/reference_architectures/10k_users.md +++ b/doc/administration/reference_architectures/10k_users.md @@ -2234,7 +2234,7 @@ future with further specific cloud provider details. | Sidekiq | 4 | 4 vCPU, 15 GB memory | `n1-standard-4` | 15.5 vCPU, 50 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 4 vCPU, 15 GB memory | `n1-standard-4` | 7.75 vCPU, 25 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. diff --git a/doc/administration/reference_architectures/25k_users.md b/doc/administration/reference_architectures/25k_users.md index 8cc355db951365..bc8d402285560d 100644 --- a/doc/administration/reference_architectures/25k_users.md +++ b/doc/administration/reference_architectures/25k_users.md @@ -2232,7 +2232,7 @@ future with further specific cloud provider details. | Sidekiq | 4 | 4 vCPU, 15 GB memory | `n1-standard-4` | 15.5 vCPU, 50 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 4 vCPU, 15 GB memory | `n1-standard-4` | 7.75 vCPU, 25 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. diff --git a/doc/administration/reference_architectures/2k_users.md b/doc/administration/reference_architectures/2k_users.md index 0a2f9e8ced085e..f6c484b08b1277 100644 --- a/doc/administration/reference_architectures/2k_users.md +++ b/doc/administration/reference_architectures/2k_users.md @@ -1022,7 +1022,7 @@ future with further specific cloud provider details. | Sidekiq | 2 | 2 vCPU, 7.5 GB memory | `n1-standard-2` | 3.9 vCPU, 11.8 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 1 vCPU, 3.75 GB memory | `n1-standard-1` | 1.9 vCPU, 5.5 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. diff --git a/doc/administration/reference_architectures/3k_users.md b/doc/administration/reference_architectures/3k_users.md index 01d9987739bb76..a7ec8e6f9cb5ae 100644 --- a/doc/administration/reference_architectures/3k_users.md +++ b/doc/administration/reference_architectures/3k_users.md @@ -2191,7 +2191,7 @@ future with further specific cloud provider details. | Sidekiq | 3 | 4 vCPU, 15 GB memory | `n1-standard-4` | 11.8 vCPU, 38.9 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 2 vCPU, 7.5 GB memory | `n1-standard-2` | 3.9 vCPU, 11.8 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. diff --git a/doc/administration/reference_architectures/50k_users.md b/doc/administration/reference_architectures/50k_users.md index d5bb9c4ad6459d..fad22386b8092a 100644 --- a/doc/administration/reference_architectures/50k_users.md +++ b/doc/administration/reference_architectures/50k_users.md @@ -2248,7 +2248,7 @@ future with further specific cloud provider details. | Sidekiq | 4 | 4 vCPU, 15 GB memory | `n1-standard-4` | 15.5 vCPU, 50 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 4 vCPU, 15 GB memory | `n1-standard-4` | 7.75 vCPU, 25 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. diff --git a/doc/administration/reference_architectures/5k_users.md b/doc/administration/reference_architectures/5k_users.md index 33ca4e4899f4b5..c104bae8656076 100644 --- a/doc/administration/reference_architectures/5k_users.md +++ b/doc/administration/reference_architectures/5k_users.md @@ -2167,7 +2167,7 @@ future with further specific cloud provider details. | Sidekiq | 3 | 4 vCPU, 15 GB memory | `n1-standard-4` | 11.8 vCPU, 38.9 GB memory | | Supporting services such as NGINX, Prometheus | 2 | 2 vCPU, 7.5 GB memory | `n1-standard-2` | 3.9 vCPU, 11.8 GB memory | -- For this setup, we **recommend** and regularly [test](index.md#testing-process-and-results) +- For this setup, we **recommend** and regularly [test](index.md#validation-and-test-results) [Google Kubernetes Engine (GKE)](https://cloud.google.com/kubernetes-engine) and [Amazon Elastic Kubernetes Service (EKS)](https://aws.amazon.com/eks/). Other Kubernetes services may also work, but your mileage may vary. - Nodes configuration is shown as it is forced to ensure pod vcpu / memory ratios and avoid scaling during **performance testing**. - In production deployments, there is no need to assign pods to nodes. A minimum of three nodes in three different availability zones is strongly recommended to align with resilient cloud architecture practices. -- GitLab From 4a3a87b0f7d15fcea42ecada8d99083ea9c0d530 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 21:00:59 +0000 Subject: [PATCH 08/25] Point all costs to the main Cost table --- doc/administration/reference_architectures/10k_users.md | 2 +- doc/administration/reference_architectures/25k_users.md | 2 +- doc/administration/reference_architectures/3k_users.md | 2 +- doc/administration/reference_architectures/50k_users.md | 2 +- doc/administration/reference_architectures/5k_users.md | 2 +- doc/administration/reference_architectures/index.md | 2 +- 6 files changed, 6 insertions(+), 6 deletions(-) diff --git a/doc/administration/reference_architectures/10k_users.md b/doc/administration/reference_architectures/10k_users.md index f9ff3d49a06a50..87fa0ff236e53b 100644 --- a/doc/administration/reference_architectures/10k_users.md +++ b/doc/administration/reference_architectures/10k_users.md @@ -12,7 +12,7 @@ full list of reference architectures, see > - **Supported users (approximate):** 10,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator#id=e77713f6-dc0b-4bb3-bcef-cea904ac8efd) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested daily with the [GitLab Performance Tool](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 200 RPS, Web: 20 RPS, Git (Pull): 20 RPS, Git (Push): 4 RPS diff --git a/doc/administration/reference_architectures/25k_users.md b/doc/administration/reference_architectures/25k_users.md index bc8d402285560d..f133e48008e881 100644 --- a/doc/administration/reference_architectures/25k_users.md +++ b/doc/administration/reference_architectures/25k_users.md @@ -12,7 +12,7 @@ full list of reference architectures, see > - **Supported users (approximate):** 25,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator#id=925386e1-c01c-4c0a-8d7d-ebde1824b7b0) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested weekly with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 500 RPS, Web: 50 RPS, Git (Pull): 50 RPS, Git (Push): 10 RPS diff --git a/doc/administration/reference_architectures/3k_users.md b/doc/administration/reference_architectures/3k_users.md index a7ec8e6f9cb5ae..0aadfa4e6220f3 100644 --- a/doc/administration/reference_architectures/3k_users.md +++ b/doc/administration/reference_architectures/3k_users.md @@ -22,7 +22,7 @@ For a full list of reference architectures, see > - **Supported users (approximate):** 3,000 > - **High Availability:** Yes, although [Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator/#id=ac4838e6-9c40-4a36-ac43-6d1bc1843e08) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested weekly with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 60 RPS, Web: 6 RPS, Git (Pull): 6 RPS, Git (Push): 1 RPS diff --git a/doc/administration/reference_architectures/50k_users.md b/doc/administration/reference_architectures/50k_users.md index fad22386b8092a..365a634cec55a9 100644 --- a/doc/administration/reference_architectures/50k_users.md +++ b/doc/administration/reference_architectures/50k_users.md @@ -12,7 +12,7 @@ full list of reference architectures, see > - **Supported users (approximate):** 50,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator/#id=8006396b-88ee-40cd-a1c8-77cdefa4d3c8) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested weekly with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 1000 RPS, Web: 100 RPS, Git (Pull): 100 RPS, Git (Push): 20 RPS diff --git a/doc/administration/reference_architectures/5k_users.md b/doc/administration/reference_architectures/5k_users.md index c104bae8656076..5e029de517dfb8 100644 --- a/doc/administration/reference_architectures/5k_users.md +++ b/doc/administration/reference_architectures/5k_users.md @@ -19,7 +19,7 @@ costly-to-operate environment by using the > - **Supported users (approximate):** 5,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [GCP](https://cloud.google.com/products/calculator/#id=8742e8ea-c08f-4e0a-b058-02f3a1c38a2f) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested weekly with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 100 RPS, Web: 10 RPS, Git (Pull): 10 RPS, Git (Push): 2 RPS diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index aaab56874ee820..b2ac5904214394 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -191,7 +191,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en 1. The Standard Reference Architectures are designed to be platform agnostic, with everything being run on VMs via [Omnibus GitLab](https://docs.gitlab.com/omnibus/). While testing occurs primarily on GCP, ad-hoc testing has shown that they perform similarly on equivalently specced hardware on other Cloud Providers or if run on premises (bare-metal). -### Cost to run +### Cost to run | Reference
Architecture
| Bare-Metal | GCP | AWS | Azure | |-----------------------------|------------|-----|-----|-------| -- GitLab From cf3708a13df80450d2b2eadb7c6a1af1a14f941e Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Thu, 20 Jan 2022 21:02:08 +0000 Subject: [PATCH 09/25] Apply 2 suggestions --- doc/administration/reference_architectures/index.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index b2ac5904214394..7e653722075ec8 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -102,8 +102,8 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en Reference
Architecture - GCP Env/ Bare-Metal - AWS Env + GCP (* also proxy for Bare-Metal) + AWS Azure Env -- GitLab From a323725d19ea1c44c2a33c20c9519b8022292aa3 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 21:06:37 +0000 Subject: [PATCH 10/25] Remove old table --- .../reference_architectures/index.md | 14 ++------------ 1 file changed, 2 insertions(+), 12 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 7e653722075ec8..23bbc5949bdebb 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -104,7 +104,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en Reference
Architecture GCP (* also proxy for Bare-Metal) AWS - Azure Env + Azure Omnibus @@ -179,17 +179,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en -| Reference
Architecture | Bare-Metal | GCP | AWS | Azure | -|-----------------------------|------------|-----|-----|-------| -| 1k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)1 | - | - | -| 2k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)1 | - | - | -| 3k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/3k)1 | - | - | -| 5k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/5k)1 | - | - | -| 10k | Refer to GCP1 | [Standard - Daily](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/10k)1
[Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)
[Cloud Native Hybrid - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid) | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k) | -| 25k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/25k)1 | - | [Standard - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/25k) | -| 50k | Refer to GCP1 | [Standard - Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/50k)1 | [Standard (inc Cloud Services) - Ad-Hoc](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/50k) | - | - -1. The Standard Reference Architectures are designed to be platform agnostic, with everything being run on VMs via [Omnibus GitLab](https://docs.gitlab.com/omnibus/). While testing occurs primarily on GCP, ad-hoc testing has shown that they perform similarly on equivalently specced hardware on other Cloud Providers or if run on premises (bare-metal). +The Standard Reference Architectures are designed to be platform agnostic, with everything being run on VMs via [Omnibus GitLab](https://docs.gitlab.com/omnibus/). While testing occurs primarily on GCP, ad-hoc testing has shown that they perform similarly on equivalently specced hardware on other Cloud Providers or if run on premises (bare-metal). ### Cost to run -- GitLab From 77a69c5b563a15eb25d8a6b6b4af5e2d8092ef55 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Thu, 20 Jan 2022 21:18:06 +0000 Subject: [PATCH 11/25] Fix broken anchor for 10k --- doc/administration/reference_architectures/10k_users.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/10k_users.md b/doc/administration/reference_architectures/10k_users.md index 87fa0ff236e53b..0c73967e877bcb 100644 --- a/doc/administration/reference_architectures/10k_users.md +++ b/doc/administration/reference_architectures/10k_users.md @@ -12,7 +12,7 @@ full list of reference architectures, see > - **Supported users (approximate):** 10,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Estimated Costs:** [See cost table](#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested daily with the [GitLab Performance Tool](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 200 RPS, Web: 20 RPS, Git (Pull): 20 RPS, Git (Push): 4 RPS -- GitLab From 9e5e4d542056e7a1cface3273663bdf0bb2cb995 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Fri, 21 Jan 2022 04:09:22 +0000 Subject: [PATCH 12/25] Add style and correct links --- .../reference_architectures/index.md | 40 +++++++++++++------ 1 file changed, 27 insertions(+), 13 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 23bbc5949bdebb..85b88c7de1fb0c 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -96,11 +96,25 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en Τhe following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly. - + + +
+ - @@ -114,9 +128,9 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - + - + @@ -125,7 +139,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - + @@ -136,7 +150,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - + @@ -147,21 +161,21 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - + - - + + - + - + - + @@ -170,7 +184,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - + -- GitLab From 1e4f763baad3638ce06631a478c4aab42b51acdd Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Fri, 21 Jan 2022 04:27:35 +0000 Subject: [PATCH 13/25] Apply 1 suggestion(s) to 1 file(s) --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 85b88c7de1fb0c..672084c4bd1d2e 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -179,7 +179,7 @@ table.test-coverage th { - + -- GitLab From 953254f6f40f15906e05594f26c2dd303b95ab2a Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Fri, 21 Jan 2022 13:35:09 +0000 Subject: [PATCH 14/25] Fix 10k anchor to cost table --- doc/administration/reference_architectures/10k_users.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/10k_users.md b/doc/administration/reference_architectures/10k_users.md index 0c73967e877bcb..87fa0ff236e53b 100644 --- a/doc/administration/reference_architectures/10k_users.md +++ b/doc/administration/reference_architectures/10k_users.md @@ -12,7 +12,7 @@ full list of reference architectures, see > - **Supported users (approximate):** 10,000 > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](#cost-to-run) +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Performance tested daily with the [GitLab Performance Tool](https://gitlab.com/gitlab-org/quality/performance)**: > - **Test requests per second (RPS) rates:** API: 200 RPS, Web: 20 RPS, Git (Pull): 20 RPS, Git (Push): 4 RPS -- GitLab From d006abbf5bb180b6ef6486646ed8e390fccaeeca Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Fri, 21 Jan 2022 14:20:29 +0000 Subject: [PATCH 15/25] Add table for Cost to run --- .../reference_architectures/index.md | 91 +++++++++++++++++-- 1 file changed, 82 insertions(+), 9 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 672084c4bd1d2e..906623d9672d7b 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -197,15 +197,88 @@ The Standard Reference Architectures are designed to be platform agnostic, with ### Cost to run -| Reference
Architecture
| Bare-Metal | GCP | AWS | Azure | -|-----------------------------|------------|-----|-----|-------| -| 1k | | | - | - | -| 2k | | [Calulated cost](https://cloud.google.com/products/calculator#id=84d11491-d72a-493c-a16e-650931faa658) | - | - | -| 3k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=ac4838e6-9c40-4a36-ac43-6d1bc1843e08) | - | - | -| 5k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=8742e8ea-c08f-4e0a-b058-02f3a1c38a2f) | - | - | -| 10k | | [Calulated cost](https://cloud.google.com/products/calculator#id=e77713f6-dc0b-4bb3-bcef-cea904ac8efd) | - | - | -| 25k | | [Calulated cost](https://cloud.google.com/products/calculator#id=925386e1-c01c-4c0a-8d7d-ebde1824b7b0) | - | - | -| 50k | | [Calulated cost](https://cloud.google.com/products/calculator/#id=8006396b-88ee-40cd-a1c8-77cdefa4d3c8) | - | - | +
Reference
Architecture		 GCP (* also proxy for Bare-Metal) AWSOmnibus Cloud Native Hybrid
1k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/1k)Weekly
2k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/2k)Weekly 3k [Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/3k)Weekly [Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/5k)Weekly
10k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/10k)[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid)WeeklyWeekly [Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k-Cloud-Native-Hybrid)Weekly [Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Past-Results/10k)Weekly
25k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/25k)Weekly
50k[Weekly](https://gitlab.com/gitlab-org/quality/performance/-/wikis/Benchmarks/Latest/50k)Weekly Omnibus + Cloud SQL (for UBS)Omnibus + Cloud SQL
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Reference
Architecture		GCP (* also proxy for Bare-Metal)AWSAzure
OmnibusCloud Native HybridOmnibusCloud Native HybridOmnibusCloud Native Hybrid
1k
2kCalculated cost
3kCalculated cost
5kCalculated cost
10kCalculated cost
25kCalculated cost
50kCalculated cost
## Availability Components -- GitLab From ab12cfb35a557cba35312c1579eb00b803b56b5e Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Fri, 21 Jan 2022 18:24:18 +0000 Subject: [PATCH 16/25] Add center alignment to table header --- doc/administration/reference_architectures/index.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 906623d9672d7b..86f71f65f0601e 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -116,9 +116,9 @@ table.test-coverage th { Reference
Architecture - GCP (* also proxy for Bare-Metal) - AWS - Azure + GCP (* also proxy for Bare-Metal) + AWS + Azure Omnibus @@ -203,9 +203,9 @@ The Standard Reference Architectures are designed to be platform agnostic, with Reference
Architecture - GCP (* also proxy for Bare-Metal) - AWS - Azure + GCP (* also proxy for Bare-Metal) + AWS + Azure Omnibus -- GitLab From d970b802f8d9f68fb23e4910d807c9fc930aeec3 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Fri, 21 Jan 2022 20:29:10 +0000 Subject: [PATCH 17/25] Omnibus 10k runs Daily --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 86f71f65f0601e..2116abd7454566 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -166,7 +166,7 @@ table.test-coverage th { 10k - Weekly + Daily Weekly Weekly -- GitLab From e1aa9b8e3191671eda48f6caf6d84c2ce5b19c91 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Sat, 22 Jan 2022 22:56:36 +0000 Subject: [PATCH 18/25] Add link for 25k --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 2116abd7454566..5aaad46ec54109 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -179,7 +179,7 @@ table.test-coverage th { - Omnibus + Cloud SQL + Omnibus + Cloud SQL -- GitLab From 2c85dff0f4a663a5fec6239c5c9004f184f9d04a Mon Sep 17 00:00:00 2001 From: Tanya Pazitny Date: Mon, 24 Jan 2022 21:40:11 +0000 Subject: [PATCH 19/25] Apply 1 suggestion(s) to 1 file(s) --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 5aaad46ec54109..9e2c1b873fa5a6 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -217,7 +217,7 @@ The Standard Reference Architectures are designed to be platform agnostic, with 1k - + Calculated cost -- GitLab From 1985a3d9302ecaedf08348ded413fcbefe17c1d1 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Mon, 24 Jan 2022 21:59:37 +0000 Subject: [PATCH 20/25] Add current status to test result table --- .../reference_architectures/index.md | 20 +++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 9e2c1b873fa5a6..762fefca9b05b4 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -130,7 +130,7 @@ table.test-coverage th { 1k - Weekly + Daily @@ -139,7 +139,7 @@ table.test-coverage th { 2k - Weekly + Daily @@ -148,30 +148,30 @@ table.test-coverage th { 3k + Weekly - Weekly 5k + Weekly - Weekly 10k Daily - Weekly - - Weekly + Ad-Hoc + Ad-Hoc (inc Cloud Services) + Ad-Hoc + Ad-Hoc - Weekly 25k @@ -179,14 +179,14 @@ table.test-coverage th { - Omnibus + Cloud SQL + Ad-Hoc (inc Cloud SQL) 50k Weekly - + Ad-Hoc (inc Cloud Services) -- GitLab From 7d4d76ffbdadf6a5be2ad92151fc642f3517b1cd Mon Sep 17 00:00:00 2001 From: Grant Young Date: Tue, 25 Jan 2022 13:52:52 +0000 Subject: [PATCH 21/25] Remove Cloud SQL as Azure Postgres is currently not supported --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 762fefca9b05b4..3c6cb655f9b4be 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -179,7 +179,7 @@ table.test-coverage th { - Ad-Hoc (inc Cloud SQL) + Ad-Hoc -- GitLab From 8ede2460e5d5a65a945052fbb808941bb81d05b5 Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Tue, 25 Jan 2022 17:56:02 +0000 Subject: [PATCH 22/25] Add reference to cost table in 1k --- doc/administration/reference_architectures/1k_users.md | 1 + 1 file changed, 1 insertion(+) diff --git a/doc/administration/reference_architectures/1k_users.md b/doc/administration/reference_architectures/1k_users.md index ed6fbe84a4804c..0d0e7681ffdb26 100644 --- a/doc/administration/reference_architectures/1k_users.md +++ b/doc/administration/reference_architectures/1k_users.md @@ -18,6 +18,7 @@ many organizations. > - **Supported users (approximate):** 1,000 > - **High Availability:** No. For a highly-available environment, you can > follow a modified [3K reference architecture](3k_users.md#supported-modifications-for-lower-user-counts-ha). +> - **Estimated Costs:** [See cost table](index.md#cost-to-run) > - **Cloud Native Hybrid:** No. For a cloud native hybrid environment, you > can follow a [modified hybrid reference architecture](#cloud-native-hybrid-reference-architecture-with-helm-charts). > - **Performance tested daily with the [GitLab Performance Tool (GPT)](https://gitlab.com/gitlab-org/quality/performance)**: -- GitLab From 1c9555e3a594da717b9cb0855c090b3681376e76 Mon Sep 17 00:00:00 2001 From: Mek Stittri Date: Tue, 25 Jan 2022 18:32:22 +0000 Subject: [PATCH 23/25] Remove bare metal from Cost to run table --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 3c6cb655f9b4be..95648aa7a97ae9 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -203,7 +203,7 @@ The Standard Reference Architectures are designed to be platform agnostic, with Reference
Architecture - GCP (* also proxy for Bare-Metal) + GCP AWS Azure -- GitLab From 1b92f4c5fb1e4fc5339f698c1053e315d40d40fb Mon Sep 17 00:00:00 2001 From: Vincy Wilson Date: Tue, 25 Jan 2022 18:49:02 +0000 Subject: [PATCH 24/25] Add note that 1k and 2k will be moved to Weekly --- doc/administration/reference_architectures/index.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 95648aa7a97ae9..4a94ba69549f52 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -130,7 +130,7 @@ table.test-coverage th { 1k - Daily + Daily (to be moved to Weekly) @@ -139,7 +139,7 @@ table.test-coverage th { 2k - Daily + Daily (to be moved to Weekly) -- GitLab From 82c4e24bead499be9335172c30c63fa8e8b76ddb Mon Sep 17 00:00:00 2001 From: Achilleas Pipinellis Date: Wed, 26 Jan 2022 13:29:07 +0000 Subject: [PATCH 25/25] Apply 1 suggestion(s) to 1 file(s) --- doc/administration/reference_architectures/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 4a94ba69549f52..2a9e4cc0e7a7ca 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -94,7 +94,7 @@ The [Quality Engineering - Enablement team](https://about.gitlab.com/handbook/en - We aim to have a "test smart" approach where architectures tested have a good range that can also apply to others. Testing focuses on 10k Omnibus on GCP as the testing has shown this is a good bellwether for the other architectures and cloud providers as well as Cloud Native Hybrids. - Testing is done publicly and all results are shared. -Τhe following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly. +The following table details the testing done against the reference architectures along with the frequency and results. Additional testing is continuously evaluated, and the table is updated accordingly.