From 5765b71a131dd35bd2c5cb7797d808744fbe70a0 Mon Sep 17 00:00:00 2001 From: Grant Young Date: Mon, 20 May 2024 13:33:28 +0100 Subject: [PATCH] Adjust Ref Arch costs section to be more accurate Better reflects need to add in specific usage --- .../reference_architectures/10k_users.md | 2 +- .../reference_architectures/1k_users.md | 2 +- .../reference_architectures/25k_users.md | 2 +- .../reference_architectures/2k_users.md | 2 +- .../reference_architectures/3k_users.md | 2 +- .../reference_architectures/50k_users.md | 2 +- .../reference_architectures/5k_users.md | 2 +- .../reference_architectures/index.md | 26 ++++++++++--------- .../index.md | 2 +- 9 files changed, 22 insertions(+), 20 deletions(-) diff --git a/doc/administration/reference_architectures/10k_users.md b/doc/administration/reference_architectures/10k_users.md index 8cda171af39b86..677e944f202c0c 100644 --- a/doc/administration/reference_architectures/10k_users.md +++ b/doc/administration/reference_architectures/10k_users.md @@ -21,7 +21,7 @@ specifically the [Before you start](index.md#before-you-start) and [Deciding whi > - **Target load:** API: 200 RPS, Web: 20 RPS, Git (Pull): 20 RPS, Git (Push): 4 RPS > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with) diff --git a/doc/administration/reference_architectures/1k_users.md b/doc/administration/reference_architectures/1k_users.md index 200870cb408e19..8331ae8cabed57 100644 --- a/doc/administration/reference_architectures/1k_users.md +++ b/doc/administration/reference_architectures/1k_users.md @@ -18,7 +18,7 @@ For a full list of reference architectures, see > - **Target Load:** API: 20 RPS, Web: 2 RPS, Git (Pull): 2 RPS, Git (Push): 1 RPS > - **High Availability:** No. For a highly-available environment, you can > follow a modified [3K reference architecture](3k_users.md#supported-modifications-for-lower-user-counts-ha). -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid:** No. For a cloud native hybrid environment, you > can follow a [modified hybrid reference architecture](#cloud-native-hybrid-reference-architecture-with-helm-charts). > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with). diff --git a/doc/administration/reference_architectures/25k_users.md b/doc/administration/reference_architectures/25k_users.md index b2e54744ae52c3..ad27ca3f25f92f 100644 --- a/doc/administration/reference_architectures/25k_users.md +++ b/doc/administration/reference_architectures/25k_users.md @@ -21,7 +21,7 @@ specifically the [Before you start](index.md#before-you-start) and [Deciding whi > - **Target load:** API: 500 RPS, Web: 50 RPS, Git (Pull): 50 RPS, Git (Push): 10 RPS > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with) diff --git a/doc/administration/reference_architectures/2k_users.md b/doc/administration/reference_architectures/2k_users.md index 4b588a0cbd4664..0d7561d0fc50db 100644 --- a/doc/administration/reference_architectures/2k_users.md +++ b/doc/administration/reference_architectures/2k_users.md @@ -18,7 +18,7 @@ For a full list of reference architectures, see > - **Target Load:** API: 40 RPS, Web: 4 RPS, Git (Pull): 4 RPS, Git (Push): 1 RPS > - **High Availability:** No. For a highly-available environment, you can > follow a modified [3K or 60 RPS reference architecture](3k_users.md#supported-modifications-for-lower-user-counts-ha). -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with). diff --git a/doc/administration/reference_architectures/3k_users.md b/doc/administration/reference_architectures/3k_users.md index a054dc9b39b137..a3d865c49588d3 100644 --- a/doc/administration/reference_architectures/3k_users.md +++ b/doc/administration/reference_architectures/3k_users.md @@ -21,7 +21,7 @@ For a full list of reference architectures, see > - **Target Load:** 60 RPS, Web: 6 RPS, Git (Pull): 6 RPS, Git (Push): 1 RPS > - **High Availability:** Yes, although [Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with). diff --git a/doc/administration/reference_architectures/50k_users.md b/doc/administration/reference_architectures/50k_users.md index e6adf3628ca34e..e18a84af59afda 100644 --- a/doc/administration/reference_architectures/50k_users.md +++ b/doc/administration/reference_architectures/50k_users.md @@ -21,7 +21,7 @@ specifically the [Before you start](index.md#before-you-start) and [Deciding whi > - **Target load:** API: 1000 RPS, Web: 100 RPS, Git (Pull): 100 RPS, Git (Push): 20 RPS > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with) diff --git a/doc/administration/reference_architectures/5k_users.md b/doc/administration/reference_architectures/5k_users.md index 3ea5ac7e72c3f8..a28f7e1535847b 100644 --- a/doc/administration/reference_architectures/5k_users.md +++ b/doc/administration/reference_architectures/5k_users.md @@ -21,7 +21,7 @@ specifically the [Before you start](index.md#before-you-start) and [Deciding whi > - **Target load:** API: 100 RPS, Web: 10 RPS, Git (Pull): 10 RPS, Git (Push): 2 RPS > - **High Availability:** Yes ([Praefect](#configure-praefect-postgresql) needs a third-party PostgreSQL solution for HA) -> - **Estimated Costs:** [See cost table](index.md#cost-to-run) +> - **Cost calculator template:** [See cost calculator templates section](index.md#cost-calculator-templates) > - **Cloud Native Hybrid Alternative:** [Yes](#cloud-native-hybrid-reference-architecture-with-helm-charts-alternative) > - **Unsure which Reference Architecture to use?** [Go to this guide for more info](index.md#deciding-which-architecture-to-start-with) diff --git a/doc/administration/reference_architectures/index.md b/doc/administration/reference_architectures/index.md index 24c69657af0e9b..ee03e100cab024 100644 --- a/doc/administration/reference_architectures/index.md +++ b/doc/administration/reference_architectures/index.md @@ -633,18 +633,19 @@ table.test-coverage th { -## Cost to run +## Cost calculator templates -As a starting point, the following table details initial costs for the different reference architectures across GCP, AWS, and Azure through the Linux package via each cloud provider's official calculator. +As a starting point, the following table lists initial compute calculator cost templates for the different reference architectures across GCP, AWS, and Azure via each cloud provider's official calculator. However, please be aware of the following caveats: -- These are only rough estimates for the Linux package environments. -- They do not take into account dynamic elements such as disk, network or object storage. +- These are only rough estimate compute templates for the Linux package architectures. +- They do not take into account dynamic elements such as disk, network or object storage - Which can notably impact costs. - Due to the nature of Cloud Native Hybrid, it's not possible to give a static cost calculation for that deployment. +- Committed use discounts are applied if they are defaulted as such for the cloud provider calculator in question. - Bare-metal costs are also not included here as it varies widely depending on each configuration. -Due to the above it's strongly recommended taking these calculators and adjusting them as close as possible to your specific setup and usage as much as possible to get a more accurate estimate. +To get an accurate estimate of costs for your specific environment you must take the closest template and adjust it accordingly to match the specs and your expected usage. @@ -663,43 +664,43 @@ Due to the above it's strongly recommended taking these calculators and adjustin - + - + - + - + - + - + - + @@ -775,6 +776,7 @@ You can find a full history of changes [on the GitLab project](https://gitlab.co **2024:** +- [2024-05](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/153579): Renamed `Cost to run` section to `Cost calculator templates` to better reflect the calculators are only a starting point and need to be adjusted with specific usage to give more accurate cost estimates. - [2024-04](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/149878): Updated recommended sizings for Webservice nodes for Cloud Native Hybrids on GCP. Also adjusted NGINX pod recommendation to be run on Webservice node pool as a DaemonSet. - [2024-04](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/149528): Updated 20 RPS / 1,000 User architecture specs to follow recommended memory target of 16 GB. - [2024-04](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/148313): Updated Reference Architecture titles to include RPS for further clarity and to help right sizing. diff --git a/doc/architecture/blueprints/clickhouse_usage/self_managed_costs_and_requirements/index.md b/doc/architecture/blueprints/clickhouse_usage/self_managed_costs_and_requirements/index.md index 25f503862137ea..bb14ffe987469f 100644 --- a/doc/architecture/blueprints/clickhouse_usage/self_managed_costs_and_requirements/index.md +++ b/doc/architecture/blueprints/clickhouse_usage/self_managed_costs_and_requirements/index.md @@ -36,7 +36,7 @@ and collaborating with ClickHouse team, we identified the following minimal conf - ClickHouse - 1 machine with >=16-cores, >=64 GB RAM, SSD, 10 GB Internet. The following [cost table](https://gitlab.com/gitlab-com/www-gitlab-com/-/issues/14384#note_1324085466) was compiled using the machine CPU and memory requirements for ClickHouse, and comparing them to the -GitLab Reference Architecture sizes and [costs](../../../../administration/reference_architectures/index.md#cost-to-run) from the GCP calculator. +GitLab Reference Architecture sizes and [costs](../../../../administration/reference_architectures/index.md#cost-calculator-templates) from the GCP calculator. | Reference Architecture | ClickHouse type | ClickHouse cost / (GitLab cost + ClickHouse cost) | |-------------|-----------------|-----------------------------------| -- GitLab
1kCalculated costCalculated cost Calculated cost Calculated cost
2kCalculated costCalculated cost Calculated cost Calculated cost
3kCalculated costCalculated cost Calculated cost Calculated cost
5kCalculated costCalculated cost Calculated cost Calculated cost
10kCalculated costCalculated cost Calculated cost Calculated cost
25kCalculated costCalculated cost Calculated cost Calculate cost
50kCalculated costCalculated cost Calculated cost Calculated cost