Direct transfer data: Discrepancy Sisense chart vs database
We noticed a significant discrepancy in the no. of Migrations failed
in our Sisense chart compared to the data in the DB as shown below:
Sisense vs DB
Finished Migrations:
Month | Sisense | DB |
---|---|---|
February | 2182 | 581 |
March | 2308 | 1379 |
Failed Migrations:
Month | Sisense | DB |
---|---|---|
February | 482 | 240 |
March | 246 | 100 |
Sisense SQL
Tthe query for the Sisense chart
SELECT
-- DATE_TRUNC(MONTH,ping_created_at) AS ping_created_at,
ping_created_date_month,
MAX(IFF(metrics_path = 'usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_failed', metric_value, NULL)) AS migration_failed,
MAX(IFF(metrics_path = 'usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_finished', metric_value, NULL)) AS migration_finished,
MAX(IFF(metrics_path = 'usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_timeout', metric_value, NULL)) AS migration_timeout
FROM common_mart.mart_ping_instance_metric_monthly --this model will limit to the last ping of the month
WHERE metrics_path IN ('usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_failed',
'usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_finished',
'usage_activity_by_stage_monthly.manage.group_imports.gitlab_migration_timeout')
AND ping_delivery_type = 'SaaS' --this model is filtered to only include the SaaS production installation
GROUP BY 1
ORDER BY 1 DESC
Data from Database
February 2023
Number of errors | Error message |
---|---|
96 | Unsuccessful response 404 from [FILTER]. Body: {"message"=>"404 Not Found"} |
46 | Net::ReadTimeout |
36 | Visibility level internal has been restricted by your GitLab administrator |
17 | unexpected character (after ) at line 1, column 1 [parse.c:733] in ' |
10 | undefined method `version' for nil:NilClass |
7 | Group URL has already been taken |
7 | Unsuccessful response 502 from [FILTER] |
6 | Name can contain only letters, digits, emojis, '', '.', dash, space, parenthesis. It must start with letter, digit, emoji or ''. |
5 | Unsuccessful response 403 from [FILTER]. Body: {"message"=>"403 Forbidden"} |
4 | Unsuccessful response 404 from [FILTER]. Body: {"message"=>"404 Group Not Found"} |
3 | Require two factor authentication is forbidden by a top-level group |
2 | User not allowed to create group |
2 | Unsuccessful response 500 from [FILTER] |
1 | Unsuccessful response 401 from [FILTER]. Body: {"error"=>"invalid_token", "error_description"=>"Token was revoked. You have to re-authorize from [FILTER]."} |
1 | Unsuccessful response 503 from [FILTER] |
March 2023
Number of errors | Error message |
---|---|
57 | Unsuccessful response 404 from [FILTER]. Body: {"message"=>"404 Not Found"} |
17 | Visibility level internal has been restricted by your GitLab administrator |
8 | Net::ReadTimeout |
6 | User not allowed to create group |
4 | Require two factor authentication is forbidden by a top-level group |
3 | Unsuccessful response 404 from [FILTER]. Body: {"error"=>"404 Not Found"} |
2 | Group URL has already been taken |
1 | Unsuccessful response 401 from [FILTER]. Body: {"error"=>"invalid_token", "error_description"=>"Token was revoked. You have to re-authorize from [FILTER]."} |
1 | Unsuccessful response 403 from [FILTER]. Body: {"message"=>"You cannot perform write operations on a read-only instance"} |
1 | Unsuccessful response 403 from [FILTER]. Body: {"message"=>"403 Forbidden"} |
Edited by Martin Wortschack