rebase

• Rebase
• Use the centralized database instead of a local postgresql
• Move the prometheus sql exporter on dali

• rebase
• reduce the memory as the database will not be running on this host but in the centralized admin database
• add the output section

rebase

rebase

fix related task

LGTM Thanks for fixing this.

LGTM \o/

LGTM

LGTM

LGTM thanks

LGTM

We will need a larger disk than 32Go as the sentry db is almost 100GB

We will wait for the availability of the dedicated admin database server (T3833) before moving grafana. It will avoid to move the data 2 times and will upgrade the database to the last postgresql version.

The first github milestone was reached today.
All the github loading are failing since 00:00 UTC.

The build of swh-search is now ok in master and swh-envrionment.
The swh-environment build is still failing but it's due to the swh-graph tests flakiness (it will be solved in T3831)

Unpin tree-sitter dependency

Remove useless remaining comment

unpin tree-sitter

I don't know, it was pinned so I kept it pinned but yes as the versions specified in the diffs are the last ones, I guess we can remove it

Why the duplication of profile::grafana into profile::grafana::backend?

The goal was to let the initial profile untouched during the migration and to clearly identify the public reverse_proxy is not installed by this part

Add more documentation on the backend profile

• Use the postgresql module to configure the database Indeed, it's simpler
• fix a wrong hostname declaration for vagrant
• fix grafana plugin installation and configuration calls

rebase

• Fix the database password resolution after the database name update
• Restore the profile::grafana::objects call to manage the orgs and database declarations It's not ideal as it introduces a dependency with the reverse proxy

thanks for the validation, I have some pending changes in progress and to reply to the olasd's remarks so I change the status to planned changes

• fix database name (not directly used by the configuration)
• fix the prometheus snippets configuration

The fix was released in the version v0.23.0 and deployed in staging and production.
Everything looks good.

upgrade accordingly the olasd's feedback

Upgrade bullseye template to 11.2

a dirty fix on the code to force the table sampling looks efficient

The initial index was a try to improve the query for the origins_without_last_update policy. Indeed, it's not used by for the other policies (never_visited_oldest_update_first / already_visited_order_by_lag) so it's not ok

the first diagnostic is it seems relative to the origin selection query taking a long time to respond (usually > 30mn)

good catches, thanks

rebase

The diffs are ready to be reviewed.
The migration will be performed at the beginning of January.

allow the database monitoring

install the auto-generated dashboards with puppet

add the grafana-piechart-panel plugin installation

rebase

Thank, the build is now green \o/

Thanks

Thanks for creating the diff and submitting the issue on the frozen dict repo.

It seems the rancher network issue is fixed in version 2.6.3 which is quite a good news

swhworker@poc-rancher:~$ ./test-network.sh 
=> Start network overlay test
poc-rancher-sw0 can reach poc-rancher-sw0
poc-rancher-sw0 can reach poc-rancher-sw1
poc-rancher-sw1 can reach poc-rancher-sw0
poc-rancher-sw1 can reach poc-rancher-sw1
=> End network overlay test

It seems the network issue is fixed in version 2.6.3 which is quite a good news