Page MenuHomeSoftware Heritage

Activate data scraping on hypervisors
ClosedPublic

Authored by ardumont on Aug 11 2021, 12:22 PM.

Details

Summary

This also updates the subnets/vagrant to add the hypervisors' ip mappings to allow
further checks using vagrant.

Related to T3462

Test Plan

octodiff checks. Expectedly, this collects scraping data for the ceph nodes branly,
beaubourg and hypervisor3. This does nothing for the remaining hypervisors which are not
ceph nodes.

$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging branly
...
*** Running octocatalog-diff on host branly.internal.softwareheritage.org
I, [2021-08-11T12:10:40.673076 #20885]  INFO -- : Catalogs compiled for branly.internal.softwareheritage.org
I, [2021-08-11T12:10:42.373621 #20885]  INFO -- : Diffs computed for branly.internal.softwareheritage.org
diff origin/production/branly.internal.softwareheritage.org current/branly.internal.softwareheritage.org
*******************************************
+ Node[__node_regexp__beaubourghypervisordbranly.internal.softwareheritage.org]
*******************************************
- Node[__node_regexp__orsaybeaubourghypervisordbranlypompidouuffizi.internal.softwareheritage.org]
*******************************************
+ Profile::Prometheus::Export_scrape_config[ceph-mgr_branly.internal.softwareheritage.org] =>
   parameters =>
      "job": "ceph-mgr"
      "labels": {}
      "metrics_path": "/metrics"
      "scheme": "http"
      "target": "branly.internal.softwareheritage.org:9283"
*******************************************
*** End octocatalog-diff on branly.internal.softwareheritage.org
$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging uffizi
Found host uffizi.internal.softwareheritage.org
...
*** Running octocatalog-diff on host uffizi.internal.softwareheritage.org
I, [2021-08-11T12:11:29.568581 #25872]  INFO -- : Catalogs compiled for uffizi.internal.softwareheritage.org
I, [2021-08-11T12:11:31.149952 #25872]  INFO -- : Diffs computed for uffizi.internal.softwareheritage.org
diff origin/production/uffizi.internal.softwareheritage.org current/uffizi.internal.softwareheritage.org
*******************************************
- Node[__node_regexp__orsaybeaubourghypervisordbranlypompidouuffizi.internal.softwareheritage.org]
*******************************************
+ Node[__node_regexp__pompidouuffizi.internal.softwareheritage.org]
*******************************************
*** End octocatalog-diff on uffizi.internal.softwareheritage.org
$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging pompidou
...
*** Running octocatalog-diff on host pompidou.internal.softwareheritage.org
I, [2021-08-11T12:12:45.344960 #30860]  INFO -- : Catalogs compiled for pompidou.internal.softwareheritage.org
I, [2021-08-11T12:12:46.816756 #30860]  INFO -- : Diffs computed for pompidou.internal.softwareheritage.org
diff origin/production/pompidou.internal.softwareheritage.org current/pompidou.internal.softwareheritage.org
*******************************************
- Node[__node_regexp__orsaybeaubourghypervisordbranlypompidouuffizi.internal.softwareheritage.org]
*******************************************
+ Node[__node_regexp__pompidouuffizi.internal.softwareheritage.org]
*******************************************
*** End octocatalog-diff on pompidou.internal.softwareheritage.org
$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging beaubourg
...
*** Running octocatalog-diff on host beaubourg.softwareheritage.org
I, [2021-08-11T12:13:09.242004 #3443]  INFO -- : Catalogs compiled for beaubourg.softwareheritage.org
I, [2021-08-11T12:13:10.863249 #3443]  INFO -- : Diffs computed for beaubourg.softwareheritage.org
diff origin/production/beaubourg.softwareheritage.org current/beaubourg.softwareheritage.org
*******************************************
+ Node[__node_regexp__beaubourghypervisordbranly.internal.softwareheritage.org]
*******************************************
- Node[__node_regexp__orsaybeaubourghypervisordbranlypompidouuffizi.internal.softwareheritage.org]
*******************************************
+ Profile::Prometheus::Export_scrape_config[ceph-mgr_beaubourg.softwareheritage.org] =>
   parameters =>
      "job": "ceph-mgr"
      "labels": {}
      "metrics_path": "/metrics"
      "scheme": "http"
      "target": "beaubourg.softwareheritage.org:9283"
*******************************************
*** End octocatalog-diff on beaubourg.softwareheritage.org
$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging hypervisor3
...
*** Running octocatalog-diff on host hypervisor3.internal.softwareheritage.org
I, [2021-08-11T12:14:11.990204 #8610]  INFO -- : Catalogs compiled for hypervisor3.internal.softwareheritage.org
I, [2021-08-11T12:14:13.562186 #8610]  INFO -- : Diffs computed for hypervisor3.internal.softwareheritage.org
diff origin/production/hypervisor3.internal.softwareheritage.org current/hypervisor3.internal.softwareheritage.org
*******************************************
+ Node[__node_regexp__beaubourghypervisordbranly.internal.softwareheritage.org]
*******************************************
- Node[__node_regexp__orsaybeaubourghypervisordbranlypompidouuffizi.internal.softwareheritage.org]
*******************************************
+ Profile::Prometheus::Export_scrape_config[ceph-mgr_hypervisor3.internal.softwareheritage.org] =>
   parameters =>
      "job": "ceph-mgr"
      "labels": {}
      "metrics_path": "/metrics"
      "scheme": "http"
      "target": "hypervisor3.internal.softwareheritage.org:9283"
*******************************************
*** End octocatalog-diff on hypervisor3.internal.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.