Change Details

Reduce azure cost: change workers to 'b2ms' vms (current 'ds2v2' underused and costly) Plan: - [x] Reasoning: https://hedgedoc.softwareheritage.org/0_eK1R3iSFmMWxwHDQfqOw?edit - [x] Provision vault-worker[01-02] as b2ms (terraform) - [x] Decomission worker13 - [x] Check vault worker are doing their job [1] - [x] Decomission worker[11-12] - [x] Adapt puppet manifest to the fqdn changes ^ and deploy - [x] Provision indexer-worker[01-02] as b2ms (terraform) - [x] Check everything is fine ^ (firewall rule to edit to allow connection) - [x] Decomission ds2v2 worker[07-10] - [ ] Provision indexer-worker[03-06] as b2ms (terraform) - [] Decomission remaining ds2v2 worker[01-06] Note: - This talks about `worker*.euwest.azure` nodes - Decomission is deleting the node, then remove references to it within puppet master, then update inventory [1] ``` Jul 18 14:45:59 vault-worker01 python3[2648]: [2022-07-18 14:45:59,239: INFO/MainProcess] vault_cooker@vault-worker01.euwest.azure.internal.softwareheritage.org ready. Jul 18 14:58:49 vault-worker01 python3[2648]: [2022-07-18 14:58:49,852: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] Jul 18 14:58:54 vault-worker01 python3[2670]: [2022-07-18 14:58:54,821: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] succeeded in 4.852631129999963s: None Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,023: INFO/MainProcess] Connected to amqp://swhconsumer:**@rabbitmq:5672// Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,293: INFO/MainProcess] vault_cooker@vault-worker02.euwest.azure.internal.softwareheritage.org ready. Jul 18 15:02:59 vault-worker02 python3[617]: [2022-07-18 15:02:59,734: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] Jul 18 15:03:19 vault-worker02 python3[997]: [2022-07-18 15:03:19,915: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] succeeded in 20.0749026s: None ```

Reduce azure cost: change workers to 'b2ms' vms (current 'ds2v2' underused and costly) Plan: - [x] Reasoning: https://hedgedoc.softwareheritage.org/0_eK1R3iSFmMWxwHDQfqOw?edit - [x] Provision vault-worker[01-02] as b2ms (terraform) - [x] Decomission worker13 - [x] Check vault worker are doing their job [1] - [x] Decomission worker[11-12] - [x] Adapt puppet manifest to the fqdn changes ^ and deploy - [x] Provision indexer-worker[01-02] as b2ms (terraform) - [x] Check everything is fine ^ (firewall rule to edit to allow connection) - [x] Decomission ds2v2 worker[07-10] - [x] Provision indexer-worker[03-06] as b2ms (terraform) - [x] Decomission remaining ds2v2 worker[03-06] - [x] Update firewall rule + alias - [x] Update inventory with vms and network interfaces according to ^ - [ ] Kept worker[01-02] for now (so they finish their current job consuming old queue messages) Note: - This talks about `worker*.euwest.azure` nodes - Decomission is deleting the node, then remove references to it within puppet master, then update inventory [1] ``` Jul 18 14:45:59 vault-worker01 python3[2648]: [2022-07-18 14:45:59,239: INFO/MainProcess] vault_cooker@vault-worker01.euwest.azure.internal.softwareheritage.org ready. Jul 18 14:58:49 vault-worker01 python3[2648]: [2022-07-18 14:58:49,852: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] Jul 18 14:58:54 vault-worker01 python3[2670]: [2022-07-18 14:58:54,821: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] succeeded in 4.852631129999963s: None Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,023: INFO/MainProcess] Connected to amqp://swhconsumer:**@rabbitmq:5672// Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,293: INFO/MainProcess] vault_cooker@vault-worker02.euwest.azure.internal.softwareheritage.org ready. Jul 18 15:02:59 vault-worker02 python3[617]: [2022-07-18 15:02:59,734: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] Jul 18 15:03:19 vault-worker02 python3[997]: [2022-07-18 15:03:19,915: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] succeeded in 20.0749026s: None ```

Reduce azure cost: change workers to 'b2ms' vms (current 'ds2v2' underused and costly) Plan: - [x] Reasoning: https://hedgedoc.softwareheritage.org/0_eK1R3iSFmMWxwHDQfqOw?edit - [x] Provision vault-worker[01-02] as b2ms (terraform) - [x] Decomission worker13 - [x] Check vault worker are doing their job [1] - [x] Decomission worker[11-12] - [x] Adapt puppet manifest to the fqdn changes ^ and deploy - [x] Provision indexer-worker[01-02] as b2ms (terraform) - [x] Check everything is fine ^ (firewall rule to edit to allow connection) - [x] Decomission ds2v2 worker[07-10] - [ - [x] Provision indexer-worker[03-06] as b2ms (terraform) - [] Decomission remaining ds2v2 worker[01-06]x] Decomission remaining ds2v2 worker[03-06] - [x] Update firewall rule + alias - [x] Update inventory with vms and network interfaces according to ^ - [ ] Kept worker[01-02] for now (so they finish their current job consuming old queue messages) Note: - This talks about `worker*.euwest.azure` nodes - Decomission is deleting the node, then remove references to it within puppet master, then update inventory [1] ``` Jul 18 14:45:59 vault-worker01 python3[2648]: [2022-07-18 14:45:59,239: INFO/MainProcess] vault_cooker@vault-worker01.euwest.azure.internal.softwareheritage.org ready. Jul 18 14:58:49 vault-worker01 python3[2648]: [2022-07-18 14:58:49,852: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] Jul 18 14:58:54 vault-worker01 python3[2670]: [2022-07-18 14:58:54,821: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[a3c95ae7-4256-4231-bca7-d3224a9149ce] succeeded in 4.852631129999963s: None Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,023: INFO/MainProcess] Connected to amqp://swhconsumer:**@rabbitmq:5672// Jul 18 15:01:58 vault-worker02 python3[617]: [2022-07-18 15:01:58,293: INFO/MainProcess] vault_cooker@vault-worker02.euwest.azure.internal.softwareheritage.org ready. Jul 18 15:02:59 vault-worker02 python3[617]: [2022-07-18 15:02:59,734: INFO/MainProcess] Received task: swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] Jul 18 15:03:19 vault-worker02 python3[997]: [2022-07-18 15:03:19,915: INFO/ForkPoolWorker-16] Task swh.vault.cooking_tasks.SWHCookingTask[e3649dcc-9d53-4d88-8245-2543e97d584a] succeeded in 20.0749026s: None ```