Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 14 2022

olasd committed rCDFJ3784c57af69b: Update jenkins agents 4.13 (authored by olasd).
Update jenkins agents 4.13
Sep 14 2022, 6:53 PM
olasd added a member for Staff: lunar.
Sep 14 2022, 5:27 PM
olasd committed rDGRPH7432bb9f5d87: swh graph grpc-serve doesn't take a host parameter (authored by olasd).
swh graph grpc-serve doesn't take a host parameter
Sep 14 2022, 4:24 PM
olasd committed rSPSITE892f68fe1e95: Prometheus's 1m is one minute, not one month (authored by olasd).
Prometheus's 1m is one minute, not one month
Sep 14 2022, 3:03 PM
olasd committed rSPSITE7447a5122848: Use the proper option to get perfdata out of prometheus metrics (authored by olasd).
Use the proper option to get perfdata out of prometheus metrics
Sep 14 2022, 2:14 PM
olasd committed rSPSITE07b107e99d77: Overhaul variables for prometheus metric icinga check (authored by olasd).
Overhaul variables for prometheus metric icinga check
Sep 14 2022, 2:09 PM
olasd committed rSPSITEcf64f9b3843b: Use proper name for the check_prometheus_metric_query var (authored by olasd).
Use proper name for the check_prometheus_metric_query var
Sep 14 2022, 1:54 PM
olasd committed rSPSITE781960c26298: Bump local prometheus retention down to 1 month (authored by olasd).
Bump local prometheus retention down to 1 month
Sep 14 2022, 1:44 PM
olasd closed D8471: Summary: Bump local prometheus retention down to 1 month.
Sep 14 2022, 1:44 PM
olasd committed rSPSITE78153d4a666f: Add all arguments of the check_prometheus_metric icinga check (authored by olasd).
Add all arguments of the check_prometheus_metric icinga check
Sep 14 2022, 1:44 PM
olasd committed rSPSITE009710953dfe: Add icinga2 warning for thanos sidecar shipper (authored by olasd).
Add icinga2 warning for thanos sidecar shipper
Sep 14 2022, 1:44 PM
olasd committed rSPSITE193e0af8e8c4: Rename check_prometheus_metric without shell suffix (authored by olasd).
Rename check_prometheus_metric without shell suffix
Sep 14 2022, 1:44 PM
olasd committed rSPSITE73e4d70f8817: Use the generic check_prometheus_metric icinga check for belvedere lag (authored by olasd).
Use the generic check_prometheus_metric icinga check for belvedere lag
Sep 14 2022, 1:44 PM
olasd closed D8470: Improve icinga2 prometheus metric checks.
Sep 14 2022, 1:44 PM
olasd committed rSPSITEb4810292860d: Don't hardcode FQDN of prometheus server (authored by olasd).
Don't hardcode FQDN of prometheus server
Sep 14 2022, 1:44 PM
olasd added inline comments to D8470: Improve icinga2 prometheus metric checks.
Sep 14 2022, 1:35 PM

Sep 13 2022

olasd requested review of D8471: Summary: Bump local prometheus retention down to 1 month.
Sep 13 2022, 7:27 PM
olasd requested review of D8470: Improve icinga2 prometheus metric checks.
Sep 13 2022, 7:26 PM
olasd accepted D8464: Add a 'swh graph grpc-serve' command.
Sep 13 2022, 4:29 PM
olasd requested review of D8466: Add date-based index to origin_visit.
Sep 13 2022, 4:26 PM
olasd requested changes to D8464: Add a 'swh graph grpc-serve' command.
Sep 13 2022, 3:44 PM
olasd accepted D8448: Reorganize configuration of the http server building.

I think this makes sense.

Sep 13 2022, 2:02 PM
olasd created P1451 (An Untitled Masterwork).
Sep 13 2022, 1:29 PM
olasd accepted D8420: auth: Improve login management and configuration.

Very nice!

Sep 13 2022, 12:00 PM
olasd added a reverting change for rSPSITE77b70356949d: Switch moma over to the main db for the somerset/beaubourg migration: rSPSITE558efbe435fb: Revert "Switch moma over to the main db for the somerset/beaubourg migration".
Sep 13 2022, 11:00 AM
olasd committed rSPSITE558efbe435fb: Revert "Switch moma over to the main db for the somerset/beaubourg migration" (authored by olasd).
Revert "Switch moma over to the main db for the somerset/beaubourg migration"
Sep 13 2022, 11:00 AM
olasd committed rSPSITE58b7480744bc: Drop legacy thanos gateway definitions (authored by olasd).
Drop legacy thanos gateway definitions
Sep 13 2022, 11:00 AM

Sep 12 2022

olasd updated subscribers of T4459: Deploy swh-indexer > v2.6 on staging then production.

There's a few issues with the configuration of these indexer clients:

Sep 12 2022, 8:10 PM · Indexer, System administration
olasd added a member for Speakers: vlorentz.
Sep 12 2022, 4:36 PM
olasd added a comment to D8420: auth: Improve login management and configuration.

Is there anything preventing swh-auth from using next= instead of next_path=?

Sep 12 2022, 4:20 PM
olasd added a comment to D8420: auth: Improve login management and configuration.
In D8420#219363, @olasd wrote:

While you're refactoring this, is there a reason for not using the default REDIRECT_FIELD_NAME from django.contrib.auth ("next") for the login/logout views, instead of "next_path"? This would save us from having to override it on every user_passes_test call.

Oh I missed that django setting, let me check.

That's much better indeed, thanks ! Diff updated.

Sep 12 2022, 3:44 PM
olasd added a comment to D8420: auth: Improve login management and configuration.

While you're refactoring this, is there a reason for not using the default REDIRECT_FIELD_NAME from django.contrib.auth ("next") for the login/logout views, instead of "next_path"? This would save us from having to override it on every user_passes_test call.

Sep 12 2022, 2:46 PM
olasd accepted D8444: tests/conftest: Remove sentry fixtures.

Thanks! I guess this needs a version bump on swh.core in requirements-swh.txt

Sep 12 2022, 2:40 PM
olasd committed rSPSITEe1c7c8dbda5e: Ensure upgrades of thanos restart all relevant services (authored by olasd).
Ensure upgrades of thanos restart all relevant services
Sep 12 2022, 12:51 PM
olasd closed D8442: Upgrade thanos to 0.28.0.
Sep 12 2022, 12:51 PM
olasd closed D8443: Bump max postgres connections on db1.staging: 200 is too low.
Sep 12 2022, 12:51 PM
olasd committed rSPSITEeec2835f4c16: Bump max postgres connections on db1.staging: 200 is too low (authored by olasd).
Bump max postgres connections on db1.staging: 200 is too low
Sep 12 2022, 12:51 PM
olasd committed rSPSITEa2233d54120e: Upgrade thanos to 0.28.0 (authored by olasd).
Upgrade thanos to 0.28.0
Sep 12 2022, 12:51 PM
olasd closed D8440: Split thanos objstore configuration management to separate class.
Sep 12 2022, 12:51 PM
olasd closed D8441: Add configuration for thanos compact.
Sep 12 2022, 12:51 PM
olasd committed rSPSITE76213b1ab932: Split thanos objstore configuration management to separate class (authored by olasd).
Split thanos objstore configuration management to separate class
Sep 12 2022, 12:51 PM
olasd committed rSPSITEca4bc487479d: Add configuration for thanos compact (authored by olasd).
Add configuration for thanos compact
Sep 12 2022, 12:51 PM
olasd closed D8439: Rename thanos-gateway service to thanos-store to match upstream.
Sep 12 2022, 12:51 PM
olasd committed rSPSITE6246518e45fd: Rename thanos-gateway service to thanos-store to match upstream (authored by olasd).
Rename thanos-gateway service to thanos-store to match upstream
Sep 12 2022, 12:51 PM

Sep 9 2022

olasd added a comment to D8443: Bump max postgres connections on db1.staging: 200 is too low.
18:43:28         ⤷ ╡ icinga PROBLEM: service check_systemd on scrubber0.internal.staging.swh.network is CRITICAL: SYSTEMD CRITICAL - swh-scrubber-checker-postgres@primary-snapshot-0.service: failed, swh-scrubber-checker-postgres@primary-snapshot-1.service: failed
Sep 9 2022, 6:54 PM
olasd requested review of D8443: Bump max postgres connections on db1.staging: 200 is too low.
Sep 9 2022, 6:53 PM
olasd triaged T4527: scrubber: keep a state file for postgresql datastores as High priority.
Sep 9 2022, 6:49 PM · Datastore Scrubber
olasd requested review of D8442: Upgrade thanos to 0.28.0.
Sep 9 2022, 6:35 PM
olasd requested review of D8441: Add configuration for thanos compact.
Sep 9 2022, 6:31 PM
olasd requested review of D8440: Split thanos objstore configuration management to separate class.
Sep 9 2022, 6:31 PM
olasd requested review of D8439: Rename thanos-gateway service to thanos-store to match upstream.
Sep 9 2022, 6:30 PM
olasd accepted D8434: pytest_plugin: Add sentry_events fixture from swh-indexer.

Indeed this seems useful; I've made a couple of naming nitpicks, but I don't care very strongly about them.

Sep 9 2022, 6:28 PM
olasd closed D8433: Add scratch disk to thanos host (for compaction).
Sep 9 2022, 6:20 PM
olasd committed rSPREd97fe4b50a47: Add scratch disk to thanos host (for compaction) (authored by olasd).
Add scratch disk to thanos host (for compaction)
Sep 9 2022, 6:20 PM
olasd updated the diff for D8433: Add scratch disk to thanos host (for compaction).

Rebase

Sep 9 2022, 6:19 PM
olasd added a project to T4526: New model for the origin layer: Provenance database.
Sep 9 2022, 6:07 PM · Provenance database
olasd updated the task description for T4526: New model for the origin layer.
Sep 9 2022, 5:50 PM · Provenance database

Sep 8 2022

olasd requested review of D8433: Add scratch disk to thanos host (for compaction).
Sep 8 2022, 7:06 PM
olasd added a comment to T4512: Strip first level directory when loading tarballs from PyPI?.

I agree that the UX of switching branches from a release to another on snapshots of PyPI origins is not good.

Sep 8 2022, 12:17 PM · PyPI loader

Sep 6 2022

olasd accepted D8404: Return HTTP 503 on AioRpcError.

Thanks for looking into this!

Sep 6 2022, 5:41 PM
olasd accepted D8403: Kill GraphServerProcess on test teardown.

Thanks.

Sep 6 2022, 5:38 PM
olasd accepted D8402: conftest: Refactor GraphServerProcess to be more flexible.

Neat

Sep 6 2022, 5:36 PM
olasd added a project to T4494: ingest hackage.haskell.org, the Haskell package repository : Archive coverage.
Sep 6 2022, 4:24 PM · Hackage loader, Hackage lister, Archive coverage

Sep 5 2022

olasd accepted D8328: templates/cypress: Run tests in parallel using sorry-cypress.

Cool stuff, thanks!

Sep 5 2022, 2:39 PM
olasd accepted D8368: jobs/swh-pipeline: Enable to limit number of concurrent builds per job.

Thanks!

Sep 5 2022, 2:38 PM

Aug 18 2022

olasd closed T4435: scrubber log verbosity puts a risk on ELK as Resolved.
Aug 18 2022, 5:21 PM · Datastore Scrubber, System administrators
olasd added a comment to T4435: scrubber log verbosity puts a risk on ELK .

I've deployed the quiesced scrubbers (v0.1.0) on both staging and production.

Aug 18 2022, 5:21 PM · Datastore Scrubber, System administrators
olasd committed rSPSITE1e1ec643ef39: Add constant statsd tags to swh-scrubber-checker services (authored by olasd).
Add constant statsd tags to swh-scrubber-checker services
Aug 18 2022, 5:09 PM
olasd requested review of D8019: Add an aiohttp logger class filtering successful requests from a set of fixed ips.
Aug 18 2022, 4:58 PM
olasd accepted D8257: Add missing DB version 3.

Thanks for checking the swh.core code, and sorry for the handwringing!

Aug 18 2022, 4:45 PM
olasd requested changes to D8250: origin_visit_add: Fix crash when adding multiple visits to the same origin simultaneously.

This is missing the database upgrade script

Aug 18 2022, 4:44 PM
olasd accepted D8254: Add metrics on references to missing objects.
Aug 18 2022, 4:39 PM
olasd accepted D8253: Split batch_duration_seconds metric in two.
Aug 18 2022, 4:38 PM
olasd added a comment to D8253: Split batch_duration_seconds metric in two.

Maybe use the same metric with an operation="check_hashes"/"check_references" tag?

Aug 18 2022, 4:37 PM
olasd accepted D8252: Deduplicate statsd calls.

Meh. Seems like some default from prometheus-statsd-exporter unexpectedly does the right thing then.

Aug 18 2022, 4:36 PM
olasd requested changes to D8252: Deduplicate statsd calls.

We don't use statsd namespaces, which use dots in metric names and aren't really compatible with the way we set up the prometheus statsd exporter.

Aug 18 2022, 4:28 PM
olasd closed D8251: Replace verbose logging with statsd probes.
Aug 18 2022, 2:34 PM
olasd committed rDSCRUBc6f711ecbfb5: Replace verbose logging with statsd probes (authored by olasd).
Replace verbose logging with statsd probes
Aug 18 2022, 2:34 PM
olasd requested review of D8251: Replace verbose logging with statsd probes.
Aug 18 2022, 1:33 PM
olasd added a revision to T4435: scrubber log verbosity puts a risk on ELK : D8251: Replace verbose logging with statsd probes.
Aug 18 2022, 1:31 PM · Datastore Scrubber, System administrators
olasd committed rSPSITE8ed3f66a3aef: Ensure systemd is reloaded before the netbox services are restarted (authored by olasd).
Ensure systemd is reloaded before the netbox services are restarted
Aug 18 2022, 12:47 PM
olasd committed rSPSITEa90fdf077f65: Update netbox config for 3.3.0 (authored by olasd).
Update netbox config for 3.3.0
Aug 18 2022, 12:38 PM
olasd committed rSPSITE354dad7119a6: Upgrade to hedgedoc 1.9.4 (authored by olasd).
Upgrade to hedgedoc 1.9.4
Aug 18 2022, 12:17 PM

Aug 17 2022

olasd accepted D8236: cassandra: Refactor the former installation scripts.

I think you've forgotten to remove the erb template :-)

Aug 17 2022, 12:48 PM

Aug 16 2022

olasd added a reverting change for rSPSITE455cd46864bf: Wrap sentry install cli in script to work around tty allocation issues (maybe): rSPSITE0aeb8f52806e: Revert "Wrap sentry install cli in script to work around tty allocation issues….
Aug 16 2022, 3:40 PM
olasd committed rSPSITE0aeb8f52806e: Revert "Wrap sentry install cli in script to work around tty allocation issues… (authored by olasd).
Revert "Wrap sentry install cli in script to work around tty allocation issues…
Aug 16 2022, 3:40 PM
olasd committed R206:a56f313c6704: Merge tag '22.8.0' into softwareheritage (authored by olasd).
Merge tag '22.8.0' into softwareheritage
Aug 16 2022, 3:20 PM
olasd committed R206:0dbc2d6e27dc: Merge tag '22.7.0' into softwareheritage (authored by olasd).
Merge tag '22.7.0' into softwareheritage
Aug 16 2022, 3:20 PM
olasd committed R206:3ccf51afda03: Merge tag '22.6.0' into softwareheritage (authored by olasd).
Merge tag '22.6.0' into softwareheritage
Aug 16 2022, 3:20 PM
olasd committed rSPSITE455cd46864bf: Wrap sentry install cli in script to work around tty allocation issues (maybe) (authored by olasd).
Wrap sentry install cli in script to work around tty allocation issues (maybe)
Aug 16 2022, 3:08 PM
olasd committed R206:fc1a78f9a983: Merge tag '22.5.0' into softwareheritage (authored by olasd).
Merge tag '22.5.0' into softwareheritage
Aug 16 2022, 3:06 PM
olasd committed rSPSITE4c80165ebfa2: Update sentry config templates from 22.5.0 (authored by olasd).
Update sentry config templates from 22.5.0
Aug 16 2022, 3:05 PM
olasd committed R206:01ff8eaffd90: Merge tag '22.4.0' into softwareheritage (authored by olasd).
Merge tag '22.4.0' into softwareheritage
Aug 16 2022, 2:49 PM
olasd committed R206:24597987b35c: Merge tag '22.3.0' into softwareheritage (authored by olasd).
Merge tag '22.3.0' into softwareheritage
Aug 16 2022, 2:49 PM
olasd committed R206:014ec904d296: Merge tag '22.2.0' into softwareheritage (authored by olasd).
Merge tag '22.2.0' into softwareheritage
Aug 16 2022, 2:35 PM
olasd committed R206:838a84981f4c: Merge tag '22.1.0' into softwareheritage (authored by olasd).
Merge tag '22.1.0' into softwareheritage
Aug 16 2022, 2:30 PM
olasd committed rSPSITEdaee87b33bcb: Use docker-compose-plugin package to install docker-compose v2 (authored by olasd).
Use docker-compose-plugin package to install docker-compose v2
Aug 16 2022, 2:22 PM
olasd added a comment to D8240: gitlab: Improve incremental listing.

Thanks, this would be a welcome change.

Aug 16 2022, 1:07 PM
olasd accepted D8224: retry: Add constant 10s wait when retrying transient exceptions.

That seems like a plausible change, thanks!

Aug 16 2022, 12:46 PM
olasd committed rDPROV8f476d494b4a: swhgraph: handle empty responses (authored by olasd).
swhgraph: handle empty responses
Aug 16 2022, 12:35 PM