Page MenuHomeSoftware Heritage

olasd (Nicolas Dandrimont)
UserAdministrator

Projects (7)

User Details

User Since
Sep 7 2015, 3:25 PM (221 w, 4 d)
Roles
Administrator

Recent Activity

Yesterday

olasd changed the status of T1358: Setup a sentry service from Open to Work in Progress.

I think I've mostly coerced sentry, at url https://sentry.softwareheritage.org/, into working. I used the opportunity to start refactoring the way apache is handled in our puppet environment, as well as slowly migrating some vhosts to Let's Encrypt.

Fri, Dec 6, 11:06 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd requested changes to D2404: storage: Add endpoint to randomly pick an origin.

Rather than depend on the counter table, which is only updated every so often and which doesn't account for potential holes in origin ids, we should use something more reliable to get a random row like the SQL 2003 tablesample clause implemented in PostgreSQL.

Fri, Dec 6, 9:15 PM
olasd committed R206:1be52b2d78f7: Make install.sh idempotent (authored by olasd).
Make install.sh idempotent
Fri, Dec 6, 6:33 PM
olasd committed R206:64c41c94178d: Drop DEFAULT_BROKERS from docker-compose.yml (to override it in .env) (authored by olasd).
Drop DEFAULT_BROKERS from docker-compose.yml (to override it in .env)
Fri, Dec 6, 6:33 PM
olasd committed rSPSITEff7732948715: Add an icinga_check_string argument to reverse proxy definitions (authored by olasd).
Add an icinga_check_string argument to reverse proxy definitions
Fri, Dec 6, 5:22 PM
olasd committed rSPSITEa7be73780e6c: Allow user registration on the sentry instance (authored by olasd).
Allow user registration on the sentry instance
Fri, Dec 6, 2:53 PM
olasd committed rSPSITE82b44c553b8b: sentry: Fully configure mail in config.yml (authored by olasd).
sentry: Fully configure mail in config.yml
Fri, Dec 6, 2:53 PM
olasd committed rSPSITE65a5b0efa915: Enable sentry beacon and report full data (authored by olasd).
Enable sentry beacon and report full data
Fri, Dec 6, 2:53 PM
olasd committed rSPSITEbe33f445d4a3: Disable sentry beacon (authored by olasd).
Disable sentry beacon
Fri, Dec 6, 2:46 PM
olasd committed rSPSITEc319f6c248ed: Set sentry admin email address (authored by olasd).
Set sentry admin email address
Fri, Dec 6, 2:46 PM
olasd committed rSPSITEb9d864ba1589: Set sentry mail.host and mail.from (authored by olasd).
Set sentry mail.host and mail.from
Fri, Dec 6, 2:42 PM
olasd committed rSPSITE002f4dd059a1: Update sentry config.yml for latest onpremise repo (authored by olasd).
Update sentry config.yml for latest onpremise repo
Fri, Dec 6, 2:42 PM
olasd committed rSPSITE8e710e58b16e: Refactor smtp::relayhost with smtp::relay_hostname (authored by olasd).
Refactor smtp::relayhost with smtp::relay_hostname
Fri, Dec 6, 2:42 PM
olasd committed rSPSITEca81239dad67: Add ProxyPreserveHost for sentry virtual host (authored by olasd).
Add ProxyPreserveHost for sentry virtual host
Fri, Dec 6, 2:42 PM
olasd committed R206:41b679bd915e: Merge remote-tracking branch 'upstream/master' into softwareheritage (authored by olasd).
Merge remote-tracking branch 'upstream/master' into softwareheritage
Fri, Dec 6, 2:30 PM
olasd committed R206:49068dc67a76: Don't run another smtp server (authored by olasd).
Don't run another smtp server
Fri, Dec 6, 2:26 PM
olasd committed rSPSITEb96300ca5516: Set sentry URL prefix to match the vhost's name (authored by olasd).
Set sentry URL prefix to match the vhost's name
Fri, Dec 6, 2:11 PM
olasd committed rSPSITE5091c6819d05: Sentry is behind TLS now (authored by olasd).
Sentry is behind TLS now
Fri, Dec 6, 2:01 PM
olasd committed rSENV4d07fc861950: Drop munin module (authored by olasd).
Drop munin module
Fri, Dec 6, 1:54 PM
olasd committed rSPSITEa0cdf8958d6e: Uninstall munin everywhere (authored by olasd).
Uninstall munin everywhere
Fri, Dec 6, 1:53 PM
olasd committed rSPSITE3ca20cee5547: Export let's encrypt certificates through the Puppet file server (authored by olasd).
Export let's encrypt certificates through the Puppet file server
Fri, Dec 6, 1:41 PM
olasd committed rSPSITEf0b3e29e69b8: Try to improve ordering of Let's Encrypt certificate operations (authored by olasd).
Try to improve ordering of Let's Encrypt certificate operations
Fri, Dec 6, 1:41 PM
olasd committed rSENVb93240273ef5: octocatalog-diff: Add an IN_OCTOCATALOG_DIFF envvar passed to puppet (authored by olasd).
octocatalog-diff: Add an IN_OCTOCATALOG_DIFF envvar passed to puppet
Fri, Dec 6, 1:19 PM
olasd committed rSPSITEb842466b66d5: Add a reverse-proxy configuration for Sentry on pergamon (authored by olasd).
Add a reverse-proxy configuration for Sentry on pergamon
Fri, Dec 6, 11:39 AM
olasd committed rSPSITE2b2ee7b8185f: Refactor reverse proxy configuration as defined type (authored by olasd).
Refactor reverse proxy configuration as defined type
Fri, Dec 6, 11:39 AM

Wed, Dec 4

olasd committed rSPSITE4a0745a81c74: Disable inactive accounts (authored by olasd).
Disable inactive accounts
Wed, Dec 4, 5:05 PM
olasd committed rSPSITEf909ecc21b09: Use the .env file to set DEFAULT_BROKERS (authored by olasd).
Use the .env file to set DEFAULT_BROKERS
Wed, Dec 4, 4:56 PM
olasd committed rSPSITEf64bead4cfdc: Put sentry install logs in /var/log (authored by olasd).
Put sentry install logs in /var/log
Wed, Dec 4, 4:56 PM
olasd accepted D2393: celery: make SWHTask send start/end of execution statsd gauges with timestamps.
Wed, Dec 4, 1:31 PM

Tue, Dec 3

olasd committed rSPPRIVCfc478c864f61: Update censored data (authored by olasd).
Update censored data
Tue, Dec 3, 7:59 PM
olasd committed rSPPRIVC4d3c3b34ffa5: Update data (authored by olasd).
Update data
Tue, Dec 3, 7:18 PM
olasd committed R206:59296456423b: Don't generate secret key (authored by olasd).
Don't generate secret key
Tue, Dec 3, 7:03 PM
olasd committed R206:884d105e6a87: Don't use postgresql container (authored by olasd).
Don't use postgresql container
Tue, Dec 3, 7:03 PM
olasd committed R206:023d350d9dfb: Don't use zookeeper or kafka containers (authored by olasd).
Don't use zookeeper or kafka containers
Tue, Dec 3, 7:03 PM
olasd committed R206:f2d65f4cc2ec: Drop kafka dependencies (authored by olasd).
Drop kafka dependencies
Tue, Dec 3, 6:43 PM
olasd added a comment to D2392: Hide (so-called) errors "Local: No offset stored"..

To future-proof this, I suggest switching the logic to have a map between error codes and log levels in the error_cb function; I'm sure we'll want to tune other messages, and I'd prefer mapping this to a debug level log message rather than silencing it completely.

Tue, Dec 3, 6:37 PM
olasd committed rSENV38e4d1dbadc3: Add riverside octocatalog-diff facts (authored by olasd).
Add riverside octocatalog-diff facts
Tue, Dec 3, 6:29 PM
olasd closed T1360: Install a sentry server, a subtask of T1358: Setup a sentry service, as Resolved.
Tue, Dec 3, 6:09 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd closed T1360: Install a sentry server as Resolved.

The new virtual machine for sentry, riverside.internal.softwareheritage.org, has now been installed.

Tue, Dec 3, 6:09 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd added a comment to T2030: Certficate for https://stats.export.softwareheritage.org/ has expired.

FWIW the expected automatic renewal happened and the updated cert has been deployed on the subsequent puppet run.

Tue, Dec 3, 6:08 PM · System administration
olasd committed rSPSITE074c6e84aa93: Update vcsrepo to 3.0.0 (authored by olasd).
Update vcsrepo to 3.0.0
Tue, Dec 3, 3:32 PM
olasd committed rSPSITE885f32209c93: Add a stub sentry role (authored by olasd).
Add a stub sentry role
Tue, Dec 3, 3:32 PM
olasd committed rSPSITE092b78ee4e0e: Add docker external module (authored by olasd).
Add docker external module
Tue, Dec 3, 3:32 PM
olasd accepted D2389: Add a 'sha1' field to origin documents, used for sorting..
Tue, Dec 3, 3:21 PM
olasd accepted D2385: lister/tasks: Standardize return statements.

Looks good to me.

Tue, Dec 3, 11:40 AM
olasd accepted D2384: api/snapshot: Handle aliases chain when resolving real branch target.

This is crying for a "lazy-loaded snapshot object" abstraction in swh.storage, but I guess that's a good step up from the status quo :)

Tue, Dec 3, 10:36 AM
olasd accepted D2383: hypothesis_strategies/snapshots: Explain last post-processing step.

Thanks for the investigation!

Tue, Dec 3, 10:35 AM

Mon, Dec 2

olasd added a comment to D2383: hypothesis_strategies/snapshots: Explain last post-processing step.
In D2383#56176, @olasd wrote:

Cycle detection in snapshots is supposed to be handled in the snapshot_identifier function; that's why it's called in a loop when generating the snapshot id.
If there's a bug here it should be fixed in that function (and a regression test should be added).

Mon, Dec 2, 6:46 PM
olasd requested changes to D2383: hypothesis_strategies/snapshots: Explain last post-processing step.

Cycle detection in snapshots is supposed to be handled in the snapshot_identifier function; that's why it's called in a loop when generating the snapshot id.

Mon, Dec 2, 6:45 PM
olasd committed R206:ab6a114af7de: Don't deploy zookeeper or kafka in sentry docker-compose (authored by olasd).
Don't deploy zookeeper or kafka in sentry docker-compose
Mon, Dec 2, 6:31 PM
olasd committed R206:6c53fc512ce9: Don't deploy postgres in sentry docker-compose (authored by olasd).
Don't deploy postgres in sentry docker-compose
Mon, Dec 2, 6:31 PM
olasd committed rSENVe7abce01db3d: Update octocatalog-diff facts (authored by olasd).
Update octocatalog-diff facts
Mon, Dec 2, 6:04 PM
olasd committed rSENV2a61a25b9e7b: Add puppetlabs-docker module (authored by olasd).
Add puppetlabs-docker module
Mon, Dec 2, 6:04 PM
olasd added a project to T1360: Install a sentry server: Sprint 2019/12 (Monitor and Conquer).
Mon, Dec 2, 2:33 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd added a project to T1359: Add sentry support in every swh running service : Sprint 2019/12 (Monitor and Conquer).
Mon, Dec 2, 2:33 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd added a project to T1358: Setup a sentry service: Sprint 2019/12 (Monitor and Conquer).
Mon, Dec 2, 2:33 PM · Sprint 2019/12 (Monitor and Conquer), Metrics/monitoring, System administration
olasd created T2133: Scheduler listener/runner: add statsd probes.
Mon, Dec 2, 2:33 PM · Metrics/monitoring, Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
olasd created T2132: Scheduler monitoring: review existing task probes.
Mon, Dec 2, 2:32 PM · Sprint 2019/12 (Monitor and Conquer), Scheduling utilities
olasd created T2131: Scheduler monitoring: compare database with rabbitmq.
Mon, Dec 2, 2:31 PM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
olasd created T2130: Scheduler monitoring: probe rabbitmq status.
Mon, Dec 2, 2:30 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2129: Journal: End to end monitoring.
Mon, Dec 2, 2:29 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2128: Monitor journal consumer lag.
Mon, Dec 2, 2:28 PM · Metrics/monitoring, Sprint 2019/12 (Monitor and Conquer)
olasd created T2127: Standalone Indexer Testing.
Mon, Dec 2, 2:26 PM · Indexer, Sprint 2019/12 (Monitor and Conquer)
olasd created T2126: Production Vault end to end testing.
Mon, Dec 2, 2:22 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2125: Production Web UI end to end testing.
Mon, Dec 2, 2:20 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2124: Save Code Now: monitoring of admin infra.
Mon, Dec 2, 2:17 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2123: Lister monitoring: count origins known per lister instance.
Mon, Dec 2, 2:16 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2122: Lister monitoring: add statsd probe for each lister instance.
Mon, Dec 2, 2:13 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2121: Global dashboarding: icinga in grafana.
Mon, Dec 2, 2:12 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2120: Loaders: standalone task tests.
Mon, Dec 2, 2:10 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2119: Monitoring of workers.
Mon, Dec 2, 2:07 PM · Scheduling utilities, Sprint 2019/12 (Monitor and Conquer)
olasd created T2118: Deposit: End to End monitoring.
Mon, Dec 2, 2:05 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created T2117: Save Code Now: End to End monitoring.
Mon, Dec 2, 2:03 PM · Sprint 2019/12 (Monitor and Conquer)
olasd created Sprint 2019/12 (Monitor and Conquer).
Mon, Dec 2, 2:00 PM

Fri, Nov 29

olasd committed rSPSITEb1de3d04cf5a: Use local nameservers in docker configuration to allow resolving internal… (authored by olasd).
Use local nameservers in docker configuration to allow resolving internal…
Fri, Nov 29, 4:17 PM
olasd committed rSPSITE5f97175fa744: Make all hosts forward queries for internal.staging.swh.network (authored by olasd).
Make all hosts forward queries for internal.staging.swh.network
Fri, Nov 29, 4:17 PM
olasd committed rSPSITE084fb922c954: Add azure euwest reverse dns zone to forwarders configuration (authored by olasd).
Add azure euwest reverse dns zone to forwarders configuration
Fri, Nov 29, 4:17 PM
olasd committed rSPSITEf09efee5c2f4: Update ssm/hitch (authored by olasd).
Update ssm/hitch
Fri, Nov 29, 4:17 PM
olasd committed rSPSITE7ce5a95aa02c: Fix typo in internal.staging.swh.network forwarder configuration (authored by olasd).
Fix typo in internal.staging.swh.network forwarder configuration
Fri, Nov 29, 4:17 PM
olasd committed rSPSITEa2dad1774b16: Refactor forward_zones configuration to stop repeating the local nameserver (authored by olasd).
Refactor forward_zones configuration to stop repeating the local nameserver
Fri, Nov 29, 4:17 PM
olasd committed rSPHIT3b748eb274c5: Add configuration variables for tls_protos and alpn_protos (authored by olasd).
Add configuration variables for tls_protos and alpn_protos
Fri, Nov 29, 4:12 PM
olasd committed rSPSITE49e107bf35c8: Modernize apache TLS configuration (authored by olasd).
Modernize apache TLS configuration
Fri, Nov 29, 3:27 PM
olasd accepted D2377: replay: use tag based statsd probes.
Fri, Nov 29, 3:14 PM
olasd added a comment to D2373: Fix release_identifier for snapshot target.

I'm just a tiny bit worried that this "swh extension" might clash with something that upstream git implements, if we reuse git terminology.

Fri, Nov 29, 2:20 PM
olasd added inline comments to D2372: replay: ensure a revision is present only once in a batch.
Fri, Nov 29, 1:53 PM

Wed, Nov 27

olasd committed rDDOC0f5d6c9035f3: Use .mrconfig to check whether we're in a mr repo (authored by olasd).
Use .mrconfig to check whether we're in a mr repo
Wed, Nov 27, 10:45 AM

Tue, Nov 26

olasd committed rDENV7178d53b9d9a: docker: Stop pinning gunicorn (authored by olasd).
docker: Stop pinning gunicorn
Tue, Nov 26, 4:34 PM
olasd closed D2355: docker: Stop pinning gunicorn.
Tue, Nov 26, 4:34 PM
olasd updated the diff for D2355: docker: Stop pinning gunicorn.

Rebase

Tue, Nov 26, 4:34 PM
olasd updated the diff for D2355: docker: Stop pinning gunicorn.

Still install gunicorn

Tue, Nov 26, 4:23 PM
olasd created D2355: docker: Stop pinning gunicorn.
Tue, Nov 26, 3:21 PM
olasd added a reverting change for D1084: Simplify and organize a bit the whole docker environment: rDENV5e8af88dc7f8: Revert "Install kombu from sources in scheduler-worker as a workaround for….
Tue, Nov 26, 1:35 PM
olasd committed rDENV5e8af88dc7f8: Revert "Install kombu from sources in scheduler-worker as a workaround for… (authored by olasd).
Revert "Install kombu from sources in scheduler-worker as a workaround for…
Tue, Nov 26, 1:35 PM
olasd added a reverting change for rDENVf8ca643a0508: Install kombu from sources in scheduler-worker as a workaround for T1491: rDENV5e8af88dc7f8: Revert "Install kombu from sources in scheduler-worker as a workaround for….
Tue, Nov 26, 1:35 PM
olasd committed rDENVb3c973594ab0: nginx: Add error logging at info level on stderr (authored by olasd).
nginx: Add error logging at info level on stderr
Tue, Nov 26, 1:35 PM
olasd committed rDENVa2778431afc1: Add a statsd-exporter instance (authored by olasd).
Add a statsd-exporter instance
Tue, Nov 26, 1:35 PM
olasd committed rDENV6df984762351: Add a prometheus instance (authored by olasd).
Add a prometheus instance
Tue, Nov 26, 1:35 PM
olasd committed rDENVb35153426aed: Avoid nginx depending on all the web-facing containers (authored by olasd).
Avoid nginx depending on all the web-facing containers
Tue, Nov 26, 1:35 PM
olasd committed rDENV8fa21cc9d1cf: Move nginx to port 5080 (authored by olasd).
Move nginx to port 5080
Tue, Nov 26, 1:35 PM
olasd committed rDENVcc26d77abd4a: Add a Makefile with a check-staged target to please the pre-commit hook (authored by olasd).
Add a Makefile with a check-staged target to please the pre-commit hook
Tue, Nov 26, 1:35 PM