Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 19 2022

ardumont updated the diff for D8499: Make storage-replayer push their issue to sentry.

Make secrets optional

Sep 19 2022, 1:49 PM
ardumont requested review of D8499: Make storage-replayer push their issue to sentry.
Sep 19 2022, 1:47 PM
ardumont added a revision to T4391: [cassandra] deploy the replaying stack: D8499: Make storage-replayer push their issue to sentry.
Sep 19 2022, 1:47 PM · System administration
ardumont accepted D8481: npm: Add test for 'author' value that used to crash.
Sep 19 2022, 10:53 AM
ardumont accepted D8491: setup.py: Fix debian unstable package build.
Sep 19 2022, 10:52 AM
ardumont accepted D8490: setup.py: Fix debian unstable package build.
Sep 19 2022, 10:45 AM
ardumont added a comment to T4538: Consider archiving NAR hashes.

yes, nix too. As far as i remember, it's NAR for Nix ARchive ;)

Sep 19 2022, 9:52 AM · SVN Loader, Tarball loader, Nixguix loader
ardumont accepted D8497: postfix: remove zack from the root smtp alias.
Sep 19 2022, 9:46 AM

Sep 16 2022

ardumont moved T4459: Deploy swh-indexer > v2.6 on staging then production from code-review/await-feedback/pause to deployed/landed/monitoring on the System administration board.
Sep 16 2022, 6:09 PM · Indexer, System administration
ardumont committed rSPSITEca0e247c1eb1: indexer: Simplify journal client configuration (authored by ardumont).
indexer: Simplify journal client configuration
Sep 16 2022, 5:38 PM
ardumont added a comment to P1454 create kakfa user for swh-indexer-prod-01.

Actually, we must avoid overriding the consumer group id prefix so more like this:

/usr/local/sbin/create_kafka_users_rocquencourt.sh swh-indexer-prod-01
Sep 16 2022, 5:24 PM
ardumont committed rSPSITE24f2623d46fb: Adapt configuration for indexer workers running on azure (authored by ardumont).
Adapt configuration for indexer workers running on azure
Sep 16 2022, 5:02 PM
ardumont closed D8493: indexer: Use public brokers in production, internal ones for staging.
Sep 16 2022, 4:48 PM
ardumont committed rSPSITE74264b68145b: indexer: Use public brokers in production, internal ones for staging (authored by ardumont).
indexer: Use public brokers in production, internal ones for staging
Sep 16 2022, 4:48 PM
ardumont closed D8492: indexer: Allow journal client authentication configuration.
Sep 16 2022, 4:47 PM
ardumont committed rSPSITE009c924339c1: indexer: Allow journal client authentication configuration (authored by ardumont).
indexer: Allow journal client authentication configuration
Sep 16 2022, 4:47 PM
ardumont updated the diff for D8492: indexer: Allow journal client authentication configuration.

Rebase

Sep 16 2022, 4:46 PM
ardumont updated the diff for D8493: indexer: Use public brokers in production, internal ones for staging.

Rebase

Sep 16 2022, 4:46 PM
ardumont updated the test plan for D8493: indexer: Use public brokers in production, internal ones for staging.
Sep 16 2022, 4:11 PM
ardumont updated the diff for D8493: indexer: Use public brokers in production, internal ones for staging.

Explicit the 9093 port for public access to broker through tls

Sep 16 2022, 4:09 PM

Sep 15 2022

ardumont committed rMSLD20b3a5c89eec: 2022-09-16: Add "10 years of Guix event" presentation (authored by vlorentz).
2022-09-16: Add "10 years of Guix event" presentation
Sep 15 2022, 6:53 PM
ardumont committed rMSLD3e62b5c0b738: Create a README to reference how to kickstart a presentation (authored by ardumont).
Create a README to reference how to kickstart a presentation
Sep 15 2022, 6:53 PM
ardumont requested review of D8493: indexer: Use public brokers in production, internal ones for staging.
Sep 15 2022, 6:29 PM
ardumont added a revision to T4459: Deploy swh-indexer > v2.6 on staging then production: D8493: indexer: Use public brokers in production, internal ones for staging.
Sep 15 2022, 6:29 PM · Indexer, System administration
ardumont added a comment to T4459: Deploy swh-indexer > v2.6 on staging then production.

There's a few issues with the configuration of these indexer clients:
the traffic should not be going through the IPSec VPN. They need to use the public,
authenticated kafka endpoints. The IPSec load is making all azure communication
struggle.

ack, that should be "simple" enough to adapt [1]
[1] https://docs.softwareheritage.org/sysadm/mirror-operations/onboard.html?highlight=credential#how-to-create-the-journal-credentials

Sep 15 2022, 6:15 PM · Indexer, System administration
ardumont updated the diff for D8492: indexer: Allow journal client authentication configuration.

Adapt according to review

Sep 15 2022, 6:11 PM
ardumont updated the test plan for D8492: indexer: Allow journal client authentication configuration.
Sep 15 2022, 6:10 PM
ardumont added a comment to D8492: indexer: Allow journal client authentication configuration.

The group id of the authenticated consumers have to be probably updated to match the kafka acls

Sep 15 2022, 6:10 PM
ardumont updated the summary of D8492: indexer: Allow journal client authentication configuration.
Sep 15 2022, 5:52 PM
ardumont updated the test plan for D8492: indexer: Allow journal client authentication configuration.
Sep 15 2022, 5:50 PM
ardumont requested review of D8492: indexer: Allow journal client authentication configuration.
Sep 15 2022, 5:49 PM
ardumont added a revision to T4459: Deploy swh-indexer > v2.6 on staging then production: D8492: indexer: Allow journal client authentication configuration.
Sep 15 2022, 5:49 PM · Indexer, System administration
ardumont committed rSPPRIVCcd358c363d8d: Sync private-data and private-data-censored (authored by ardumont).
Sync private-data and private-data-censored
Sep 15 2022, 5:45 PM
ardumont created P1454 create kakfa user for swh-indexer-prod-01.
Sep 15 2022, 5:19 PM
ardumont closed T4532: GraphQL: staging - Deploy version v0.0.4, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
Sep 15 2022, 4:47 PM · GraphQL API, Roadmap 2022
ardumont closed T4532: GraphQL: staging - Deploy version v0.0.4 as Resolved.
Sep 15 2022, 4:47 PM · System administration, GraphQL API
ardumont accepted D8487: utils: Cache origin visit types in production webapp only.
Sep 15 2022, 3:52 PM
ardumont added a comment to D8489: docker: Use swh-search with memory backend as default search engine.

with a more costly

i think you meant *without* ;)

Nope, when using the docker-compose.search.yml, an elasticsearch service is created, which is clearly more costly than a memory backend.

Sep 15 2022, 3:49 PM
ardumont accepted D8489: docker: Use swh-search with memory backend as default search engine.

I guess the memory implementation is enough to reproduce the same behavior as the actual search service.

Sep 15 2022, 3:46 PM
ardumont added a comment to D8489: docker: Use swh-search with memory backend as default search engine.

with a more costly

Sep 15 2022, 3:44 PM
ardumont accepted D8485: api/server: Fix remote search server when using memory backend.
Sep 15 2022, 3:33 PM
ardumont accepted D8486: docker/conf/scheduler: Set no_origins_scheduled_backoff to 1 minute.
Sep 15 2022, 3:32 PM
ardumont accepted D8482: rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes.
Sep 15 2022, 3:31 PM
ardumont committed rMSLD41ec08ca6d42: 2022-09-16: Improve slide titles (authored by ardumont).
2022-09-16: Improve slide titles
Sep 15 2022, 3:26 PM
ardumont committed rMSLD4258a0d48b46: 2022-09-16: Adapt according to moranegg's feedback (authored by ardumont).
2022-09-16: Adapt according to moranegg's feedback
Sep 15 2022, 3:26 PM
ardumont accepted D8472: cassandra: Allow to configure the jmx for remote or local only access.
Sep 15 2022, 2:02 PM
ardumont accepted D8483: pre-commit: Exclude generated files in grpc folder from checks.
Sep 15 2022, 1:58 PM
ardumont accepted D8484: Restore erroneously removed paragraph in Docker documentation Really sorry for the extra work..
Sep 15 2022, 1:57 PM
ardumont added a comment to D8482: rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes.

ok, but i'm a bit confused about the absence of conditional regarding the second hard drive configured.
Don't that need a conditional somewhere?

Sep 15 2022, 1:51 PM
ardumont accepted D8480: loaders: Use an emptydir volume type for /tmp.
Sep 15 2022, 1:48 PM
ardumont accepted D8475: recurrent_visits: Allow to set no origins scheduled backoff in config.
Sep 15 2022, 1:48 PM
ardumont retitled D8482: rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes from rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes A manual reconfiguration of the existing nodes will be needed to configure the dataset before puppet does a mount over on the existing directory content to rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes.
Sep 15 2022, 1:44 PM
ardumont added a comment to D8482: rancher: use a zfs dataset for /var/lib/kubelet to use the local storage for EmptyDir volumes.

lol, i think the diff description went wrong given the diff's title ;)

Sep 15 2022, 1:44 PM
ardumont accepted D8479: staging-cluster: Declare the 2d disk on the local storage of uffizi.

Great, thanks.

Sep 15 2022, 1:42 PM
ardumont accepted D8478: Update documentation for Docker Compose V2 (i.e. compose plugin).
Sep 15 2022, 1:41 PM
ardumont added a comment to D8478: Update documentation for Docker Compose V2 (i.e. compose plugin).

lgtm, but i think there are 2 typos to fix first.

Sep 15 2022, 1:41 PM
ardumont committed rMSLD21b51a7c297c: 2022-09-16: Update first part of the presentation transcript (authored by ardumont).
2022-09-16: Update first part of the presentation transcript
Sep 15 2022, 1:20 PM
ardumont committed rMSLD2e999429ebee: 2022-09-16: Vertical align merkle dag rendering (authored by ardumont).
2022-09-16: Vertical align merkle dag rendering
Sep 15 2022, 12:49 PM
ardumont committed rMSLDbb5b9880ebbc: 2022-09-16: Reorganize slides around coverage and swhid (authored by ardumont).
2022-09-16: Reorganize slides around coverage and swhid
Sep 15 2022, 11:59 AM
ardumont committed rMSLDdbefdd3f766f: 2022-09-16: Drop copyright slide to the benefit of misc info slides (authored by ardumont).
2022-09-16: Drop copyright slide to the benefit of misc info slides
Sep 15 2022, 9:55 AM
ardumont committed rMSLDca9b096ea3c8: 2022-09-16: Integrate some break between slides (authored by ardumont).
2022-09-16: Integrate some break between slides
Sep 15 2022, 9:53 AM

Sep 14 2022

ardumont committed rMSLDbe3973357645: 2022-09-11: Add a bit of history about guix/swh collaboration (authored by ardumont).
2022-09-11: Add a bit of history about guix/swh collaboration
Sep 14 2022, 4:58 PM
ardumont committed rMSLDa3bf3cb607a4: 2022-09-11: Add worked example on swhid / dag prior to guix slides (authored by ardumont).
2022-09-11: Add worked example on swhid / dag prior to guix slides
Sep 14 2022, 4:40 PM
ardumont committed rMSLD83a08d0b23ec: 2022-09-11: Rename org source appropriately (authored by ardumont).
2022-09-11: Rename org source appropriately
Sep 14 2022, 4:40 PM
ardumont committed rMSLD20d37930505d: 2022-09-11: Make pause between slides (authored by ardumont).
2022-09-11: Make pause between slides
Sep 14 2022, 4:40 PM
ardumont committed rMSLDc4a237cb6662: 2022-09-11: Add thanks note and basic copyright slide (authored by ardumont).
2022-09-11: Add thanks note and basic copyright slide
Sep 14 2022, 4:40 PM
ardumont committed rMSLDea968018443b: 2022-09-11: Integrate guix chart coverage (authored by ardumont).
2022-09-11: Integrate guix chart coverage
Sep 14 2022, 4:40 PM
ardumont committed rMSLDd618dbcdfee8: 2022-09-11: Update links (authored by ardumont).
2022-09-11: Update links
Sep 14 2022, 4:40 PM
ardumont committed rMSLD97bf917d47f4: 2022-09-11: Update reproducibility slides (authored by ardumont).
2022-09-11: Update reproducibility slides
Sep 14 2022, 4:40 PM
ardumont committed rMSLD32c410b446a8: f2022-06-24: Add thanks note and basic copyright slide (authored by ardumont).
f2022-06-24: Add thanks note and basic copyright slide
Sep 14 2022, 3:30 PM
ardumont committed rMSLD606add78707f: 2022-06-24: Integrate guix chart coverage (authored by ardumont).
2022-06-24: Integrate guix chart coverage
Sep 14 2022, 3:14 PM
ardumont committed rMSLD73b014d67fc9: 2022-06-24: Update links (authored by ardumont).
2022-06-24: Update links
Sep 14 2022, 3:14 PM
ardumont committed rSKCONF3749b14afd9d: archive-staging: Switch back branch to master (authored by ardumont).
archive-staging: Switch back branch to master
Sep 14 2022, 2:15 PM
ardumont committed R260:13964e8e82c3: swh-loader-package: Deploy v4.1 (authored by ardumont).
swh-loader-package: Deploy v4.1
Sep 14 2022, 1:55 PM
ardumont committed R259:8e3e31f116b6: swh-loader-core v4.1.0: Generate new frozen requirements (authored by ardumont).
swh-loader-core v4.1.0: Generate new frozen requirements
Sep 14 2022, 1:54 PM
ardumont accepted D8466: Add date-based index to origin_visit.
Sep 14 2022, 12:30 PM
ardumont committed rMSLD0254d6eb968f: 2022-06-24: Update reproducibility slides (authored by ardumont).
2022-06-24: Update reproducibility slides
Sep 14 2022, 12:24 PM
ardumont accepted D8470: Improve icinga2 prometheus metric checks.
Sep 14 2022, 9:43 AM
ardumont accepted D8471: Summary: Bump local prometheus retention down to 1 month.

Wait, now we can make icinga check with prometheus/thanos metrics?
How awesome!

Sep 14 2022, 9:42 AM
ardumont accepted D8469: graphql: Declare startup and liveness probes.

Great! Thanks.

Sep 14 2022, 9:34 AM

Sep 13 2022

ardumont accepted D8467: tests/urls: Import test views only when running cypress tests.
Sep 13 2022, 4:36 PM
ardumont moved T4459: Deploy swh-indexer > v2.6 on staging then production from deployed/landed/monitoring to code-review/await-feedback/pause on the System administration board.
Sep 13 2022, 3:42 PM · Indexer, System administration
ardumont abandoned D8446: Create a README to reference how to kickstart a presentation.

Closing now, that will be landing with the current presentation on the 'guix' branch.

Sep 13 2022, 3:40 PM
ardumont moved T4532: GraphQL: staging - Deploy version v0.0.4 from code-review/await-feedback/pause to deployed/landed/monitoring on the System administration board.
Sep 13 2022, 3:35 PM · System administration, GraphQL API
ardumont moved T4532: GraphQL: staging - Deploy version v0.0.4 from in-progress to code-review/await-feedback/pause on the System administration board.
Sep 13 2022, 3:35 PM · System administration, GraphQL API
ardumont updated the task description for T4532: GraphQL: staging - Deploy version v0.0.4.
Sep 13 2022, 3:35 PM · System administration, GraphQL API
ardumont committed R260:cf7bc7430ae5: swh-graphql: Deploy v0.0.5 (authored by ardumont).
swh-graphql: Deploy v0.0.5
Sep 13 2022, 3:32 PM
ardumont committed R259:a86d53a81595: swh-graphql: v0.0.5: Generate new frozen requirements (authored by ardumont).
swh-graphql: v0.0.5: Generate new frozen requirements
Sep 13 2022, 3:32 PM
ardumont committed rMSLD0109460473d6: README: Update missing deps (authored by ardumont).
README: Update missing deps
Sep 13 2022, 3:18 PM
ardumont accepted D8465: Move uvicorn and starlette to the main requirement file.
Sep 13 2022, 3:16 PM
ardumont published D8465: Move uvicorn and starlette to the main requirement file for review.

\o/

Sep 13 2022, 3:16 PM
ardumont added a revision to T4532: GraphQL: staging - Deploy version v0.0.4: D8465: Move uvicorn and starlette to the main requirement file.
Sep 13 2022, 3:15 PM · System administration, GraphQL API
ardumont accepted D8461: archive_coverage: Add new listed origin types.

Thanks.

Sep 13 2022, 2:57 PM
ardumont committed R260:a1beb0a10e08: swh-graphql: Deploy v0.0.4 (authored by ardumont).
swh-graphql: Deploy v0.0.4
Sep 13 2022, 2:49 PM
ardumont updated the task description for T4532: GraphQL: staging - Deploy version v0.0.4.
Sep 13 2022, 2:48 PM · System administration, GraphQL API
ardumont committed R260:8c805440315b: swh-graphql: Deploy v0.0.4 (authored by ardumont).
swh-graphql: Deploy v0.0.4
Sep 13 2022, 2:45 PM
ardumont committed R259:1daf7a649686: swh-graphql: Adapt entrypoint according to latest change (authored by ardumont).
swh-graphql: Adapt entrypoint according to latest change
Sep 13 2022, 2:42 PM
ardumont committed R259:4e6c58a81231: swh-graphql: Generate new frozen requirements (authored by ardumont).
swh-graphql: Generate new frozen requirements
Sep 13 2022, 2:42 PM
ardumont updated the task description for T4532: GraphQL: staging - Deploy version v0.0.4.
Sep 13 2022, 2:34 PM · System administration, GraphQL API
ardumont updated the task description for T4532: GraphQL: staging - Deploy version v0.0.4.
Sep 13 2022, 2:32 PM · System administration, GraphQL API