Page MenuHomeSoftware Heritage
Feed Advanced Search

May 30 2022

ardumont requested review of D7903: cli.db: Fix help message typo.
May 30 2022, 3:10 PM
ardumont closed D7900: Update manifest to exclude swh/provenance/tools.
May 30 2022, 2:57 PM
ardumont committed rDPROV8f206d569245: Update manifest to exclude swh/provenance/tools (authored by ardumont).
Update manifest to exclude swh/provenance/tools
May 30 2022, 2:57 PM
ardumont closed D7902: requirements: Add missing dependency.
May 30 2022, 2:57 PM
ardumont committed rDSCRUBe8935e816b3d: requirements: Add missing dependency (authored by ardumont).
requirements: Add missing dependency
May 30 2022, 2:57 PM
ardumont added a comment to T4228: scrubber: Investigate the apparent lock (staging).

And now time to unstuck the debian build...

May 30 2022, 2:56 PM · Archive integrity, System administration
ardumont committed rDSCRUB0f0102afe4dd: d/changelog: Bump new release (authored by ardumont).
d/changelog: Bump new release
May 30 2022, 2:26 PM
ardumont committed rDSCRUBb96b3efec5b6: d/control: Update dependencies (authored by ardumont).
d/control: Update dependencies
May 30 2022, 2:26 PM
ardumont added a comment to T4228: scrubber: Investigate the apparent lock (staging).

And now time to unstuck the debian build...

May 30 2022, 2:24 PM · Archive integrity, System administration
ardumont updated the summary of D7902: requirements: Add missing dependency.
May 30 2022, 2:10 PM
ardumont requested review of D7902: requirements: Add missing dependency.
May 30 2022, 2:10 PM
ardumont added a revision to T4228: scrubber: Investigate the apparent lock (staging): D7902: requirements: Add missing dependency.
May 30 2022, 2:07 PM · Archive integrity, System administration
ardumont accepted D7901: Add support for python-keycloak >= 1.0.0.
May 30 2022, 2:04 PM
ardumont accepted D7899: Add support for indexing directly from the journal client.
May 30 2022, 2:01 PM
ardumont triaged T4282: Deploy new origin intrinsic metadata journal client indexer > v1.1 as Normal priority.
May 30 2022, 1:16 PM · System administration, Indexer, Metadata workflow
ardumont closed D7892: Fix master build.
May 30 2022, 9:38 AM
ardumont committed rDDEPfb2c2d825af5: Fix master build [1] (authored by ardumont).
Fix master build [1]
May 30 2022, 9:38 AM

May 25 2022

ardumont added a comment to T4280: Unstuck swh-web master build failing .

computer says no [1]

May 25 2022, 6:36 PM · Web app
ardumont added a comment to T4280: Unstuck swh-web master build failing .

That currently prevented the v0.0.391 from being built [1].

May 25 2022, 6:02 PM · Web app
ardumont updated the task description for T4280: Unstuck swh-web master build failing .
May 25 2022, 6:01 PM · Web app
ardumont added a revision to T4280: Unstuck swh-web master build failing : D7895: wip: Fix mypy issues which fail the master build.
May 25 2022, 6:00 PM · Web app
ardumont added a comment to T4280: Unstuck swh-web master build failing .

Tentatively tried it but that's not working [1]

May 25 2022, 6:00 PM · Web app
ardumont triaged T4280: Unstuck swh-web master build failing as High priority.
May 25 2022, 5:59 PM · Web app
ardumont added a comment to P1367 diff deps between last green and current green builds.

May 25 2022, 5:34 PM
ardumont created P1367 diff deps between last green and current green builds.
May 25 2022, 5:33 PM
ardumont added a revision to T4230: [provenance] pip deploy the stack on the ovh server: D7900: Update manifest to exclude swh/provenance/tools.
May 25 2022, 5:20 PM · Provenance database, System administration
ardumont updated the summary of D7900: Update manifest to exclude swh/provenance/tools.
May 25 2022, 5:20 PM
ardumont changed the status of T4278: Elastic worker cluster failures to unstuck from Open to Work in Progress.
May 25 2022, 5:20 PM · System administration, Roadmap 2022
ardumont changed the status of T4278: Elastic worker cluster failures to unstuck, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
May 25 2022, 5:20 PM · meta-task, System administration, Roadmap 2022
ardumont requested review of D7900: Update manifest to exclude swh/provenance/tools.
May 25 2022, 5:13 PM
ardumont accepted D7893: Refactor base indexers to provide a process_journal_objects method.
May 25 2022, 5:12 PM
ardumont retitled D7892: Fix master build from Fix master build [1] to Fix master build.
May 25 2022, 5:03 PM
ardumont added a comment to D7892: Fix master build.

looks like this bumps the django version requirement;

how so?

If mypy started complaining about the # type: ignore annotations, it means they stopped being useful. I assume it's because the CI uses a new version of some dependency (probably Django).

May 25 2022, 4:28 PM
ardumont added a comment to D7812: [WIP] Add arch lister module..

New patch that fetch archives instead of git repository is D7894

May 25 2022, 3:33 PM
ardumont added a revision to T4233: Ingest Arch Linux: D7894: Add arch lister module (origins from archives)..
May 25 2022, 3:32 PM · Arch loader, Arch Lister, Archive coverage
ardumont updated the task description for T4233: Ingest Arch Linux.
May 25 2022, 3:32 PM · Arch loader, Arch Lister, Archive coverage
ardumont accepted D7896: Fix crash when using datastore_get_or_add for an existing datastore.
May 25 2022, 3:29 PM
ardumont published D7896: Fix crash when using datastore_get_or_add for an existing datastore for review.
May 25 2022, 3:29 PM
ardumont added a comment to D7892: Fix master build.

looks like this bumps the django version requirement;

May 25 2022, 3:24 PM
ardumont requested review of D7892: Fix master build.
May 25 2022, 2:57 PM
ardumont updated the task description for T4232: Listers: Canonicalize listed github origins.
May 25 2022, 2:30 PM · Lister
ardumont triaged T4279: Refactor swh module to computes canonical github origins as Normal priority.
May 25 2022, 2:29 PM · Lister
ardumont updated the task description for T4232: Listers: Canonicalize listed github origins.
May 25 2022, 2:28 PM · Lister
ardumont updated subscribers of T4228: scrubber: Investigate the apparent lock (staging).
May 25 2022, 2:26 PM · Archive integrity, System administration
ardumont added a comment to D7537: Add tooltip to add forge now request status.

@pranay101 For this to land is not only about making it work, you need to attend to anlambert's remark as well [1]

May 25 2022, 2:24 PM
ardumont added a comment to T4228: scrubber: Investigate the apparent lock (staging).

@vlorentz And now we got [1] to unstuck.

May 25 2022, 2:21 PM · Archive integrity, System administration
ardumont triaged T4278: Elastic worker cluster failures to unstuck as High priority.
May 25 2022, 2:11 PM · System administration, Roadmap 2022
ardumont closed T4270: Deploy swh.lister v2.9.3 as Resolved.
May 25 2022, 2:10 PM · System administration, Lister
ardumont closed T4271: Deploy loader.core v3.5 and loader.git v1.9 as Resolved.
May 25 2022, 2:10 PM · System administration
ardumont moved T4064: Test GitLab migration scripts from deployed/landed/monitoring to code-review/await-feedback/pause on the System administration board.
May 25 2022, 2:09 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4064: Test GitLab migration scripts from in-progress to deployed/landed/monitoring on the System administration board.
May 25 2022, 2:09 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
May 25 2022, 2:09 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4228: scrubber: Investigate the apparent lock (staging) from in-progress to deployed/landed/monitoring on the System administration board.
May 25 2022, 2:07 PM · Archive integrity, System administration
ardumont changed the status of T4228: scrubber: Investigate the apparent lock (staging) from Open to Work in Progress.
May 25 2022, 2:07 PM · Archive integrity, System administration
ardumont added a comment to T4228: scrubber: Investigate the apparent lock (staging).

Well, i don't get it the apparent locking situation.
Services that do need to write to the db have the proper credentials for that.

May 25 2022, 2:01 PM · Archive integrity, System administration
ardumont accepted D7891: Convert test_metadata from unittest to pytest.

skimmed through but this lgtm

May 25 2022, 1:55 PM
ardumont added a comment to D7888: Represent filtered_objects_percent as a histogram rather than average.

Please do test this in docker or something to check it does what you want to avoid yet another ping pong with staging/production deployment.

May 25 2022, 1:54 PM
ardumont added a comment to T3781: Replace the Nixguix loader with a lister.

Another argument: currently, there is always at least some failures when loading real
Nix and Guix repositories, so visits always have status partial; which prevents them
from being listed in
https://archive.softwareheritage.org/browse/search/?q=&with_visit=true&with_content=true&visit_type=nixguix
(but we get results when un-checking " only show origins visited at least once")

May 25 2022, 10:14 AM · Data Model, Nixguix loader
ardumont added a comment to T4064: Test GitLab migration scripts.

"Full" (with the overall sysadm repositories) run [1].

May 25 2022, 8:36 AM · System administration, GitLab migration, Roadmap 2020

May 24 2022

ardumont accepted D7889: cff: Do not change yaml.SafeLoader globally.
May 24 2022, 7:57 PM
ardumont added a project to T4272: Schedule regular visits for origins added with Save Code Now: Scheduling utilities.
May 24 2022, 4:47 PM · Scheduling utilities
ardumont renamed T4272: Schedule regular visits for origins added with Save Code Now from Schedule regular visits for origins addes with Save Code Now to Schedule regular visits for origins added with Save Code Now.
May 24 2022, 4:47 PM · Scheduling utilities
ardumont added a comment to T4272: Schedule regular visits for origins added with Save Code Now.

They are rescheduled though [1] [2], at some point they had a way too high frequency (it may still be the case).

May 24 2022, 4:17 PM · Scheduling utilities
ardumont added a comment to T4272: Schedule regular visits for origins added with Save Code Now.

Related to T1524

May 24 2022, 4:13 PM · Scheduling utilities
ardumont added a comment to T4064: Test GitLab migration scripts.

Another "private" (for the test) repository to try and migrate [1], it should be private but it's not [2]:

May 24 2022, 3:05 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Added 2 more repositories [1] to migrate and triggered it [2] [3]:

May 24 2022, 2:58 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4271: Deploy loader.core v3.5 and loader.git v1.9 from in-progress to deployed/landed/monitoring on the System administration board.
May 24 2022, 10:29 AM · System administration
ardumont updated the task description for T4271: Deploy loader.core v3.5 and loader.git v1.9.
May 24 2022, 9:37 AM · System administration
ardumont changed the status of T4271: Deploy loader.core v3.5 and loader.git v1.9 from Open to Work in Progress.
May 24 2022, 9:33 AM · System administration
ardumont triaged T4271: Deploy loader.core v3.5 and loader.git v1.9 as Normal priority.
May 24 2022, 9:33 AM · System administration

May 23 2022

ardumont added a comment to T4064: Test GitLab migration scripts.

It seems to have finished badly [1].
But that may only be because it's configured to run in debug mode.
Latest run logs for later [2]

May 23 2022, 5:12 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4270: Deploy swh.lister v2.9.3 from in-progress to deployed/landed/monitoring on the System administration board.
May 23 2022, 5:06 PM · System administration, Lister
ardumont updated the task description for T4270: Deploy swh.lister v2.9.3.
May 23 2022, 5:06 PM · System administration, Lister
ardumont changed the status of T4270: Deploy swh.lister v2.9.3 from Open to Work in Progress.
May 23 2022, 4:55 PM · System administration, Lister
ardumont added a project to T4270: Deploy swh.lister v2.9.3: System administration.
May 23 2022, 4:55 PM · System administration, Lister
ardumont triaged T4270: Deploy swh.lister v2.9.3 as Normal priority.
May 23 2022, 4:55 PM · System administration, Lister
ardumont accepted D7886: rancher: downgrade deployment-internship cluster to 1.21.
May 23 2022, 4:54 PM
ardumont added a comment to T4064: Test GitLab migration scripts.

Migration is now ongoing without failing thus far.
Configured to only import puppet-environment for now [1] (to fix papercuts).
But that's still migrating the rest (users, issues, etc...).

May 23 2022, 4:39 PM · System administration, GitLab migration, Roadmap 2020
ardumont accepted D7883: Run flake8/mypy/radon sequentially.
May 23 2022, 4:37 PM
ardumont accepted D7884: Fix test failure caused by swh-auth 0.6.3.

ok then

May 23 2022, 4:36 PM
ardumont added inline comments to D7885: docker: Install required ssh/config so migration can push to gitlab.
May 23 2022, 4:17 PM
ardumont requested review of D7885: docker: Install required ssh/config so migration can push to gitlab.
May 23 2022, 4:15 PM
ardumont added a revision to T4064: Test GitLab migration scripts: D7885: docker: Install required ssh/config so migration can push to gitlab.
May 23 2022, 4:15 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Summary sent to Frank Duncan and Karl Fogel.

May 23 2022, 4:05 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed D7879: Adapt maven lister to list canonical gh urls if any.
May 23 2022, 3:39 PM
ardumont committed rDLS263db667d09c: Adapt maven lister to list canonical gh urls if any (authored by ardumont).
Adapt maven lister to list canonical gh urls if any
May 23 2022, 3:39 PM
ardumont updated the diff for D7879: Adapt maven lister to list canonical gh urls if any.

Fix

May 23 2022, 2:47 PM
ardumont moved T4036: CGit listing of git.yoctoproject.org instance is broken from Backlog to done on the System administration board.
May 23 2022, 2:27 PM · CGit lister, System administration
ardumont changed the status of T4235: [As a temporary solution] deploy the statsd-exporter binary published by prometheus from Duplicate to Resolved.
May 23 2022, 2:27 PM · System administration
ardumont changed the status of T4235: [As a temporary solution] deploy the statsd-exporter binary published by prometheus, a subtask of T4225: Deploy a more recent version of prometheus-statsd-exporter on all nodes, from Duplicate to Resolved.
May 23 2022, 2:27 PM · System administration
ardumont moved T3487: Installation of the new provenance server from in-progress to done on the System administration board.
May 23 2022, 2:27 PM · System administration
ardumont moved T3817: Install grafana on its own server from in-progress to done on the System administration board.
May 23 2022, 2:27 PM · System administration
ardumont moved T3827: Analyze low performance scheduling from in-progress to done on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont moved T3699: ECC corrections too important on one memory module of granet from deployed/landed/monitoring to done on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont moved T3699: ECC corrections too important on one memory module of granet from code-review/await-feedback/pause to deployed/landed/monitoring on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont moved T3433: Deploy swh.search v0.10/v0.11 from in-progress to done on the System administration board.
May 23 2022, 2:26 PM · System administration, Archive search
ardumont moved T3707: Use local disks for worker scratch space from in-progress to done on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont moved T3444: 26/07/2021: Unstuck infrastructure outage then post-mortem from code-review/await-feedback/pause to done on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont moved T3592: POC elastic worker infrastructure from in-progress to done on the System administration board.
May 23 2022, 2:26 PM · System administration
ardumont changed the status of T4146: Test gitlab migrations in the gitlab staging instance from Duplicate to Resolved.
May 23 2022, 2:26 PM · System administration, GitLab migration