Page MenuHomeSoftware Heritage
Feed All Stories

Oct 28 2021

douardda requested review of D6584: Make the test_client_with_deserializer reliable.
Oct 28 2021, 4:50 PM
ardumont moved T3667: Orchestrate origins scheduling according to scheduler metrics feedback from in-progress to deployed/landed/monitoring on the System administration board.
Oct 28 2021, 4:43 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont moved T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Backlog to in-progress on the System administration board.
Oct 28 2021, 4:43 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a project to T3667: Orchestrate origins scheduling according to scheduler metrics feedback: System administration.
Oct 28 2021, 4:42 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont added a comment to T3667: Orchestrate origins scheduling according to scheduler metrics feedback.

Deployed in production.

Oct 28 2021, 4:42 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback, a subtask of T2345: Improve handling of recurrent loading tasks in scheduler, from Open to Work in Progress.
Oct 28 2021, 4:34 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
ardumont changed the status of T3667: Orchestrate origins scheduling according to scheduler metrics feedback from Open to Work in Progress.

Deployed in staging.

Oct 28 2021, 4:34 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
olasd closed D6583: scheduler: Add service to schedule recurrent visits.
Oct 28 2021, 4:25 PM
olasd committed rSPSITE76564529a27f: scheduler: Add service to schedule recurrent visits (authored by olasd).
scheduler: Add service to schedule recurrent visits
Oct 28 2021, 4:25 PM
olasd closed D6582: Refactor swh scheduler services using a single unit file template.
Oct 28 2021, 4:25 PM
olasd committed rSPSITE19f0fcc6bf91: Refactor swh scheduler services using a single unit file template (authored by olasd).
Refactor swh scheduler services using a single unit file template
Oct 28 2021, 4:25 PM
ardumont abandoned D6574: scheduler: Add schedule recurrent tasks service.
Oct 28 2021, 4:25 PM
ardumont accepted D6583: scheduler: Add service to schedule recurrent visits.
Oct 28 2021, 4:24 PM
ardumont added a reviewer for D6583: scheduler: Add service to schedule recurrent visits: System administrators.
Oct 28 2021, 4:24 PM
ardumont accepted D6582: Refactor swh scheduler services using a single unit file template.
Oct 28 2021, 4:23 PM
ardumont added a reviewer for D6582: Refactor swh scheduler services using a single unit file template: System administrators.
Oct 28 2021, 4:23 PM
ardumont accepted D6582: Refactor swh scheduler services using a single unit file template.

Awesome, thx a lot.

Oct 28 2021, 4:22 PM
Harbormaster failed to build B24789: rDJNLf92d4acf30e6: Pass the object_type to JournalClient.value_serializer() for rDJNLf92d4acf30e6: Pass the object_type to JournalClient.value_serializer()!
Oct 28 2021, 4:19 PM
douardda added a comment to D6570: Remove now useless revision date checker in fixer.
In D6570#170941, @olasd wrote:

While we're here, could you check whether the other fixers are really still needed too?

Oct 28 2021, 4:18 PM
douardda added a comment to D6570: Remove now useless revision date checker in fixer.

You checked on the whole journal, right?

Oct 28 2021, 4:18 PM
olasd requested review of D6583: scheduler: Add service to schedule recurrent visits.
Oct 28 2021, 4:16 PM
olasd added a revision to T3667: Orchestrate origins scheduling according to scheduler metrics feedback: D6583: scheduler: Add service to schedule recurrent visits.
Oct 28 2021, 4:16 PM · System administration, Sprint 2021 01, Archive coverage, Scheduling utilities
olasd requested review of D6582: Refactor swh scheduler services using a single unit file template.
Oct 28 2021, 4:13 PM
jayeshv triaged T3698: Deprecate origin directory routes as Normal priority.
Oct 28 2021, 3:50 PM · Web app
jayeshv triaged T3697: Deprecate origin content routes as Normal priority.
Oct 28 2021, 3:50 PM · Web app
ardumont closed D6581: loader: Rename ignore_history parameter to incremental.
Oct 28 2021, 3:49 PM
ardumont committed rDLDG670e8c837e9e: loader: Rename ignore_history parameter to incremental (authored by ardumont).
loader: Rename ignore_history parameter to incremental
Oct 28 2021, 3:49 PM
swh-public-ci added a comment to D6581: loader: Rename ignore_history parameter to incremental.

Build is green

Oct 28 2021, 3:46 PM
ardumont updated the diff for D6581: loader: Rename ignore_history parameter to incremental.

Revert coverage tryouts

Oct 28 2021, 3:42 PM
Harbormaster failed remote builds in B24803: Diff 23925 for D6581: loader: Rename ignore_history parameter to incremental!
Oct 28 2021, 3:40 PM
swh-public-ci added a comment to D6581: loader: Rename ignore_history parameter to incremental.

Build has FAILED

Oct 28 2021, 3:40 PM
ardumont updated the diff for D6581: loader: Rename ignore_history parameter to incremental.

Another tryout to add coverage, too much pg connection in previous iteration

Oct 28 2021, 3:38 PM
Harbormaster failed remote builds in B24801: Diff 23923 for D6581: loader: Rename ignore_history parameter to incremental!
Oct 28 2021, 3:33 PM
swh-public-ci added a comment to D6581: loader: Rename ignore_history parameter to incremental.

Build has FAILED

Oct 28 2021, 3:33 PM
Harbormaster failed remote builds in B24800: Diff 23922 for D6581: loader: Rename ignore_history parameter to incremental!
Oct 28 2021, 3:31 PM
swh-public-ci added a comment to D6581: loader: Rename ignore_history parameter to incremental.

Build has FAILED

Oct 28 2021, 3:31 PM
ardumont updated the diff for D6581: loader: Rename ignore_history parameter to incremental.

Fix typos and mistyped assertion

Oct 28 2021, 3:30 PM
swh-public-ci added a comment to D6578: Add support to filter files a minimum size.

Build is green

Oct 28 2021, 3:29 PM
ardumont updated the diff for D6581: loader: Rename ignore_history parameter to incremental.

Add missing coverage

Oct 28 2021, 3:28 PM
aeviso added a comment to D6578: Add support to filter files a minimum size.

Looks good, but could you update the diff and commit message to give the motivation for the change?

Oct 28 2021, 3:23 PM
aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Oct 28 2021, 3:23 PM
aeviso updated the summary of D6578: Add support to filter files a minimum size.
Oct 28 2021, 3:22 PM
vlorentz accepted D6581: loader: Rename ignore_history parameter to incremental.

thx

Oct 28 2021, 3:18 PM
vlorentz closed D6580: Fix/update description of the 'deposit admin' view..
Oct 28 2021, 3:17 PM
vlorentz committed rDWAPPS40f7d0d37cfc: Fix/update description of the 'deposit admin' view. (authored by vlorentz).
Fix/update description of the 'deposit admin' view.
Oct 28 2021, 3:17 PM
ardumont requested review of D6581: loader: Rename ignore_history parameter to incremental.
Oct 28 2021, 3:17 PM
ardumont accepted D6580: Fix/update description of the 'deposit admin' view..
Oct 28 2021, 3:13 PM
swh-public-ci added a comment to D6580: Fix/update description of the 'deposit admin' view..

Build is green

Oct 28 2021, 3:09 PM
ardumont closed D6576: loader: Rename start_from_scratch parameter to incremental.
Oct 28 2021, 3:05 PM
ardumont committed rDLDSVNed8c189b8258: loader: Rename start_from_scratch parameter to incremental (authored by ardumont).
loader: Rename start_from_scratch parameter to incremental
Oct 28 2021, 3:05 PM
vlorentz published D6580: Fix/update description of the 'deposit admin' view. for review.
Oct 28 2021, 3:01 PM
ardumont closed T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs, a subtask of T3035: Triage documentation in wiki, as Resolved.
Oct 28 2021, 3:00 PM · Documentation
ardumont closed T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs as Resolved.
Oct 28 2021, 3:00 PM · System administration, Documentation
vlorentz accepted D6576: loader: Rename start_from_scratch parameter to incremental.
Oct 28 2021, 3:00 PM
vlorentz retitled D6576: loader: Rename start_from_scratch parameter to incremental from loader: Rename start_from_scratch parameter to ignore_history to loader: Rename start_from_scratch parameter to incremental.
Oct 28 2021, 3:00 PM
ardumont added a comment to T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs.

All existing sysadm pages have been migration from the wiki and from the intranet to the docs.softwareheritage.org/sysadm pages.
The redirection have also been configured to those pages.

Oct 28 2021, 3:00 PM · System administration, Documentation
vlorentz added a comment to D6579: bin/update: Run 'pre-commit install' to setup the git hook..

Oh, I get it. the fixups we have are:

Oct 28 2021, 2:59 PM
ardumont updated the task description for T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs.
Oct 28 2021, 2:59 PM · System administration, Documentation
olasd added a comment to D6579: bin/update: Run 'pre-commit install' to setup the git hook..

That's supposed to already be handled by the fixup hook for each repo in .mrconfig, isn't it?

I'm not sure that's run each time though, is it?
At initial time yes, but afterwards...

Oct 28 2021, 2:58 PM
ardumont added a comment to D6579: bin/update: Run 'pre-commit install' to setup the git hook..

That's supposed to already be handled by the fixup hook for each repo in .mrconfig, isn't it?

Oct 28 2021, 2:57 PM
vlorentz abandoned D6579: bin/update: Run 'pre-commit install' to setup the git hook..

ah, right. it didn't run for me because I had unstaged changes

Oct 28 2021, 2:56 PM
ardumont updated the diff for D6574: scheduler: Add schedule recurrent tasks service.

Use correct repository to update the diff

Oct 28 2021, 2:55 PM
vlorentz accepted D6578: Add support to filter files a minimum size.

Looks good, but could you update the diff and commit message to give the motivation for the change?

Oct 28 2021, 2:55 PM
olasd added a comment to D6579: bin/update: Run 'pre-commit install' to setup the git hook..

That's supposed to already be handled by the fixup hook for each repo in .mrconfig, isn't it?

Oct 28 2021, 2:54 PM
ardumont added a comment to D6579: bin/update: Run 'pre-commit install' to setup the git hook..

ok but won't that slow things down even more?

Oct 28 2021, 2:54 PM
olasd requested changes to D6574: scheduler: Add schedule recurrent tasks service.

Looks like you've updated the wrong diff.

Oct 28 2021, 2:53 PM
vlorentz requested review of D6579: bin/update: Run 'pre-commit install' to setup the git hook..
Oct 28 2021, 2:52 PM
ardumont updated the task description for T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs.
Oct 28 2021, 2:52 PM · System administration, Documentation
ardumont updated the task description for T3154: sysadm docs: Move relevant and public doc from intranet to swh-docs.
Oct 28 2021, 2:52 PM · System administration, Documentation
olasd added a comment to D6570: Remove now useless revision date checker in fixer.

While we're here, could you check whether the other fixers are really still needed too?

Oct 28 2021, 2:51 PM
olasd accepted D6569: Add a --type option to 'swh storage replay'.

Maybe it would be worth expanding the existing cli test for this flag?

Oct 28 2021, 2:50 PM
aeviso closed D6577: Fix `yaml.load` deprecated warning.
Oct 28 2021, 2:48 PM
aeviso committed rDPROV30d8899bcfd6: Fix `yaml.load` deprecated warning (authored by aeviso).
Fix `yaml.load` deprecated warning
Oct 28 2021, 2:48 PM
swh-public-ci added a comment to D6578: Add support to filter files a minimum size.

Build is green

Oct 28 2021, 2:47 PM
ardumont closed D6573: Migrate openvpn page to the sysadm documentation.
Oct 28 2021, 2:46 PM
ardumont committed rDDOC7124c46038ca: Migrate openvpn page to the sysadm documentation (authored by ardumont).
Migrate openvpn page to the sysadm documentation
Oct 28 2021, 2:46 PM
swh-public-ci added a comment to D6576: loader: Rename start_from_scratch parameter to incremental.

Build is green

Oct 28 2021, 2:44 PM
ardumont updated the diff for D6576: loader: Rename start_from_scratch parameter to incremental.

Rename the parameter into incremental

Oct 28 2021, 2:42 PM
aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Oct 28 2021, 2:41 PM
Harbormaster failed to build B24789: rDJNLf92d4acf30e6: Pass the object_type to JournalClient.value_serializer() for rDJNLf92d4acf30e6: Pass the object_type to JournalClient.value_serializer()!
Oct 28 2021, 2:38 PM
douardda closed D6565: Pass the object_type to JournalClient.value_serializer().
Oct 28 2021, 2:34 PM
douardda committed rDJNLf92d4acf30e6: Pass the object_type to JournalClient.value_serializer() (authored by douardda).
Pass the object_type to JournalClient.value_serializer()
Oct 28 2021, 2:34 PM
douardda closed D6564: Do call consumer.commit() even if not objects have been received.
Oct 28 2021, 2:34 PM
douardda committed rDJNL88054da89653: Do call consumer.commit() even if not objects have been received (authored by douardda).
Do call consumer.commit() even if not objects have been received
Oct 28 2021, 2:34 PM
aeviso requested review of D6578: Add support to filter files a minimum size.
Oct 28 2021, 2:34 PM
swh-public-ci added a comment to D6572: interface: Add origin_snapshot_get_all method.

Build is green

Oct 28 2021, 2:33 PM
swh-public-ci added a comment to D6339: Add support for remote backend on existing storage tests.

Build is green

Oct 28 2021, 2:33 PM
anlambert added inline comments to D6572: interface: Add origin_snapshot_get_all method.
Oct 28 2021, 2:30 PM
anlambert retitled D6572: interface: Add origin_snapshot_get_all method from interface: Add origin_snapshot_get method to interface: Add origin_snapshot_get_all method.
Oct 28 2021, 2:29 PM
ardumont planned changes to D6576: loader: Rename start_from_scratch parameter to incremental.

actually changing to incremental.
Note that this also inverts the default value for that param.

Oct 28 2021, 2:29 PM
swh-public-ci added a comment to D6165: Add new RabbitMQ-based client/server API.

Build is green

Oct 28 2021, 2:29 PM
vlorentz accepted D6577: Fix `yaml.load` deprecated warning.
Oct 28 2021, 2:29 PM
swh-public-ci added a comment to D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

Build is green

Oct 28 2021, 2:27 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 28 2021, 2:26 PM
aeviso requested review of D6577: Fix `yaml.load` deprecated warning.
Oct 28 2021, 2:26 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Improve timeout logic on remote storage client side
Oct 28 2021, 2:26 PM
anlambert updated the diff for D6572: interface: Add origin_snapshot_get_all method.

Address @vlorentz comments

Oct 28 2021, 2:25 PM
anlambert added a comment to D6576: loader: Rename start_from_scratch parameter to incremental.

What about "incremental", for consistency with the listers' terminology?

Oct 28 2021, 2:24 PM
ardumont added a comment to D6576: loader: Rename start_from_scratch parameter to incremental.

What about "incremental", for consistency with the listers' terminology?

Oct 28 2021, 2:24 PM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Oct 28 2021, 2:24 PM