Page MenuHomeSoftware Heritage
Feed All Stories

Jan 27 2022

zack added a comment to T3887: Storing multiple authors in Revisions and Releases.

Then let's just go for it (insert here ref. to upcoming separate task :-)).

Jan 27 2022, 6:00 PM · SWORD deposit, Data Model, BZR loader
olasd added a comment to T3887: Storing multiple authors in Revisions and Releases.
In T3887#77951, @zack wrote:

Do you foresee any issue in adding extra_headers to releases as well, other than "someone should do it"?

Jan 27 2022, 5:54 PM · SWORD deposit, Data Model, BZR loader
zack added a comment to T3887: Storing multiple authors in Revisions and Releases.
In T3887#77949, @olasd wrote:

Now that I've written it out loud, of course, Releases don't have extra_headers so the package loaders can't make use of this workaround/hack for now.

Jan 27 2022, 5:40 PM · SWORD deposit, Data Model, BZR loader
olasd added a comment to T3887: Storing multiple authors in Revisions and Releases.

Now that I've written it out loud, of course, Releases don't have extra_headers so the package loaders can't make use of this workaround/hack for now.

Jan 27 2022, 5:34 PM · SWORD deposit, Data Model, BZR loader
olasd renamed T3887: Storing multiple authors in Revisions and Releases from Storing multiple authors to Storing multiple authors in Revisions and Releases.
Jan 27 2022, 5:30 PM · SWORD deposit, Data Model, BZR loader
olasd added a comment to T3887: Storing multiple authors in Revisions and Releases.

From merged tasks, this would also be useful for some package loaders, e.g. npm, that support multiple authors in their packaging metadata.

Jan 27 2022, 5:29 PM · SWORD deposit, Data Model, BZR loader
olasd merged task T1645: Associating multiple authors to a revision into T3887: Storing multiple authors in Revisions and Releases.
Jan 27 2022, 5:28 PM · Data Model
olasd merged task T3284: Support for multiple revision authors? into T3887: Storing multiple authors in Revisions and Releases.
Jan 27 2022, 5:28 PM · Data Model
olasd merged tasks T1645: Associating multiple authors to a revision, T3284: Support for multiple revision authors? into T3887: Storing multiple authors in Revisions and Releases.
Jan 27 2022, 5:28 PM · SWORD deposit, Data Model, BZR loader
olasd lowered the priority of T3887: Storing multiple authors in Revisions and Releases from Normal to Wishlist.
Jan 27 2022, 5:27 PM · SWORD deposit, Data Model, BZR loader
olasd added a comment to T3887: Storing multiple authors in Revisions and Releases.

Practically, we could be storing the metadata on additional authors *now* in the extra_headers field (make them a bunch of (b'author', b'XXX <yyy@zzz.ttt>') entries). Of course, that doesn't solve the question of presenting the information.

Jan 27 2022, 5:26 PM · SWORD deposit, Data Model, BZR loader
olasd added a comment to T3888: Storing associated bugs.

Is this information fully intrinsic, or can it be modified without the revision id changing ?

Jan 27 2022, 5:15 PM · BZR loader
vlorentz committed rDSNIPe944cc63ffd3: recheck_consistency.py: Reuse code from the backfiller. (authored by vlorentz).
recheck_consistency.py: Reuse code from the backfiller.
Jan 27 2022, 4:17 PM
ardumont closed T3895: Vagrant: node outside of the default production environment have their fqdn wronly defined as Resolved.
Jan 27 2022, 4:10 PM · System administration
ardumont added a comment to T3895: Vagrant: node outside of the default production environment have their fqdn wronly defined.

Diff fixed it ^

Jan 27 2022, 4:10 PM · System administration
ardumont updated the diff for D7045: Migrate sentry node to admin vlan.

Rebase

Jan 27 2022, 4:10 PM
ardumont closed D7046: vagrant: Fix dns search domains per deployment.
Jan 27 2022, 4:10 PM
ardumont committed rSPSITEfb4be9b6ce18: vagrant: Fix dns search domains per deployment (authored by ardumont).
vagrant: Fix dns search domains per deployment
Jan 27 2022, 4:10 PM
ardumont updated the diff for D7046: vagrant: Fix dns search domains per deployment.

Rebase

Jan 27 2022, 4:09 PM
vsellier accepted D7046: vagrant: Fix dns search domains per deployment.

LGTM, it's not really ideal but it avoid to break the current subnet spliting we are using

Jan 27 2022, 4:09 PM
Alphare added a task to D6344: Non-incremental, non-delta Bazaar/Breezy loader: T3887: Storing multiple authors in Revisions and Releases.
Jan 27 2022, 4:06 PM
Alphare added a revision to T3887: Storing multiple authors in Revisions and Releases: D6344: Non-incremental, non-delta Bazaar/Breezy loader.
Jan 27 2022, 4:06 PM · SWORD deposit, Data Model, BZR loader
Alphare closed T3888: Storing associated bugs as Resolved.
Jan 27 2022, 4:05 PM · BZR loader
ardumont updated the diff for D7046: vagrant: Fix dns search domains per deployment.

Update

Jan 27 2022, 4:03 PM
ardumont requested review of D7046: vagrant: Fix dns search domains per deployment.
Jan 27 2022, 4:01 PM
ardumont added a revision to T3895: Vagrant: node outside of the default production environment have their fqdn wronly defined: D7046: vagrant: Fix dns search domains per deployment.
Jan 27 2022, 4:01 PM · System administration
swh-public-ci added a comment to D7021: Add graph dataset reading classes (orc+edges).

Build is green

Jan 27 2022, 3:52 PM
ardumont added a project to T3895: Vagrant: node outside of the default production environment have their fqdn wronly defined: System administration.
Jan 27 2022, 3:50 PM · System administration
ardumont triaged T3895: Vagrant: node outside of the default production environment have their fqdn wronly defined as Normal priority.
Jan 27 2022, 3:50 PM · System administration
seirl updated the diff for D7021: Add graph dataset reading classes (orc+edges).

Fix docstring

Jan 27 2022, 3:49 PM
swh-public-ci added a comment to D7021: Add graph dataset reading classes (orc+edges).

Build is green

Jan 27 2022, 3:47 PM
seirl updated the diff for D7021: Add graph dataset reading classes (orc+edges).

Remove dead code

Jan 27 2022, 3:44 PM
ardumont added inline comments to D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 3:44 PM
ardumont added a comment to D7045: Migrate sentry node to admin vlan.

What's currently missing [1] in the state of the diff is the icinga check on the sentry service (moved to rp1).
With the proper means to define the http_uri value.

Jan 27 2022, 3:43 PM
vlorentz added inline comments to D7021: Add graph dataset reading classes (orc+edges).
Jan 27 2022, 3:39 PM
vlorentz added inline comments to D7021: Add graph dataset reading classes (orc+edges).
Jan 27 2022, 3:39 PM
olasd added inline comments to D7021: Add graph dataset reading classes (orc+edges).
Jan 27 2022, 3:36 PM
vlorentz committed rDSNIP7b95d164632b: recheck_consistency.py: Better docstring (authored by vlorentz).
recheck_consistency.py: Better docstring
Jan 27 2022, 3:13 PM
douardda updated the task description for T3894: Add a 'swh db upgrade' cli.
Jan 27 2022, 3:10 PM · Core & foundations
vlorentz committed rDSNIP0e0ca6ce6932: Add recheck_consistency.py (authored by vlorentz).
Add recheck_consistency.py
Jan 27 2022, 3:09 PM
douardda triaged T3894: Add a 'swh db upgrade' cli as High priority.
Jan 27 2022, 3:07 PM · Core & foundations
douardda closed T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage as Resolved.

yeah!

Jan 27 2022, 2:21 PM · Journal
douardda closed T1279: swh-journal: The schema migration problem, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Wontfix.
Jan 27 2022, 2:21 PM · Journal
douardda closed T1279: swh-journal: The schema migration problem as Wontfix.

See T3893 instead.

Jan 27 2022, 2:21 PM · Journal
douardda renamed T3893: Version swh schema from Make the swh schema versioned to Version swh schema .
Jan 27 2022, 2:18 PM · Data Model
douardda updated the task description for T3893: Version swh schema .
Jan 27 2022, 2:16 PM · Data Model
vlorentz added a project to T3893: Version swh schema : Data Model.
Jan 27 2022, 2:13 PM · Data Model
douardda added a comment to T3893: Version swh schema .

From IRC:

Jan 27 2022, 2:13 PM · Data Model
vlorentz renamed T3893: Version swh schema from Make the swh schema versionned to Make the swh schema versioned .
Jan 27 2022, 2:13 PM · Data Model
douardda triaged T3893: Version swh schema as High priority.
Jan 27 2022, 2:09 PM · Data Model
ardumont updated the test plan for D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 2:09 PM
douardda created T3893: Version swh schema .
Jan 27 2022, 2:09 PM · Data Model
ardumont added inline comments to D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 2:08 PM
ardumont updated the diff for D7045: Migrate sentry node to admin vlan.

Add misses changes

Jan 27 2022, 2:07 PM
ardumont updated the diff for D7045: Migrate sentry node to admin vlan.

Use correct range of commits

Jan 27 2022, 2:03 PM
ardumont updated the test plan for D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 2:03 PM
douardda closed T1481: add metric to monitor "save code now" efficiency, a subtask of T1408: More/better Metrics, as Resolved.
Jan 27 2022, 1:45 PM · Metrics/monitoring, Sprint 2018 12
douardda closed T1481: add metric to monitor "save code now" efficiency as Resolved.

we can always improve it, but now we have a decent dashboard, so let's consider this done.

Jan 27 2022, 1:45 PM · Save Code Now, System administration, Metrics/monitoring
douardda closed T1481: add metric to monitor "save code now" efficiency, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jan 27 2022, 1:45 PM · Save Code Now, meta-task, Roadmap 2021, Web app
douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors, a subtask of T3197: Mirror: fix common issues of a replayer session, as Resolved.
Jan 27 2022, 1:43 PM · Mirror
douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors as Resolved.

Seems moslty ok, even if these errors still pop now and then in the logs.

Jan 27 2022, 1:43 PM · Mirror
moranegg closed T3766: Create SWH5YEARS page from events page, a subtask of T3757: Create events page on the website, as Resolved.
Jan 27 2022, 12:31 PM · Community Building, Unknown Object (Project), Website
moranegg closed T3766: Create SWH5YEARS page from events page as Resolved.
Jan 27 2022, 12:31 PM · Community Building, Unknown Object (Project), Website
vlorentz added inline comments to D6344: Non-incremental, non-delta Bazaar/Breezy loader.
Jan 27 2022, 12:08 PM
Alphare added a comment to T3888: Storing associated bugs.

That works for me

Jan 27 2022, 11:55 AM · BZR loader
Alphare added inline comments to D6344: Non-incremental, non-delta Bazaar/Breezy loader.
Jan 27 2022, 11:55 AM
ardumont updated the test plan for D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 11:54 AM
ardumont updated the diff for D7045: Migrate sentry node to admin vlan.

Adapt according to review

Jan 27 2022, 11:51 AM
ardumont added inline comments to D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 11:46 AM
moranegg committed rMSLDb8ec98f9f093: Add deposit with SWHID scenario diagram (authored by moranegg).
Add deposit with SWHID scenario diagram
Jan 27 2022, 11:41 AM
vsellier added inline comments to D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 11:38 AM
ardumont updated the test plan for D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 11:36 AM
vlorentz updated the task description for T3890: schema of timezones in the journal.
Jan 27 2022, 11:28 AM · Journal, Data Model
anlambert added inline comments to D7040: assets/vault: Trigger task creation when hitting enter key on modals.
Jan 27 2022, 11:15 AM
douardda triaged T3892: Add a dashboard/page with a summary of which version of swh components are running on which service/machine as Normal priority.
Jan 27 2022, 11:04 AM · System administration
vlorentz added inline comments to D6344: Non-incremental, non-delta Bazaar/Breezy loader.
Jan 27 2022, 11:02 AM
vlorentz added inline comments to D6344: Non-incremental, non-delta Bazaar/Breezy loader.
Jan 27 2022, 11:02 AM
ardumont accepted D7044: assets/save: Add origin browse link only for valid visit statuses.
Jan 27 2022, 10:52 AM
vsellier changed the status of T3889: Admin database backup from Open to Work in Progress.
Jan 27 2022, 10:50 AM · System administration
vsellier added a comment to T3889: Admin database backup.

Unfornunately I didn't find any tool supporting natively the backup of postgresql through zfs snapshots.
We have a couple of alternatives:

  • Use borg to to implement a clean backup of the postgresql data directory based on hooks [1]
  • Use a tool like pgbackrest[2], the backup type and storage target need to be choosen (S3, storage server, ...)
  • Implement a backup based on zfs snapshots, which should not be too complicated but we need to manage all the plumbing to deal with full/incremental backups and the history cleaning
Jan 27 2022, 10:50 AM · System administration
Alphare added a comment to D6344: Non-incremental, non-delta Bazaar/Breezy loader.

Arcanist is bugged with the new PHP 8.1, so I'll wait until I have addressed everything to try to re-send, in the mean time, some questions

Jan 27 2022, 10:47 AM
vlorentz added a comment to T3888: Storing associated bugs.

Should we have an ad-hoc coding of sorts?

Jan 27 2022, 10:39 AM · BZR loader
vlorentz claimed T3890: schema of timezones in the journal.
Jan 27 2022, 10:36 AM · Journal, Data Model
vsellier added a comment to P1269 quick and dirty postgresql backup script based on zfs snapshot.

related to T3889

Jan 27 2022, 10:26 AM
vsellier created P1269 quick and dirty postgresql backup script based on zfs snapshot.
Jan 27 2022, 10:25 AM
ardumont created P1268 snap' dat' vm.
Jan 27 2022, 10:16 AM
zack committed rMSLD4bf5d5d41819: check in recent presentations (authored by zack).
check in recent presentations
Jan 27 2022, 10:13 AM
ardumont requested review of D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 9:44 AM
ardumont added a revision to T3891: Migrate sentry to admin vlan: D7045: Migrate sentry node to admin vlan.
Jan 27 2022, 9:44 AM · System administration

Jan 26 2022

Alphare added a comment to T3888: Storing associated bugs.

It seems like the expected type of Tuple[Tuple[bytes, bytes], ...] does not offer any nesting opportunities. Should we have an ad-hoc coding of sorts? Am I just missing something?

Jan 26 2022, 10:42 PM · BZR loader
olasd created P1267 Command-Line Input.
Jan 26 2022, 9:46 PM
seirl updated the summary of D7021: Add graph dataset reading classes (orc+edges).
Jan 26 2022, 7:35 PM
seirl requested review of D7021: Add graph dataset reading classes (orc+edges).
Jan 26 2022, 7:21 PM
seirl closed D7038: ORC exporter: use ZST compression.
Jan 26 2022, 7:17 PM
seirl committed rDDATASET18c612bb9865: ORC exporter: use ZST compression (authored by seirl).
ORC exporter: use ZST compression
Jan 26 2022, 7:17 PM
olasd committed rSPSITEb4bc8a45a68a: Refresh key for deb.sury.org (authored by olasd).
Refresh key for deb.sury.org
Jan 26 2022, 5:36 PM
anlambert requested review of D7044: assets/save: Add origin browse link only for valid visit statuses.
Jan 26 2022, 4:54 PM
vlorentz added a comment to D6344: Non-incremental, non-delta Bazaar/Breezy loader.

I will have to retrace my steps, but yes, it's probably a good idea. Would a shell script work?

Jan 26 2022, 4:44 PM
vlorentz added a comment to T3888: Storing associated bugs.

extra_headers looks like the best way to do this.

Jan 26 2022, 4:43 PM · BZR loader
anlambert added a revision to T3848: Activate saved origin browse link only when loading data are available in database: D7044: assets/save: Add origin browse link only for valid visit statuses.
Jan 26 2022, 4:34 PM · Save Code Now, Web app