Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 2 2022

olasd added inline comments to D8799: codemeta: Fix crash on SWORD documents that specify an id.
Nov 2 2022, 12:55 PM

Oct 27 2022

olasd accepted D8788: tests: Fix test_replay_content_static_group_id.

Oh wow, what an awful hack (I should know, I wrote it).

Oct 27 2022, 6:02 PM
olasd accepted D8782: templates/stage-cypress-tests: Prevent race condition with support file.

I'm a bit confused about who is copying what in there, but I trust your judgment...

Oct 27 2022, 6:00 PM
olasd committed rCDFJ49db710b38ad: Install cpio in base image (authored by olasd).
Install cpio in base image
Oct 27 2022, 2:24 PM
olasd committed rCDFJ3a34a564856d: Upgrade kafka to 3.3.1 (authored by olasd).
Upgrade kafka to 3.3.1
Oct 27 2022, 2:24 PM

Oct 26 2022

olasd added a comment to D8775: test_converters: Rename 'raw_manifest' to 'raw_string'.

Dulwich calls it "raw_string", so I went with that

Oct 26 2022, 2:16 PM
olasd committed rDSNIP8fe0cbf957b5: takedowns: Transparently compute ""origin SWHIDs"" (authored by olasd).
takedowns: Transparently compute ""origin SWHIDs""
Oct 26 2022, 11:41 AM

Oct 25 2022

olasd added a comment to T4644: replayer crashes on invalid directory entry name (b'gitter/gitter.xml').

This is now done, the objects are fixed in the production DB and kafka.

Oct 25 2022, 8:10 PM · Archive integrity, Object storage, Data Model
olasd added a comment to T4644: replayer crashes on invalid directory entry name (b'gitter/gitter.xml').

@vlorentz I'm running the following adaptation to your script:

Oct 25 2022, 7:03 PM · Archive integrity, Object storage, Data Model
olasd added a comment to D8151: [RFC] Add 'evolve' method to BaseModel objects.

Yeah, I think that makes sense. Time for these tests to be written? :)

Oct 25 2022, 6:19 PM
olasd accepted D8775: test_converters: Rename 'raw_manifest' to 'raw_string'.

must... resist... painting the bikeshed (git_manifest? git_object? raw_object?)

Oct 25 2022, 6:15 PM
olasd accepted D8776: converters: Replace '/' with '_' in directory entries.

Great, thanks!

Oct 25 2022, 6:14 PM
olasd closed D8770: Ensure origins are not visited faster than twice a day.
Oct 25 2022, 4:58 PM
olasd closed D8769: Refresh task type data from the database every time recurrent tasks are run.
Oct 25 2022, 4:58 PM
olasd committed rDSCHff75e742ee45: Ensure origins are not visited faster than twice a day (authored by olasd).
Ensure origins are not visited faster than twice a day
Oct 25 2022, 4:58 PM
olasd committed rDSCH1f9109fa4d66: Refresh task type data from the database every time recurrent tasks are run (authored by olasd).
Refresh task type data from the database every time recurrent tasks are run
Oct 25 2022, 4:58 PM
olasd closed D8768: Use json instead of msgpack for serializers.
Oct 25 2022, 4:58 PM
olasd committed rDSCHbde27a9e4262: Use json instead of msgpack for serializers (authored by olasd).
Use json instead of msgpack for serializers
Oct 25 2022, 4:58 PM
olasd updated the diff for D8770: Ensure origins are not visited faster than twice a day.

Rebase on updated D8769

Oct 25 2022, 4:50 PM
olasd updated the diff for D8769: Refresh task type data from the database every time recurrent tasks are run.

Variabilize task_name

Oct 25 2022, 4:50 PM
olasd closed D8771: client: redact sensitive consumer settings before logging them.
Oct 25 2022, 4:45 PM
olasd committed rDJNL1d879f1dd624: client: redact sensitive consumer settings before logging them (authored by olasd).
client: redact sensitive consumer settings before logging them
Oct 25 2022, 4:45 PM
olasd updated the diff for D8770: Ensure origins are not visited faster than twice a day.

Add tests for the new absolute_cooldown

Oct 25 2022, 4:43 PM
olasd requested review of D8771: client: redact sensitive consumer settings before logging them.
Oct 25 2022, 4:00 PM
olasd requested review of D8770: Ensure origins are not visited faster than twice a day.
Oct 25 2022, 3:56 PM
olasd requested review of D8769: Refresh task type data from the database every time recurrent tasks are run.
Oct 25 2022, 3:56 PM
olasd requested review of D8768: Use json instead of msgpack for serializers.
Oct 25 2022, 3:56 PM
olasd added inline comments to D8756: azure: Add tests based on Azurite in addition to mocks.
Oct 25 2022, 2:43 PM
olasd added inline comments to D8756: azure: Add tests based on Azurite in addition to mocks.
Oct 25 2022, 2:40 PM
olasd accepted D8765: Install Azurite in base docker image.
Oct 25 2022, 2:33 PM
olasd added inline comments to D8756: azure: Add tests based on Azurite in addition to mocks.
Oct 25 2022, 2:32 PM
olasd accepted D8756: azure: Add tests based on Azurite in addition to mocks.

This seems like a great idea.

Oct 25 2022, 1:45 PM
olasd added a comment to D8759: model: Add payload to ExtID class.

Anyway, I'm guessing it will fix itself when you send any update to the diff so let's ignore that issue for now.

This looks fine to me, though we might want to use something other than SHA1 for this.

We are currently in the process of moving the objstorage to multi-hashes, so eventually we will want to use multi-hashes here too. I wonder if we should do that before landing this diff (and D8760). It would be less effort overall, but will delay your work a bit.

eg. here it could be done by making payload a dictionary (with algos as keys and digests as values), and serialize the manifest as:

[payload_type $StrWithoutSpaces]
[payload blake2s256 $Hexdigest]
[payload sha1 $Hexdigest]
[payload sha1_git $Hexdigest]
[payload sha256 $Hexdigest]

@samplet @olasd What do you think?

Oct 25 2022, 1:22 PM
olasd added a comment to D8759: model: Add payload to ExtID class.

Hi, thanks for the diffs

It looks like using the --draft flag when sending this with arc has confused the CI system. The build failed because it couldn't access the updated code:

fatal: Couldn't find remote ref refs/tags/phabricator/diff/31582

It was because you hadn't signed the CLA when submitting the diff

Oct 25 2022, 1:14 PM

Oct 22 2022

olasd committed R263:2b12c984f5f7: Implement new "migrated" status in Phabricator (authored by olasd).
Implement new "migrated" status in Phabricator
Oct 22 2022, 2:36 PM
olasd committed R263:2d85b319fbba: Implement new "migrated" status in Phabricator (authored by olasd).
Implement new "migrated" status in Phabricator
Oct 22 2022, 2:35 PM
olasd committed R263:a9dcd5176446: Add a bunch more statuses recorded in Phabricator revisions (authored by olasd).
Add a bunch more statuses recorded in Phabricator revisions
Oct 22 2022, 2:12 PM

Oct 21 2022

olasd added a comment to T2513: Copy metadata on revisions to the extrinsic metadata storage.

I've relaunched the latest version of the migrate_extrinsic_metadata script on getty...

Oct 21 2022, 1:43 PM · Metadata workflow, Roadmap 2020

Oct 20 2022

olasd accepted D8696: tests: simplify and (possibly) fix the grpc_server helper context manager.

Woohoo, green tests!

Oct 20 2022, 3:18 PM
olasd added a comment to D8705: writer: make calling flush() in write_addition(s)() optional.

...ah... maybe, it's for other tests in another repository, right?

Oct 20 2022, 3:18 PM
olasd updated subscribers of D8705: writer: make calling flush() in write_addition(s)() optional.

@vlorentz mentions that this is missing a docstring change

Oct 20 2022, 3:18 PM
olasd added a comment to D8697: tests: make the kafka_server_base fixture a function scoped one.

Yeah, I'm a bit surprised too that this would decrease overall test times, and seems like a latent bug, but this at least doesn't seem to /increase/ test times in this module, so it's probably fine?

Oct 20 2022, 3:18 PM
olasd accepted D8705: writer: make calling flush() in write_addition(s)() optional.

If it's for test speedup only, don't you want to keep the actual behavior instead?
That is, make the auto_flush be False by default, and then you explicitely set it up to True in the calling tests.

Oct 20 2022, 3:18 PM
olasd committed rDSNIPb0425cf33b1e: takedowns: new code dump :-( (authored by olasd).
takedowns: new code dump :-(
Oct 20 2022, 3:18 PM
olasd archived Test tag please ignore.
Oct 20 2022, 3:18 PM

Oct 19 2022

olasd added a member for System administrators: gitlab-migration.
Oct 19 2022, 5:59 PM
olasd removed a member for System administrators: amadouth6.
Oct 19 2022, 5:59 PM
olasd committed rDSNIP6463f825569b: gitlab: Add script to lock migrated phabricator tasks (authored by olasd).
gitlab: Add script to lock migrated phabricator tasks
Oct 19 2022, 5:55 PM
olasd added a member for Staff: gitlab-migration.
Oct 19 2022, 4:05 PM
olasd closed T4617: Test task please ignore as Migrated.
Oct 19 2022, 4:02 PM
olasd assigned T4617: Test task please ignore to gitlab-migration.

This task was migrated to Gitlab

Oct 19 2022, 4:02 PM
olasd committed R263:bb3ac71cabc3: Implement a forced migration of some users (authored by olasd).
Implement a forced migration of some users
Oct 19 2022, 3:22 PM
olasd committed R263:5cf35727543d: Break out the `user-must-be-migrated` filter into a helper (authored by olasd).
Break out the `user-must-be-migrated` filter into a helper
Oct 19 2022, 3:22 PM
olasd reopened T4617: Test task please ignore as "Open".
Oct 19 2022, 2:28 PM
olasd closed T4617: Test task please ignore as Migrated.

Migrated to GitLab

Oct 19 2022, 2:27 PM
olasd changed the Default View Policy policy for application Maniphest from All Users to Public (No Login Required).
Oct 19 2022, 2:22 PM
olasd changed the edit policy for T4617: Test task please ignore.
Oct 19 2022, 2:19 PM
olasd shifted T4617: Test task please ignore from the Restricted Space space to the S1 Public space.
Oct 19 2022, 2:18 PM
olasd added inline comments to D8691: docs/grpc-api.rst: Add Python examples.
Oct 19 2022, 1:33 PM
olasd accepted D8743: debian/gbp-buildpackage: Use mirror of cassandra debian repository.

Thanks!

Oct 19 2022, 1:26 PM
olasd added a comment to T4617: Test task please ignore.
Oct 19 2022, 1:20 PM

Oct 18 2022

olasd committed rDSNIP2db58046fb27: gitlab: Testing before pushing considered good, actually. (authored by olasd).
gitlab: Testing before pushing considered good, actually.
Oct 18 2022, 2:38 PM
olasd committed rDSNIPdac6ea41a3d7: Add a simple script to manage gitlab group memberships (authored by olasd).
Add a simple script to manage gitlab group memberships
Oct 18 2022, 2:23 PM

Oct 17 2022

olasd committed rSPSITE35918e257de5: Give swhworker, olasd and ardumont direct access to tate for the GitLab… (authored by olasd).
Give swhworker, olasd and ardumont direct access to tate for the GitLab…
Oct 17 2022, 5:37 PM
olasd committed R263:2aff3cadfa49: Implement `default-branch-name` in vc-repository model (authored by olasd).
Implement `default-branch-name` in vc-repository model
Oct 17 2022, 5:26 PM
olasd added a project to T4617: Test task please ignore: Test tag please ignore.

This project has migrated to GitLab

Oct 17 2022, 4:27 PM
olasd removed a project from T4617: Test task please ignore: Test tag please ignore.
Oct 17 2022, 4:27 PM
olasd added a project to T4617: Test task please ignore: Test tag please ignore.
Oct 17 2022, 4:17 PM
olasd created Test tag please ignore.
Oct 17 2022, 4:17 PM
olasd committed R263:f38151294482: Repository archival is stored two different ways on phabricator (authored by olasd).
Repository archival is stored two different ways on phabricator
Oct 17 2022, 2:45 PM
olasd committed R263:25762bcbc547: Enable ssh's control socket persistence (authored by olasd).
Enable ssh's control socket persistence
Oct 17 2022, 12:20 PM
olasd committed R263:d953a637115d: Assume repositories with a custom view policy are private (authored by olasd).
Assume repositories with a custom view policy are private
Oct 17 2022, 12:20 PM
olasd committed R263:1b3d150274e3: Don't force push on the master branch, which is protected (authored by olasd).
Don't force push on the master branch, which is protected
Oct 17 2022, 12:20 PM
olasd committed R263:1379ec21d7f7: Actually perform repository archival at the end of the migration (authored by olasd).
Actually perform repository archival at the end of the migration
Oct 17 2022, 12:20 PM

Oct 16 2022

olasd committed R263:86ed60a73adb: Add archived status for exported repositories (authored by olasd).
Add archived status for exported repositories
Oct 16 2022, 11:52 PM
olasd committed R263:4f76d1d77b62: Improve the regexp for list headers again (authored by olasd).
Improve the regexp for list headers again
Oct 16 2022, 11:52 PM
olasd committed R263:2303f02afc4e: Finer-grained implementation of repository visibility (authored by olasd).
Finer-grained implementation of repository visibility
Oct 16 2022, 11:52 PM
olasd committed R263:ec4eafabc25c: Ensure ppcre scanners are only created once (authored by olasd).
Ensure ppcre scanners are only created once
Oct 16 2022, 11:52 PM
olasd committed R263:9d873c05b3ca: Improve mangling of check-list headers (authored by olasd).
Improve mangling of check-list headers
Oct 16 2022, 11:52 PM
olasd committed R263:fe924a51c389: Improve phabricator link parsing regexp (authored by olasd).
Improve phabricator link parsing regexp
Oct 16 2022, 11:52 PM
olasd committed R263:df821e0ef717: Tighten regexes when parsing phabricator notes (authored by olasd).
Tighten regexes when parsing phabricator notes
Oct 16 2022, 11:52 PM
olasd committed R263:f808ee1d6d5d: Implement fallback text for mapped items that aren't being migrated (authored by olasd).
Implement fallback text for mapped items that aren't being migrated
Oct 16 2022, 11:52 PM
olasd committed R263:b3e83f8dc9ed: Be more verbose when failing to unapprove merge requests (authored by olasd).
Be more verbose when failing to unapprove merge requests
Oct 16 2022, 11:52 PM
olasd committed R263:26f88365195d: Ensure git operations on MRs are only done once we've mapped the note… (authored by olasd).
Ensure git operations on MRs are only done once we've mapped the note…
Oct 16 2022, 11:52 PM
olasd committed R263:a5a64d3d6962: Try to avoid a race condition when updating merge request approvals (authored by olasd).
Try to avoid a race condition when updating merge request approvals
Oct 16 2022, 11:52 PM
olasd committed R263:a62a3697f259: Only update merge request event dates once, before recording the mapping (authored by olasd).
Only update merge request event dates once, before recording the mapping
Oct 16 2022, 11:52 PM
olasd committed R263:2433b215174a: Harden git repository manipulations on the gitlab export side (authored by olasd).
Harden git repository manipulations on the gitlab export side
Oct 16 2022, 11:52 PM
olasd committed R263:d2b24c59031e: Ensure merge-request actions are only mapped once (authored by olasd).
Ensure merge-request actions are only mapped once
Oct 16 2022, 11:52 PM
olasd committed R263:2fbf3c85288a: Add newlines in mapped files (authored by olasd).
Add newlines in mapped files
Oct 16 2022, 11:52 PM
olasd committed R263:34ce20466aef: When creating issue links, update system notes (authored by olasd).
When creating issue links, update system notes
Oct 16 2022, 11:52 PM
olasd committed R263:5430c201ed42: Give actions and notes more meaningful ids (authored by olasd).
Give actions and notes more meaningful ids
Oct 16 2022, 11:52 PM
olasd committed R263:10d003f2e7a0: Ensure all actions and notes have meaningful ids (authored by olasd).
Ensure all actions and notes have meaningful ids
Oct 16 2022, 11:52 PM
olasd committed R263:cb641ff0fbd1: Increase rails-command error wait times (authored by olasd).
Increase rails-command error wait times
Oct 16 2022, 11:52 PM
olasd committed R263:45cf46750ed1: Mark ticket actions in the gitlab mapping (authored by olasd).
Mark ticket actions in the gitlab mapping
Oct 16 2022, 11:52 PM
olasd committed R263:badfe92a19b9: Process merge request actions and notes in (interspersed) order (authored by olasd).
Process merge request actions and notes in (interspersed) order
Oct 16 2022, 11:52 PM
olasd committed R263:c768aec5ea06: Add newlines after each sexp in the gitlab mapping file (authored by olasd).
Add newlines after each sexp in the gitlab mapping file
Oct 16 2022, 11:52 PM
olasd committed R263:5a2c9f661362: Factor the way references to mapped items are translated (authored by olasd).
Factor the way references to mapped items are translated
Oct 16 2022, 11:52 PM
olasd committed R263:b515f9769962: Completely overhaul merge request action handling (authored by olasd).
Completely overhaul merge request action handling
Oct 16 2022, 11:52 PM
olasd committed R263:cf4270673d83: Improve commit comment (authored by olasd).
Improve commit comment
Oct 16 2022, 11:52 PM
olasd committed R263:1a7a110d0e2d: Ensure commit comment backlinks and events get updated (authored by olasd).
Ensure commit comment backlinks and events get updated
Oct 16 2022, 11:52 PM