Page MenuHomeSoftware Heritage

vlorentz (Valentin Lorentz)
User

Projects

User Details

User Since
Oct 1 2018, 11:23 AM (29 w, 2 d)

Recent Activity

Yesterday

vlorentz committed R186:161bcd9639e1: Finish the long benchmarks. (authored by vlorentz).
Finish the long benchmarks.
Wed, Apr 24, 5:37 PM
vlorentz committed R186:b5196b9d8298: Add long benchmarks. (authored by vlorentz).
Add long benchmarks.
Wed, Apr 24, 5:23 PM
vlorentz closed T1691: metadata indexer: investigate metadata entries with empty mappings as Resolved.

We should investigate why they are there.

Wed, Apr 24, 5:22 PM · Archive content, Indexer
vlorentz closed T1691: metadata indexer: investigate metadata entries with empty mappings, a subtask of T1549: Clean up entries in {origin_intrinsic,revision}_metadata with no metadata, as Resolved.
Wed, Apr 24, 5:22 PM · Archive content, Indexer
vlorentz created D1432: Drop constraint on references of revision_metadata from origin_metadata..
Wed, Apr 24, 4:59 PM
vlorentz committed rDCIDX22175dbc20be: Don't store empty metadata dicts. (authored by vlorentz).
Don't store empty metadata dicts.
Wed, Apr 24, 3:30 PM
vlorentz closed D1335: Don't store empty metadata dicts..
Wed, Apr 24, 3:30 PM
vlorentz updated the diff for D1335: Don't store empty metadata dicts..
  • rebase
Wed, Apr 24, 3:30 PM
vlorentz added a comment to D1430: Correct typo "scrapping" -> "scraping".

@anlambert non-developers have been able to push accepted diffs to master in the past

Wed, Apr 24, 1:11 PM
vlorentz added a comment to D1430: Correct typo "scrapping" -> "scraping".

@anlambert That feature is only enabled on swh-storage, and I think it's broken anyway.

Wed, Apr 24, 12:11 PM
vlorentz committed R186:8c8c3f808478: Don't create the indexes 6 times... (authored by vlorentz).
Don't create the indexes 6 times...
Wed, Apr 24, 10:40 AM
vlorentz committed R186:9701a5c1b7a8: remove debug print. (authored by vlorentz).
remove debug print.
Wed, Apr 24, 10:40 AM
vlorentz committed R186:a9727ef6886d: New run of pg benchmark. (authored by vlorentz).
New run of pg benchmark.
Wed, Apr 24, 10:40 AM
vlorentz committed R186:6aa0a942a624: move plot data to a text file. (authored by vlorentz).
move plot data to a text file.
Wed, Apr 24, 10:40 AM

Tue, Apr 23

vlorentz committed R186:94e5f782b9a1: Apply permissions after db init. (authored by vlorentz).
Apply permissions after db init.
Tue, Apr 23, 4:15 PM
vlorentz committed R186:6b45fcfd8d5a: Add plot.py (authored by vlorentz).
Add plot.py
Tue, Apr 23, 4:15 PM
vlorentz committed R186:7a318f9b246a: Fix pgsql config. (authored by vlorentz).
Fix pgsql config.
Tue, Apr 23, 4:15 PM
vlorentz committed R186:7db9c7c2fbb9: Tell GNU Parallel not to eat error messages. (authored by vlorentz).
Tell GNU Parallel not to eat error messages.
Tue, Apr 23, 4:15 PM
vlorentz triaged T1684: Race condition on person insertion in pgsql storage as Low priority.
Tue, Apr 23, 9:38 AM · Storage manager

Fri, Apr 19

vlorentz triaged T1681: Use project metadata as a "lister" as Low priority.
Fri, Apr 19, 11:03 PM · Archive coverage, Indexer, Metadata workflow
vlorentz committed R186:a1fdedf5e77a: Change VM type for the client, as it's now CPU-bound. (authored by vlorentz).
Change VM type for the client, as it's now CPU-bound.
Fri, Apr 19, 6:00 PM
vlorentz committed R186:2cd74e7f479e: even the data distribution between servers. (authored by vlorentz).
even the data distribution between servers.
Fri, Apr 19, 6:00 PM
vlorentz committed R186:f152032f2ca5: fix bashrc (authored by vlorentz).
fix bashrc
Fri, Apr 19, 6:00 PM
vlorentz committed R186:d4a878afe5d7: 4 cassandra servers instead of 2. (authored by vlorentz).
4 cassandra servers instead of 2.
Fri, Apr 19, 6:00 PM
vlorentz committed R186:b9582cf381ae: Add pgsql server. (authored by vlorentz).
Add pgsql server.
Fri, Apr 19, 4:00 PM
vlorentz committed R186:c07461887d25: Wait for Cassandra to start before initializing the DB. (authored by vlorentz).
Wait for Cassandra to start before initializing the DB.
Fri, Apr 19, 4:00 PM

Thu, Apr 18

vlorentz requested changes to D1415: Add support for client side rendering of Jupyter notebooks.
Thu, Apr 18, 6:03 PM
vlorentz added inline comments to D1425: assets: XSS filtering improvements.
Thu, Apr 18, 5:50 PM
vlorentz added inline comments to D1425: assets: XSS filtering improvements.
Thu, Apr 18, 5:37 PM
vlorentz committed R186:40c3a606dfe0: use RAID0 for data disks (doubles the throughput cap). (authored by vlorentz).
use RAID0 for data disks (doubles the throughput cap).
Thu, Apr 18, 5:22 PM
vlorentz committed R186:b532a5caf753: init db and scripts. (authored by vlorentz).
init db and scripts.
Thu, Apr 18, 5:22 PM
vlorentz committed R186:70615b994111: Start Cassandra. (authored by vlorentz).
Start Cassandra.
Thu, Apr 18, 10:15 AM
vlorentz committed R186:9d9efb7e3d40: Initial commit, with VM provisioning. (authored by vlorentz).
Initial commit, with VM provisioning.
Thu, Apr 18, 10:15 AM

Wed, Apr 17

vlorentz committed rDDOCcccdd2d4b3cc: Add missing deps of the dev setup guide. (authored by vlorentz).
Add missing deps of the dev setup guide.
Wed, Apr 17, 5:22 PM
vlorentz created P383 ansible_terraform.py.
Wed, Apr 17, 2:33 PM
vlorentz created P382 test.tf.
Wed, Apr 17, 1:37 PM

Tue, Apr 16

vlorentz requested changes to D1420: Made changes to adapt it to new content_find return type.
Tue, Apr 16, 5:25 PM
vlorentz requested changes to D1420: Made changes to adapt it to new content_find return type.
Tue, Apr 16, 3:26 PM
vlorentz edited P379 (An Untitled Masterwork).
Tue, Apr 16, 11:24 AM
vlorentz created P379 (An Untitled Masterwork).
Tue, Apr 16, 11:24 AM
vlorentz committed rDSTO685b60180e4c: Make revision_add and directory_add call `_missing` using the same transaction. (authored by vlorentz).
Make revision_add and directory_add call `_missing` using the same transaction.
Tue, Apr 16, 10:27 AM
vlorentz closed D1417: Fix connection leaks in revision_add and directory_add..
Tue, Apr 16, 10:27 AM
vlorentz updated the diff for D1417: Fix connection leaks in revision_add and directory_add..

rebase

Tue, Apr 16, 10:27 AM
vlorentz closed D1413: Add a from_dict() method to model classes, that does the inverse of to_dict()..
Tue, Apr 16, 10:19 AM
vlorentz committed rDMODefc7e725991a: Add a from_dict() method to model classes, that does the inverse of to_dict(). (authored by vlorentz).
Add a from_dict() method to model classes, that does the inverse of to_dict().
Tue, Apr 16, 10:19 AM
vlorentz updated the diff for D1413: Add a from_dict() method to model classes, that does the inverse of to_dict()..

rebase

Tue, Apr 16, 10:17 AM

Mon, Apr 15

vlorentz added inline comments to D1413: Add a from_dict() method to model classes, that does the inverse of to_dict()..
Mon, Apr 15, 3:25 PM
vlorentz updated the diff for D1413: Add a from_dict() method to model classes, that does the inverse of to_dict()..

More doc.

Mon, Apr 15, 3:24 PM
vlorentz updated the diff for D1417: Fix connection leaks in revision_add and directory_add..

Fix commit message to match the actual source of the error.

Mon, Apr 15, 2:22 PM
vlorentz updated the diff for D1417: Fix connection leaks in revision_add and directory_add..

Better commit message.

Mon, Apr 15, 1:58 PM
Herald added a reviewer for D1417: Fix connection leaks in revision_add and directory_add.: Reviewers.
Mon, Apr 15, 12:43 PM
vlorentz accepted D1375: Phabricator/plugin: Add support for commented links.

Could you factorize this part:

Mon, Apr 15, 10:51 AM

Sat, Apr 13

vlorentz requested changes to D1288: Storage.content_find returns list instead of single value.
Sat, Apr 13, 10:50 AM

Fri, Apr 12

vlorentz added a comment to D1288: Storage.content_find returns list instead of single value.

Looking good!

Fri, Apr 12, 4:40 PM
vlorentz committed rDSTO3c0788962e43: Move converters to their own functions. (authored by vlorentz).
Move converters to their own functions.
Fri, Apr 12, 4:00 PM
vlorentz committed rDSTOd414b9f93e0e: Implement revision_{get,add,missing}. (authored by vlorentz).
Implement revision_{get,add,missing}.
Fri, Apr 12, 3:55 PM
vlorentz committed rDSTO246f238a2875: Hide Cassandra's output. (authored by vlorentz).
Hide Cassandra's output.
Fri, Apr 12, 3:55 PM
Herald added a reviewer for D1413: Add a from_dict() method to model classes, that does the inverse of to_dict().: Reviewers.
Fri, Apr 12, 3:51 PM
vlorentz requested changes to D1288: Storage.content_find returns list instead of single value.
Fri, Apr 12, 12:02 PM
vlorentz closed T1628: replayer: non reliability when fetching items from kafka as Resolved.
Fri, Apr 12, 10:01 AM · Journal

Thu, Apr 11

vlorentz committed rDSTOd2a446e7bee7: Add a Cassandra pytest fixture. (authored by vlorentz).
Add a Cassandra pytest fixture.
Thu, Apr 11, 5:42 PM
vlorentz accepted D1407: Fix backwards-compatibility for snapshot_add in the server.
Thu, Apr 11, 2:40 PM
vlorentz committed R65:a574fe51d41d: Add a new endpoint origin_visit_upsert to add an origin_visit with a specific… (authored by vlorentz).
Add a new endpoint origin_visit_upsert to add an origin_visit with a specific…
Thu, Apr 11, 12:20 PM
vlorentz committed R65:d110b5854d9d: Make content_add_metadata require a ctime argument. (authored by vlorentz).
Make content_add_metadata require a ctime argument.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:92a575f4b81d: Move Hypothesis strategies to swh-model. (authored by vlorentz).
Move Hypothesis strategies to swh-model.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:00e5f336ee25: Make test_origin_get_range run faster. (authored by vlorentz).
Make test_origin_get_range run faster.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:a62b1ad6bf80: Prevent the 'snapshots' hypothesis strategy from generating loops. (authored by vlorentz).
Prevent the 'snapshots' hypothesis strategy from generating loops.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:4c8a0ac1fba2: Make origin_add copy objects before changing them. (authored by vlorentz).
Make origin_add copy objects before changing them.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:ee62e0564393: Add a new endpoint content_add_metadata. (authored by vlorentz).
Add a new endpoint content_add_metadata.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:591371869eec: Refactor content_add's code into smaller functions. (authored by vlorentz).
Refactor content_add's code into smaller functions.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:81a995460e45: Don't leak origin ids to the journal. (authored by vlorentz).
Don't leak origin ids to the journal.
Thu, Apr 11, 12:20 PM
vlorentz committed R65:86308f6431a9: Make snapshot_add take an iterable of snapshot. (authored by vlorentz).
Make snapshot_add take an iterable of snapshot.
Thu, Apr 11, 12:19 PM
vlorentz committed R65:1ddb1453605e: Use sha1 instead of bigint as FK from origin_visit to snapshot (part 3: cleanup) (authored by vlorentz).
Use sha1 instead of bigint as FK from origin_visit to snapshot (part 3: cleanup)
Thu, Apr 11, 12:19 PM
vlorentz committed R65:7b56701b64d5: Use sha1 instead of bigint as FK from origin_visit to snapshot (part 2… (authored by vlorentz).
Use sha1 instead of bigint as FK from origin_visit to snapshot (part 2…
Thu, Apr 11, 12:19 PM
vlorentz committed R65:3457207b22b3: Add a new argument snapshot_id to origin_visit_update, and make all its… (authored by vlorentz).
Add a new argument snapshot_id to origin_visit_update, and make all its…
Thu, Apr 11, 12:19 PM
vlorentz committed R65:742dd4fa8958: Split Storage.snapshot_add (add the snapshot + update the origin_visit) (authored by vlorentz).
Split Storage.snapshot_add (add the snapshot + update the origin_visit)
Thu, Apr 11, 12:19 PM
vlorentz committed R65:a150fdf05763: Use sha1 instead of bigint as FK from origin_visit to snapshot (part 1: add new… (authored by vlorentz).
Use sha1 instead of bigint as FK from origin_visit to snapshot (part 1: add new…
Thu, Apr 11, 12:19 PM
vlorentz committed R65:246855c813a2: Add a new JournalWriter interface, which is notified by swh-storage before… (authored by vlorentz).
Add a new JournalWriter interface, which is notified by swh-storage before…
Thu, Apr 11, 12:19 PM
vlorentz committed R65:480e09808b4e: Fix import. (authored by vlorentz).
Fix import.
Thu, Apr 11, 12:19 PM
vlorentz committed R65:8bbbf9f2e0c9: Add an helper function to list all origins in the storage. (authored by vlorentz).
Add an helper function to list all origins in the storage.
Thu, Apr 11, 12:19 PM
vlorentz committed R65:c533d6e9c76a: Double the timeout of revision_get. (authored by vlorentz).
Double the timeout of revision_get.
Thu, Apr 11, 12:19 PM
vlorentz committed R65:006d102df4f3: Double the timeout of snapshot_get_latest. (authored by vlorentz).
Double the timeout of snapshot_get_latest.
Thu, Apr 11, 12:19 PM
vlorentz committed R65:152cb528234f: Move origin_get_range's right after origin_get. (authored by vlorentz).
Move origin_get_range's right after origin_get.
Thu, Apr 11, 12:19 PM
vlorentz committed rDCIDX669998e6cbac: Better explain what the 'string fields' are. (authored by vlorentz).
Better explain what the 'string fields' are.
Thu, Apr 11, 11:37 AM
vlorentz closed D1405: Better explain what the 'string fields' are..
Thu, Apr 11, 11:37 AM
vlorentz accepted D1404: tasks: fix handling of unsupported promise.save() calls.

That code (and the lines before) look very similar to each other.

Thu, Apr 11, 11:10 AM
vlorentz created D1405: Better explain what the 'string fields' are..
Thu, Apr 11, 11:08 AM
vlorentz added inline comments to D1288: Storage.content_find returns list instead of single value.
Thu, Apr 11, 10:08 AM
vlorentz requested changes to D1288: Storage.content_find returns list instead of single value.
Thu, Apr 11, 10:08 AM
vlorentz accepted D1398: cli_utils: Use yaml.safe_load instead of yaml.load.
Thu, Apr 11, 10:03 AM
vlorentz committed rDJNL730f4b911942: Make the replayer insert objects in batches. (authored by vlorentz).
Make the replayer insert objects in batches.
Thu, Apr 11, 9:59 AM
vlorentz closed D1395: Make the replayer insert objects in batches..
Thu, Apr 11, 9:59 AM

Wed, Apr 10

vlorentz committed rDSCHb644006489e8: Fix support of latest versions of swh-core and psycopg2. (authored by vlorentz).
Fix support of latest versions of swh-core and psycopg2.
Wed, Apr 10, 6:55 PM
vlorentz closed D1397: Fix support of latest versions of swh-core and psycopg2..
Wed, Apr 10, 6:55 PM
vlorentz updated the diff for D1397: Fix support of latest versions of swh-core and psycopg2..

rebase

Wed, Apr 10, 6:55 PM
vlorentz updated the diff for D1397: Fix support of latest versions of swh-core and psycopg2..

RealDictRow is not a real dict.

Wed, Apr 10, 3:57 PM
vlorentz updated the diff for D1397: Fix support of latest versions of swh-core and psycopg2..

rebase

Wed, Apr 10, 3:41 PM
Herald added a reviewer for D1397: Fix support of latest versions of swh-core and psycopg2.: Reviewers.
Wed, Apr 10, 3:40 PM
vlorentz added inline comments to D1395: Make the replayer insert objects in batches..
Wed, Apr 10, 3:08 PM
vlorentz added inline comments to D1395: Make the replayer insert objects in batches..
Wed, Apr 10, 3:07 PM