Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 9 2018

zack assigned T894: Vault: add limits for the max size of the objects that can be cooked to seirl.
Jan 9 2018, 12:43 PM · Restricted Project, Vault

Jan 8 2018

zack committed rDSNIP9b50858ac749: swh-dedup-blocks: add effective average block size to summary (authored by zack).
swh-dedup-blocks: add effective average block size to summary
Jan 8 2018, 1:49 PM
zack committed rDSNIP75e0a2d698bd: swh-dedup-blocks: fix typo in avg block size configuration (authored by zack).
swh-dedup-blocks: fix typo in avg block size configuration
Jan 8 2018, 1:49 PM
zack committed rDSNIP998d88cb4641: swh-dedup-blocks: add sample driver script (run.sh) (authored by zack).
swh-dedup-blocks: add sample driver script (run.sh)
Jan 8 2018, 1:49 PM
zack added a project to T919: deposit: support archive formats other than zip (e.g., tarballs): Restricted Project.
Jan 8 2018, 12:45 PM · Restricted Project, SWORD deposit
zack renamed T919: deposit: support archive formats other than zip (e.g., tarballs) from deposit: Improve tarball policy to deposit: support archive formats other than zip (e.g., tarballs).
Jan 8 2018, 12:44 PM · Restricted Project, SWORD deposit

Jan 7 2018

zack committed rDSNIP359fea8207e6: swh-dedup-blocks: multiprocess implementation (authored by zack).
swh-dedup-blocks: multiprocess implementation
Jan 7 2018, 10:52 PM
zack committed rDSNIPb9d742eed04f: swh-dedup-blocks: use postgres to store deduplication results (authored by zack).
swh-dedup-blocks: use postgres to store deduplication results
Jan 7 2018, 4:14 PM
zack committed rDSNIP567ad94a1ce0: move swh-dedup-blocks.py to dedicated dir (authored by zack).
move swh-dedup-blocks.py to dedicated dir
Jan 7 2018, 4:14 PM
zack committed rDSNIPe26a6cee53d0: swh-dedup-blocks: new script to play with (rabin) deduplication (authored by zack).
swh-dedup-blocks: new script to play with (rabin) deduplication
Jan 7 2018, 1:47 PM
zack created T918: document DB encoding requirements.
Jan 7 2018, 8:43 AM · Documentation, Storage manager

Jan 6 2018

zack committed rDSTO7b5c1114003b: db-init: actually grant privileges on tables and sequences (authored by zack).
db-init: actually grant privileges on tables and sequences
Jan 6 2018, 3:03 PM
zack committed rDSTOca308c702a05: sql/bin/db-init: new helper script to setup development DB (authored by zack).
sql/bin/db-init: new helper script to setup development DB
Jan 6 2018, 2:53 PM
zack committed rDSTOcf6cac74260c: SQL: move definition of hash_sha1() function to swh-func.sql (authored by zack).
SQL: move definition of hash_sha1() function to swh-func.sql
Jan 6 2018, 2:53 PM
zack renamed T917: Git loader: update README for YAML-based syntax from Git loader: update README for YAML-based syntax. to Git loader: update README for YAML-based syntax.
Jan 6 2018, 8:50 AM · Git loader, Documentation
zack created T917: Git loader: update README for YAML-based syntax.
Jan 6 2018, 8:50 AM · Git loader, Documentation

Jan 5 2018

zack committed rDOBJS74a6a959b271: strengthen check for object existence in path slicing object storage (authored by zack).
strengthen check for object existence in path slicing object storage
Jan 5 2018, 6:31 PM
zack committed rDOBJS7ff4c22a570b: specialize bare "except:" blocks (authored by zack).
specialize bare "except:" blocks
Jan 5 2018, 6:31 PM
zack committed R123:3153bdd6b298: port tests to Je suis GPL output (authored by zack).
port tests to Je suis GPL output
Jan 5 2018, 1:51 PM
zack committed R123:7cfc10996137: move version to .tarball-version (authored by zack).
move version to .tarball-version
Jan 5 2018, 1:32 PM
zack committed R123:40216583f788: add README, keeping upstream original as README-GNU-Hello (authored by zack).
add README, keeping upstream original as README-GNU-Hello
Jan 5 2018, 12:06 PM
zack committed R123:82e99a2cdc8b: .gitignore jesuisgpl-* distribution tarballs (authored by zack).
.gitignore jesuisgpl-* distribution tarballs
Jan 5 2018, 11:58 AM
zack committed R123:af1262fa8bb0: customize package name and metadata (authored by zack).
customize package name and metadata
Jan 5 2018, 11:54 AM
zack committed R123:1da7530e860f: customize greeting message for Je Suis GPL (authored by zack).
customize greeting message for Je Suis GPL
Jan 5 2018, 11:18 AM

Jan 4 2018

zack committed rDSNIPd6ccd4895d87: sql/anon-dump: fix typo in SQL statement (authored by zack).
sql/anon-dump: fix typo in SQL statement
Jan 4 2018, 2:50 PM

Jan 3 2018

zack committed rDSNIPd180b1655bb9: sql/anon-dump: fix bytea output format (authored by zack).
sql/anon-dump: fix bytea output format
Jan 3 2018, 6:07 PM
zack committed rDSNIP10f626fd7be4: check-in id-to-path, to have it have a stable place (authored by zack).
check-in id-to-path, to have it have a stable place
Jan 3 2018, 5:54 PM
zack committed rDSNIP70bd9cbf7c73: SQL queries (+ script) to produce an email-anonymized dump of the DB (authored by zack).
SQL queries (+ script) to produce an email-anonymized dump of the DB
Jan 3 2018, 5:45 PM
zack added a parent task for T883: set up a replica of the main DB on azure: T888: Deploy the Vault and a DB replica on Azure.
Jan 3 2018, 3:28 PM · Restricted Project, System administration
zack added a subtask for T888: Deploy the Vault and a DB replica on Azure: T883: set up a replica of the main DB on azure.
Jan 3 2018, 3:28 PM · System administration, Restricted Project, Vault
zack moved T845: Failure mode for Vault tasks from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:27 PM · Restricted Project, Vault
zack moved T883: set up a replica of the main DB on azure from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:27 PM · Restricted Project, System administration
zack moved T759: Web-based interface for browsing the archive (1st public version) from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:27 PM · Restricted Project, Web app
zack added a project to T888: Deploy the Vault and a DB replica on Azure: System administration.
Jan 3 2018, 3:26 PM · System administration, Restricted Project, Vault
zack moved T884: set up a web cache in front of the Web UI from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · Restricted Project, Web app, System administration
zack moved T884: set up a web cache in front of the Web UI from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · Restricted Project, Web app, System administration
zack moved T888: Deploy the Vault and a DB replica on Azure from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · System administration, Restricted Project, Vault
zack moved T893: Vault: get progress and fetch by bundle ID from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · Vault
zack moved T894: Vault: add limits for the max size of the objects that can be cooked from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · Restricted Project, Vault
zack moved T913: documentation for the vault from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Jan 3 2018, 3:26 PM · Web app, Documentation, Vault, Restricted Project
zack added a project to T759: Web-based interface for browsing the archive (1st public version): Restricted Project.
Jan 3 2018, 3:25 PM · Restricted Project, Web app
zack renamed T759: Web-based interface for browsing the archive (1st public version) from SWH Web UI: implement HTML interface for browsing the archive to Web-based interface for browsing the archive (1st public version).
Jan 3 2018, 3:25 PM · Restricted Project, Web app
zack triaged T888: Deploy the Vault and a DB replica on Azure as Normal priority.
Jan 3 2018, 3:22 PM · System administration, Restricted Project, Vault
zack lowered the priority of T913: documentation for the vault from High to Normal.
Jan 3 2018, 3:19 PM · Web app, Documentation, Vault, Restricted Project
zack added projects to T913: documentation for the vault: Vault, Documentation, Web app.
Jan 3 2018, 3:19 PM · Web app, Documentation, Vault, Restricted Project
zack created T913: documentation for the vault.
Jan 3 2018, 3:18 PM · Web app, Documentation, Vault, Restricted Project
zack updated subscribers of T884: set up a web cache in front of the Web UI.
Jan 3 2018, 3:14 PM · Restricted Project, Web app, System administration
zack raised the priority of T884: set up a web cache in front of the Web UI from Normal to High.
Jan 3 2018, 3:14 PM · Restricted Project, Web app, System administration
zack assigned T883: set up a replica of the main DB on azure to ftigeot.
Jan 3 2018, 3:14 PM · Restricted Project, System administration
zack raised the priority of T883: set up a replica of the main DB on azure from Normal to High.
Jan 3 2018, 3:14 PM · Restricted Project, System administration
zack raised the priority of T894: Vault: add limits for the max size of the objects that can be cooked from Normal to High.
Jan 3 2018, 3:13 PM · Restricted Project, Vault
zack added a project to T845: Failure mode for Vault tasks: Restricted Project.
Jan 3 2018, 3:13 PM · Restricted Project, Vault
zack added a project to T893: Vault: get progress and fetch by bundle ID: Restricted Project.
Jan 3 2018, 3:13 PM · Vault
zack edited projects for T889: Web API: add a user-friendly way to retrieve Vault bundles in /browse, added: Web app; removed Website.
Jan 3 2018, 3:12 PM · Web app, Vault
zack added a project to T883: set up a replica of the main DB on azure: Restricted Project.
Jan 3 2018, 3:10 PM · Restricted Project, System administration
zack added a project to T884: set up a web cache in front of the Web UI: Restricted Project.
Jan 3 2018, 3:10 PM · Restricted Project, Web app, System administration
zack created P208 ~/.pg_service.conf.
Jan 3 2018, 3:03 PM
zack removed a parent task for T718: SWORD deposit: backend server: T716: Integration HAL - Software Heritage (metatask).
Jan 3 2018, 10:33 AM · SWORD deposit
zack added a parent task for T647: support software deposit via SWORD protocol (meta task): T716: Integration HAL - Software Heritage (metatask).
Jan 3 2018, 10:33 AM · SWORD deposit, General
zack edited subtasks for T716: Integration HAL - Software Heritage (metatask), added: T647: support software deposit via SWORD protocol (meta task); removed: T718: SWORD deposit: backend server.
Jan 3 2018, 10:33 AM · SWORD deposit
zack renamed T718: SWORD deposit: backend server from HAL-SWH integration implementation to SWORD deposit: backend server.
Jan 3 2018, 10:32 AM · SWORD deposit
zack renamed T859: SWORD deposit: verify deposit on web-app from HAL-SWH: verify deposit on web-app to SWORD deposit: verify deposit on web-app.
Jan 3 2018, 10:31 AM · SWORD deposit
zack renamed T821: SWORD deposit - ingest deposed artifact from HAL-SWH - loading deposit to SWORD deposit - ingest deposed artifact.
Jan 3 2018, 10:31 AM · SWORD deposit
zack edited parent tasks for T820: HAL-SWH - connectivity tests, added: T912: integration with HAL for SWORD-based deposit (meta task); removed: T718: SWORD deposit: backend server.
Jan 3 2018, 10:30 AM · SWORD deposit
zack added a subtask for T912: integration with HAL for SWORD-based deposit (meta task): T820: HAL-SWH - connectivity tests.
Jan 3 2018, 10:30 AM · SWORD deposit (2018-09-25-HAL-opening)
zack removed a subtask for T718: SWORD deposit: backend server: T820: HAL-SWH - connectivity tests.
Jan 3 2018, 10:30 AM · SWORD deposit
zack added a project to T912: integration with HAL for SWORD-based deposit (meta task): SWORD deposit.
Jan 3 2018, 10:29 AM · SWORD deposit (2018-09-25-HAL-opening)
zack added a comment to T912: integration with HAL for SWORD-based deposit (meta task).

I'm splitting this from T647, as HAL integration is not the only use case for SWORD-based deposit.
Hosting complete & corresponding source code tarballs for compliance reasons is another one.

Jan 3 2018, 10:26 AM · SWORD deposit (2018-09-25-HAL-opening)
zack created T912: integration with HAL for SWORD-based deposit (meta task).
Jan 3 2018, 10:25 AM · SWORD deposit (2018-09-25-HAL-opening)

Dec 21 2017

zack accepted D282: db: use a thread instead of a tmpfile to COPY data to postgresql.

LGTM, and nice catch

Dec 21 2017, 8:06 PM

Dec 19 2017

zack committed rDSTO655bcb6b433a: doc generation: use more specific db-schema basename for images (authored by zack).
doc generation: use more specific db-schema basename for images
Dec 19 2017, 12:07 PM
zack committed rDSTOa455fc0220e0: docs: reference original db-schema.svg without symlink indirection (authored by zack).
docs: reference original db-schema.svg without symlink indirection
Dec 19 2017, 12:07 PM
zack committed rDDOC6ada88675b5d: delete old files from target dir upon doc installation (authored by zack).
delete old files from target dir upon doc installation
Dec 19 2017, 12:04 PM

Dec 18 2017

zack added a comment to T743: Vault: polish web-ui API.
In T743#16529, @seirl wrote:
  • shouldn't the format be a parameter instead of a part of the URL? i.e., ?format=foo instead of /foo at the end?

I see some reasons why not:

Dec 18 2017, 2:33 PM · Restricted Project, Web app, Vault
zack updated subscribers of T743: Vault: polish web-ui API.

First of all thanks for this useful summary @seirl !

Dec 18 2017, 12:04 PM · Restricted Project, Web app, Vault

Dec 15 2017

zack added a member for Reviewers: seirl.
Dec 15 2017, 1:59 PM
zack added a member for Reviewers: moranegg.
Dec 15 2017, 1:58 PM
zack added inline comments to D268: Add snapshot models.
Dec 15 2017, 1:35 PM

Dec 13 2017

zack accepted D277: Support snapshot identifiers in swh.model.

Thumbs up for the good work!
I like it.

Dec 13 2017, 10:54 AM

Dec 12 2017

zack added a project to T884: set up a web cache in front of the Web UI: Web app.
Dec 12 2017, 3:02 PM · Restricted Project, Web app, System administration
zack created T884: set up a web cache in front of the Web UI.
Dec 12 2017, 3:02 PM · Restricted Project, Web app, System administration
zack triaged T883: set up a replica of the main DB on azure as Normal priority.
Dec 12 2017, 3:00 PM · Restricted Project, System administration
zack created T883: set up a replica of the main DB on azure.
Dec 12 2017, 3:00 PM · Restricted Project, System administration

Dec 3 2017

zack committed rMSLDaad4c507ee42: check in slides for POSS talk (authored by zack).
check in slides for POSS talk
Dec 3 2017, 3:34 PM
zack committed rMSLD75340a2e8bcc: module vision: better spacing and sizing (authored by zack).
module vision: better spacing and sizing
Dec 3 2017, 3:34 PM
zack committed rMSLDbe856d478608: module source-code-different: add slide "software is everywhere" (authored by zack).
module source-code-different: add slide "software is everywhere"
Dec 3 2017, 3:34 PM

Dec 1 2017

zack raised the priority of T866: uffizi disk's full makes some workers fail from Normal to Unbreak Now!.
Dec 1 2017, 2:05 PM · System administration

Nov 22 2017

zack added a member for System administrators: seirl.
Nov 22 2017, 3:59 PM

Nov 21 2017

zack added inline comments to D270: add methods to storage for searching origins whose urls contain a string pattern or match a regular expression.
Nov 21 2017, 11:30 AM
zack added inline comments to D270: add methods to storage for searching origins whose urls contain a string pattern or match a regular expression.
Nov 21 2017, 11:22 AM

Nov 17 2017

zack created P195 (An Untitled Masterwork).
Nov 17 2017, 2:16 PM

Nov 15 2017

zack created T855: support directory entries pointing to revisions when loading directories.
Nov 15 2017, 9:53 PM · Directory loader
zack renamed T850: reschedule indexing of contents with bogus mimetype values from Schedule back bogus mimetype values for indexation to reschedule indexing of contents with bogus mimetype values.
Nov 15 2017, 12:25 PM · Archive content, Indexer

Nov 13 2017

zack added a comment to T809: move contents larger than current injection limit to separate object storage.

This is now done on uffizi.
Potentially remaining sub-tasks before closing this:

Nov 13 2017, 8:58 AM · Archive content

Nov 12 2017

zack claimed T809: move contents larger than current injection limit to separate object storage.

Updated SQL to also delete objects from tables that references them, e.g., the indexer ones.

Nov 12 2017, 10:53 AM · Archive content

Nov 10 2017

zack changed the join policy for Metadata workflow.
Nov 10 2017, 2:35 PM

Nov 8 2017

zack added a comment to T809: move contents larger than current injection limit to separate object storage.

thanks for the review, I've updated the SQL query accordingly

Nov 8 2017, 2:37 PM · Archive content
zack added a comment to T843: Vault: Add a "git bare" tarball cooker.

And what would be the actual on-the-wire serialization format used to send the bare repo to users? Some sort of archive of the .git dir or what?

Nov 8 2017, 10:29 AM · Vault

Nov 6 2017

zack added a comment to T335: specify the URI scheme swh:... to point to software heritage objects.

I'm not opposed to having explicit hash scheme names in the IDs—it is a good idea, only to be weighed against the cost in terms of length.
But we should also have schema version numbers, in case more radical changes will be needed in the future, e.g., renaming the object types in the graph.
If we retain both suggestions, that would give:

  • swh:1:revision:sha1_git:<git sha1 of a revision>
  • swh:1:content:blake2s256:<blake2s256 of a content>
Nov 6 2017, 3:04 PM · General

Nov 5 2017

zack added a comment to T829: Remove duplication between fetch_history and origin_visit.

(agreed)

Nov 5 2017, 8:27 PM · Storage manager, Archive content