Page MenuHomeSoftware Heritage
Feed All Stories

Apr 18 2019

anlambert added inline comments to D1425: assets: XSS filtering improvements.
Apr 18 2019, 5:48 PM
swh-public-ci added a comment to D1424: algos.revisions_walker: Handle missing revisions in the archive.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/376/ for more details.

Apr 18 2019, 5:40 PM
olasd accepted D1424: algos.revisions_walker: Handle missing revisions in the archive.
Apr 18 2019, 5:39 PM
vlorentz added inline comments to D1425: assets: XSS filtering improvements.
Apr 18 2019, 5:37 PM
anlambert updated the diff for D1424: algos.revisions_walker: Handle missing revisions in the archive.

Update: Address comments

Apr 18 2019, 5:34 PM
anlambert added a comment to D1424: algos.revisions_walker: Handle missing revisions in the archive.

T1677 created for implementing missing revision data notification.

Apr 18 2019, 5:25 PM
anlambert triaged T1677: Revisions walker: Add notification for truncated/shallow histories as Normal priority.
Apr 18 2019, 5:24 PM · Storage manager
vlorentz committed R186:40c3a606dfe0: use RAID0 for data disks (doubles the throughput cap). (authored by vlorentz).
use RAID0 for data disks (doubles the throughput cap).
Apr 18 2019, 5:22 PM
vlorentz committed R186:b532a5caf753: init db and scripts. (authored by vlorentz).
init db and scripts.
Apr 18 2019, 5:22 PM
anlambert added a comment to D1424: algos.revisions_walker: Handle missing revisions in the archive.

Could we find a way to return a flag saying "history truncated", "parent revision not found" or something more explicit than just returning "invalid" results silently?

Apr 18 2019, 5:09 PM
swh-public-ci added a comment to D1415: Add support for client side rendering of Jupyter notebooks.

Build is green
See https://jenkins.softwareheritage.org/job/DWAPPS/job/tox/395/ for more details.

Apr 18 2019, 5:05 PM
anlambert retitled D1415: Add support for client side rendering of Jupyter notebooks from [WIP] Add support for client side rendering of Jupyter notebooks to Add support for client side rendering of Jupyter notebooks.
Apr 18 2019, 5:02 PM
anlambert updated the summary of D1415: Add support for client side rendering of Jupyter notebooks.
Apr 18 2019, 5:02 PM
swh-public-ci added a comment to D1425: assets: XSS filtering improvements.

Build is green
See https://jenkins.softwareheritage.org/job/DWAPPS/job/tox/394/ for more details.

Apr 18 2019, 5:02 PM
anlambert updated the diff for D1415: Add support for client side rendering of Jupyter notebooks.
  • move the XSS filtering improvements in a separate diff (D1425)
Apr 18 2019, 5:02 PM
olasd added a comment to D1424: algos.revisions_walker: Handle missing revisions in the archive.

Just to be clear, the "history truncated" flag stuff can happen later, the new behavior after this minimal change is still better than just crashing

Apr 18 2019, 4:59 PM
Herald added a reviewer for D1425: assets: XSS filtering improvements: Reviewers.
Apr 18 2019, 4:58 PM
anlambert committed rDWAPPSb28e13b66f65: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Apr 18 2019, 4:57 PM
anlambert committed rDWAPPS3bb1a7090a4c: assets/config/bootstrap-pre-customize: Improve some stylesheets (authored by anlambert).
assets/config/bootstrap-pre-customize: Improve some stylesheets
Apr 18 2019, 4:57 PM
olasd requested changes to D1424: algos.revisions_walker: Handle missing revisions in the archive.

Please clarify the code and the commit message to say that this is handling truncated/shallow histories where a revision's parent is referenced but doesn't exist in the archive.

Apr 18 2019, 4:31 PM
swh-public-ci added a comment to D1424: algos.revisions_walker: Handle missing revisions in the archive.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/375/ for more details.

Apr 18 2019, 4:26 PM
swh-public-ci added a comment to D1423: Make sure that revision metadata is passed through from the caller.

Build is green
See https://jenkins.softwareheritage.org/job/DLDTAR/job/tox/107/ for more details.

Apr 18 2019, 4:22 PM
Herald added a reviewer for D1424: algos.revisions_walker: Handle missing revisions in the archive: Reviewers.
Apr 18 2019, 4:20 PM
olasd added a revision to T1676: Bug: the deposit metadata is not added to the revision while those are present: D1423: Make sure that revision metadata is passed through from the caller.
Apr 18 2019, 4:20 PM · SWORD deposit
olasd created D1423: Make sure that revision metadata is passed through from the caller.
Apr 18 2019, 4:20 PM
anlambert added a project to T1675: Fix message and error for artifact history view bug: Storage manager.
Apr 18 2019, 4:17 PM · Storage manager, Web app
moranegg renamed T1676: Bug: the deposit metadata is not added to the revision while those are present from The deposit metadata is not added to the revision (it is recieved) to Bug: the deposit metadata is not added to the revision (it is recieved).
Apr 18 2019, 4:04 PM · SWORD deposit
moranegg triaged T1676: Bug: the deposit metadata is not added to the revision while those are present as Unbreak Now! priority.
Apr 18 2019, 4:03 PM · SWORD deposit
anlambert added a comment to T1675: Fix message and error for artifact history view bug.

The bug is related to the fact that the parent revision of that deposit is not present in the archive (see https://archive.softwareheritage.org/browse/revision/3d4aadc83990ccda9cc94a554ca69f6dedb1e071/?origin=https://hal.archives-ouvertes.fr/hal-01897934).

Apr 18 2019, 3:42 PM · Storage manager, Web app
moranegg triaged T1675: Fix message and error for artifact history view bug as Normal priority.
Apr 18 2019, 3:31 PM · Storage manager, Web app
douardda added a comment to T1671: Implement a uniform and consistent cli to be used by all SWH packages.

This generic swh cli should be done so that is minimal dependency installed especially for "pure client" commands (e.g. swh.deposit's deposit or swh.model's identify tools).

Apr 18 2019, 3:14 PM · SWH command line interface
douardda added a parent task for T1651: Create a separate project for deposit-client: T1671: Implement a uniform and consistent cli to be used by all SWH packages.
Apr 18 2019, 3:03 PM · SWH command line interface, SWORD deposit
douardda added a subtask for T1671: Implement a uniform and consistent cli to be used by all SWH packages: T1651: Create a separate project for deposit-client.
Apr 18 2019, 3:03 PM · SWH command line interface
douardda added a parent task for T1658: Gather CLI tools spread in SWH packages: T1671: Implement a uniform and consistent cli to be used by all SWH packages.
Apr 18 2019, 3:02 PM · SWH command line interface
douardda added a subtask for T1671: Implement a uniform and consistent cli to be used by all SWH packages: T1658: Gather CLI tools spread in SWH packages.
Apr 18 2019, 3:02 PM · SWH command line interface
douardda triaged T1671: Implement a uniform and consistent cli to be used by all SWH packages as Normal priority.
Apr 18 2019, 3:02 PM · SWH command line interface
douardda updated the task description for T1651: Create a separate project for deposit-client.
Apr 18 2019, 2:59 PM · SWH command line interface, SWORD deposit
douardda updated the task description for T1651: Create a separate project for deposit-client.
Apr 18 2019, 2:57 PM · SWH command line interface, SWORD deposit
rdicosmo created T1667: Fix confusing duplication of "Archive" links on the main website.
Apr 18 2019, 2:48 PM · Website, Unknown Object (Project)
ftigeot added a comment to T1442: Replace Munin graphs with Grafana/Prometheus dashboards.

If we remove Munin before implementing missing graph replacements, we will lack a comparison base and possibly fail to discover bogus data.
Right now, Prometheus disk throughput and iops values are suspiciously low for example.

Apr 18 2019, 2:44 PM · Sprint 2018 12, System administration
douardda added a comment to T1658: Gather CLI tools spread in SWH packages.

Currently, we have:

Apr 18 2019, 11:49 AM · SWH command line interface
zack added a subtask for T1451: ingest GNU Savannah Git repositories: T1659: rewrite the CGit lister as a proper lister.
Apr 18 2019, 10:38 AM · Archive coverage
zack added a parent task for T1659: rewrite the CGit lister as a proper lister: T1451: ingest GNU Savannah Git repositories.
Apr 18 2019, 10:38 AM · CGit lister
zack triaged T1659: rewrite the CGit lister as a proper lister as Low priority.
Apr 18 2019, 10:38 AM · CGit lister
douardda closed T1599: Analyze objstorage's Azure updateness as Resolved.
Apr 18 2019, 10:35 AM · Sprint 2019 03
vlorentz committed R186:70615b994111: Start Cassandra. (authored by vlorentz).
Start Cassandra.
Apr 18 2019, 10:15 AM
vlorentz committed R186:9d9efb7e3d40: Initial commit, with VM provisioning. (authored by vlorentz).
Initial commit, with VM provisioning.
Apr 18 2019, 10:15 AM
zack renamed T1451: ingest GNU Savannah Git repositories from ingest savannah git repositories to ingest GNU Savannah Git repositories.
Apr 18 2019, 10:03 AM · Archive coverage
zack updated the task description for T1651: Create a separate project for deposit-client.
Apr 18 2019, 9:40 AM · SWH command line interface, SWORD deposit
douardda triaged T1658: Gather CLI tools spread in SWH packages as Normal priority.
Apr 18 2019, 9:36 AM · SWH command line interface
douardda added a project to T1651: Create a separate project for deposit-client: SWH command line interface.
Apr 18 2019, 9:25 AM · SWH command line interface, SWORD deposit
douardda created SWH command line interface.
Apr 18 2019, 9:25 AM
douardda added a comment to T1442: Replace Munin graphs with Grafana/Prometheus dashboards.

It is these graphs we are still missing.

Apr 18 2019, 9:19 AM · Sprint 2018 12, System administration

Apr 17 2019

ardumont closed T1643: Deposit client: Improve error handling, a subtask of T1581: Deposit: improvements, as Resolved.
Apr 17 2019, 11:22 PM · SWORD deposit
ardumont closed T1643: Deposit client: Improve error handling as Resolved.

Well, it turned out that it's already the case, there was just a racket hole... T1638

Apr 17 2019, 11:22 PM · SWORD deposit
ardumont renamed T1582: deposit: Update debian packages from deposit: Adapt debian package for the least surprise effect to deposit: Update debian packages.
Apr 17 2019, 11:20 PM · SWORD deposit
swh-public-ci added a comment to D1415: Add support for client side rendering of Jupyter notebooks.

Build is green
See https://jenkins.softwareheritage.org/job/DWAPPS/job/tox/393/ for more details.

Apr 17 2019, 10:42 PM
anlambert planned changes to D1415: Add support for client side rendering of Jupyter notebooks.
Apr 17 2019, 10:39 PM
anlambert updated the diff for D1415: Add support for client side rendering of Jupyter notebooks.
  • Add support for image rendering in the notebook when the src url is relative to a directory present in the swh archive
Apr 17 2019, 10:38 PM
ardumont updated subscribers of T1582: deposit: Update debian packages.

@zack @douardda @moranegg Latest adaptations packaged and deployed

Apr 17 2019, 7:11 PM · SWORD deposit
ardumont updated the task description for T1648: Change `url` and `external-id` from mandatory to optional metadata.
Apr 17 2019, 7:04 PM · SWORD deposit
ardumont added a comment to T1579: Deposit: Refactor tests using pytest.

The deposit cli is not though.

Apr 17 2019, 6:46 PM · SWORD deposit
vlorentz committed rDDOCcccdd2d4b3cc: Add missing deps of the dev setup guide. (authored by vlorentz).
Add missing deps of the dev setup guide.
Apr 17 2019, 5:22 PM
anlambert committed rDWAPPS76bba3681611: Makefile.local: Add test-fast target using swh-web-fast hypothesis profile (authored by anlambert).
Makefile.local: Add test-fast target using swh-web-fast hypothesis profile
Apr 17 2019, 4:23 PM
anlambert committed rDWAPPS17e61eb7758e: browse: Code and swh objects metadata cleanup (authored by anlambert).
browse: Code and swh objects metadata cleanup
Apr 17 2019, 4:23 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP5f218ee2a3f5: Updated backport on stretch-swh from debian/0.0.68-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on stretch-swh from debian/0.0.68-1_swh1 (unstable-swh)
Apr 17 2019, 3:51 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP4f97ea2f4bcf: Merge tag 'debian/0.0.68-1_swh1' into debian/stretch-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.0.68-1_swh1' into debian/stretch-swh
Apr 17 2019, 3:51 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP870b2ea8b650: New upstream version 0.0.68 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.0.68
Apr 17 2019, 3:50 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP80f031659944: pristine-tar data for swh-deposit_0.0.68.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-deposit_0.0.68.orig.tar.gz
Apr 17 2019, 3:50 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP87a25195f490: Updated version 0.0.68 from 'debian/upstream/0.0.68' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated version 0.0.68 from 'debian/upstream/0.0.68'
Apr 17 2019, 3:50 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDDEP80635f55e500: Updated debian changelog for version 0.0.68 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.0.68
Apr 17 2019, 3:50 PM
ardumont closed T1638: Deposit: error when submitting through cli, a subtask of T1581: Deposit: improvements, as Resolved.
Apr 17 2019, 3:42 PM · SWORD deposit
ardumont closed T1638: Deposit: error when submitting through cli as Resolved.
Apr 17 2019, 3:42 PM · SWORD deposit
ardumont closed T1650: Generate xml for SWORD protocol with deposit client, a subtask of T1646: Enable compliance scenario for deposits, as Resolved.
Apr 17 2019, 3:41 PM · SWORD deposit
ardumont closed T1650: Generate xml for SWORD protocol with deposit client as Resolved.
Apr 17 2019, 3:41 PM · SWORD deposit
ardumont committed rDDEPd075c56e7cd5: Remove unnecessary leftover check on no longer existing url fields (authored by ardumont).
Remove unnecessary leftover check on no longer existing url fields
Apr 17 2019, 3:39 PM
ardumont committed rDDEP708beba5c223: cli.deposit: Add mandatory flags to generate the metadata xml (authored by ardumont).
cli.deposit: Add mandatory flags to generate the metadata xml
Apr 17 2019, 3:39 PM
ardumont closed D1419: cli.deposit: Add mandatory flags to generate the metadata xml.
Apr 17 2019, 3:39 PM
swh-public-ci added a comment to D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/126/ for more details.

Apr 17 2019, 3:38 PM
swh-public-ci added a comment to D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/125/ for more details.

Apr 17 2019, 3:35 PM
ardumont updated the diff for D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Plug on master

Apr 17 2019, 3:35 PM
Harbormaster failed to build B5491: rDDEP793b0d18e453: deposit: Wrongly formatted xml should return a 400 bad request for rDDEP793b0d18e453: deposit: Wrongly formatted xml should return a 400 bad request!
Apr 17 2019, 3:33 PM
ardumont updated the diff for D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Rebase on latest master

Apr 17 2019, 3:32 PM
ardumont committed rDDEP3b19233c6d66: tests: Reformat some deposit tests (authored by ardumont).
tests: Reformat some deposit tests
Apr 17 2019, 3:32 PM
ardumont committed rDDEP793b0d18e453: deposit: Wrongly formatted xml should return a 400 bad request (authored by ardumont).
deposit: Wrongly formatted xml should return a 400 bad request
Apr 17 2019, 3:32 PM
ardumont closed D1422: deposit: Wrongly formatted xml should return a 400 bad request.
Apr 17 2019, 3:32 PM · SWORD deposit
swh-public-ci added a comment to D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/124/ for more details.

Apr 17 2019, 3:32 PM · SWORD deposit
swh-public-ci added a comment to D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/123/ for more details.

Apr 17 2019, 3:29 PM
moranegg accepted D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

After pairing with Ardumont, the updates are validated!

Apr 17 2019, 3:28 PM
ardumont updated the diff for D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Plug on master

Apr 17 2019, 3:26 PM · SWORD deposit
ardumont updated the diff for D1419: cli.deposit: Add mandatory flags to generate the metadata xml.
  • Remove unnecessary leftover check on no longer existing url fields
Apr 17 2019, 3:25 PM
moranegg accepted D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Validating this but we have some changes to do on the added test to follow a more restrictive grammar.

Apr 17 2019, 2:51 PM · SWORD deposit
moranegg accepted D1419: cli.deposit: Add mandatory flags to generate the metadata xml.

Blocked because I thought I can call swh-deposit like old times:-)
Now it is good for me (saw the slug changes live).

Apr 17 2019, 2:40 PM
vlorentz created P383 ansible_terraform.py.
Apr 17 2019, 2:33 PM
swh-public-ci added a comment to D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/122/ for more details.

Apr 17 2019, 2:25 PM · SWORD deposit
ardumont added a project to D1422: deposit: Wrongly formatted xml should return a 400 bad request: SWORD deposit.
Apr 17 2019, 2:24 PM · SWORD deposit
ardumont updated the diff for D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Fix typo and flake8 error

Apr 17 2019, 2:22 PM · SWORD deposit
Harbormaster failed remote builds in B5487: Diff 4615 for D1422: deposit: Wrongly formatted xml should return a 400 bad request!
Apr 17 2019, 2:20 PM · SWORD deposit
swh-public-ci added a comment to D1422: deposit: Wrongly formatted xml should return a 400 bad request.

Build has FAILED

Apr 17 2019, 2:20 PM · SWORD deposit
ardumont moved T1638: Deposit: error when submitting through cli from In progress to In code review on the SWORD deposit board.
Apr 17 2019, 2:20 PM · SWORD deposit