Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 20 2018

zack closed D430: getting_started: install swh packages in a virtualenv.
Sep 20 2018, 10:12 AM

Sep 19 2018

zack retitled D312: Fix scheduler listener on buster's celery version (4.1.0-4) from Fix scheduler listener on buster's celery version (4.1.0-4) to [WIP] Fix scheduler listener on buster's celery version (4.1.0-4).
Sep 19 2018, 8:00 PM
zack accepted D402: swh-py-template: Improve default repository template.
Sep 19 2018, 7:59 PM
zack added inline comments to D430: getting_started: install swh packages in a virtualenv.
Sep 19 2018, 7:50 PM
zack requested changes to D430: getting_started: install swh packages in a virtualenv.

looks good, thanks! only minor changes requested

Sep 19 2018, 6:26 PM
zack requested changes to D431: bin: use pip-swh-packages instead of manually looking at the dependencies.
Sep 19 2018, 6:21 PM
zack accepted D429: Generate snapshots with a PyPI-specific namespace convention.
Sep 19 2018, 6:03 PM
zack committed rDSTO332a1e17eea3: use /usr/bin/env python3 as shebang, to be nice to virtualenv (authored by zack).
use /usr/bin/env python3 as shebang, to be nice to virtualenv
Sep 19 2018, 5:19 PM
zack committed rDSCH53c822587aca: use /usr/bin/env python3 as shebang, to be nice to virtualenv (authored by zack).
use /usr/bin/env python3 as shebang, to be nice to virtualenv
Sep 19 2018, 5:19 PM
zack committed rDOBJSdc58bdc1f5df: use /usr/bin/env python3 as shebang, to be nice to virtualenv (authored by zack).
use /usr/bin/env python3 as shebang, to be nice to virtualenv
Sep 19 2018, 5:19 PM
zack committed rDLS26d855c796ed: use /usr/bin/env python3 as shebang, to be nice to virtualenv (authored by zack).
use /usr/bin/env python3 as shebang, to be nice to virtualenv
Sep 19 2018, 5:18 PM
zack committed rDSNIP20cb59c349bc: dump-swh-graph.sql: add support to dump snapshot table (authored by zack).
dump-swh-graph.sql: add support to dump snapshot table
Sep 19 2018, 5:15 PM
zack committed rDSNIPbc8ea627581b: use /usr/bin/env python3 as shebang, to be nice to virtualenv (authored by zack).
use /usr/bin/env python3 as shebang, to be nice to virtualenv
Sep 19 2018, 5:15 PM
zack added a comment to D424: Rework branch names to align them with git origins.
In D424#8216, @ardumont wrote:

I guess that concludes the discussion in D409 then (mercurial tags representation in swh model ~> snapshot with an equivalent naming convention).

Sep 19 2018, 3:54 PM
zack added inline comments to D424: Rework branch names to align them with git origins.
Sep 19 2018, 3:47 PM
zack added a comment to T1202: swh services: Monitor swh-worker@.service's status.

here's a random list of contributed icinga checks to monitor the state of a systemd service:

not tested and i'm not entirely sure to have looked in all the right places…

Sep 19 2018, 3:16 PM · Metrics/monitoring, System administration

Sep 18 2018

zack added a comment to T1179: Create an independent DNS resolver on Azure.
In T1179#22308, @olasd wrote:

The name server itself works but I had not pointed the azure hosts to this mirror yet.

We should also add monitoring to make sure the zones stay in sync.

Sep 18 2018, 3:04 PM · System administration
zack triaged T1201: monitor DNS zones on primary/replica to ensure they stay in sync as High priority.
Sep 18 2018, 3:04 PM · System administration
zack triaged T1200: point azure hosts to DNS running on azure as High priority.
Sep 18 2018, 3:04 PM · System administration
zack added a comment to T1117: Origin search is *slow* when you look for very common words.

Thanks for your analysis.

Sep 18 2018, 1:19 PM · Web app, Storage manager
zack committed rDDOC7f318086da9c: getting started: update webapp configuration file path (authored by zack).
getting started: update webapp configuration file path
Sep 18 2018, 11:48 AM
zack committed rDWAPPSb5e0537aced4: dev doc: fix dangling ref to webapp/webapp.yml (authored by zack).
dev doc: fix dangling ref to webapp/webapp.yml
Sep 18 2018, 11:46 AM

Sep 17 2018

zack committed rDDOC266fc3909800: getting-started: fix sphinx markup error (authored by zack).
getting-started: fix sphinx markup error
Sep 17 2018, 4:36 PM
zack committed rDDOC08369dd9890c: getting started: simplify web app step (authored by zack).
getting started: simplify web app step
Sep 17 2018, 3:33 PM
zack added a comment to T1198: webapp: Following getting started fails with node dependencies error.

https://forge.softwareheritage.org/tag/unreproducible/

Sep 17 2018, 3:12 PM · Unreproducible, Documentation, Web app
zack lowered the priority of T1198: webapp: Following getting started fails with node dependencies error from Normal to Low.
Sep 17 2018, 3:09 PM · Unreproducible, Documentation, Web app
zack created Unreproducible.
Sep 17 2018, 3:09 PM
zack added a comment to T1198: webapp: Following getting started fails with node dependencies error.

Honestly, it would be too much of a hurdle. Using node/npm is quite common in web development today
and users who want to hack on the webapp locally should not be suprised about having to issue a 'npm install'
command before being able to run it (this is also explained in the README).

Sep 17 2018, 2:58 PM · Unreproducible, Documentation, Web app
zack updated subscribers of T1198: webapp: Following getting started fails with node dependencies error.

According to this log, we need at least 10.x:

Sep 17 2018, 1:51 PM · Unreproducible, Documentation, Web app
zack updated the task description for T1197: web app: missing static images when running locally.
Sep 17 2018, 12:14 PM · Web app
zack updated the task description for T1197: web app: missing static images when running locally.
Sep 17 2018, 12:14 PM · Web app
zack changed the visibility for F3300035: swh-web-app-missing-static.png.
Sep 17 2018, 12:14 PM
zack triaged T1197: web app: missing static images when running locally as Low priority.
Sep 17 2018, 12:14 PM · Web app
zack committed rDDOCe36394df09e6: getting started: highlight web app conffile as YAML (authored by zack).
getting started: highlight web app conffile as YAML
Sep 17 2018, 11:02 AM
zack added a comment to T1030: Provide a pip-compatible index of python modules.

now that T1193 is out of the door, i'm adding it a note about the need of updating the getting started doc when this is done

Sep 17 2018, 10:58 AM · System administration
zack committed rDDOC4d3271cf6f75: getting started: write web app section (authored by zack).
getting started: write web app section
Sep 17 2018, 10:55 AM
zack closed T1193: doc: write a developer-oriented walk-through on how to run a minimal swh stack locally as Resolved by committing rDDOC4d3271cf6f75: getting started: write web app section.
Sep 17 2018, 10:55 AM · Documentation
zack closed T918: document DB encoding requirements as Resolved.

db-init has been updated a while ago to force UTF8 encoding, and it is now the documented way to initialize the DB, so there is no need to further specify DB encoding requirements elsewhere

Sep 17 2018, 10:46 AM · Documentation, Storage manager
zack triaged T1196: web app default configuration file should be config/swh/web/web.yml as Low priority.
Sep 17 2018, 10:41 AM · Web app
zack added a comment to T1194: storage API server: nicer landing page.
In T1194#22202, @olasd wrote:

However I'd be happy for the static default landing pages to tell people that, and to point to the (static) API documentation of the respective components.

Sep 17 2018, 10:15 AM · Storage manager

Sep 16 2018

zack committed rDDOC6abc98f6a679: getting started: simplify doc around first code checkout (authored by zack).
getting started: simplify doc around first code checkout
Sep 16 2018, 9:39 AM
zack committed rDDOCab29d8e68a89: Sphinx theme: make sidebar fixed on the left (authored by zack).
Sphinx theme: make sidebar fixed on the left
Sep 16 2018, 9:15 AM
zack committed rDDOCe6fcae905018: getting started: add dependency installation documentation (authored by zack).
getting started: add dependency installation documentation
Sep 16 2018, 9:15 AM

Sep 15 2018

zack committed rDENVc4113de23840: bin/pip-*-deps: new helpers to list/install all PyPI dependencies (authored by zack).
bin/pip-*-deps: new helpers to list/install all PyPI dependencies
Sep 15 2018, 2:40 PM
zack committed rDENV017a36a00d79: bin/ls-py-modules: fail gracefully if not run from swh-environment (authored by zack).
bin/ls-py-modules: fail gracefully if not run from swh-environment
Sep 15 2018, 2:40 PM
zack committed rDLDHG075be34bd3a7: bundle20_reader: fix typo in comment (authored by zack).
bundle20_reader: fix typo in comment
Sep 15 2018, 2:32 PM
zack committed rDLDHG96259d960f49: requirements.txt: fix name of python hglib dependency (authored by zack).
requirements.txt: fix name of python hglib dependency
Sep 15 2018, 2:32 PM
zack committed rDSCH4f5199658bd3: requirements.txt: add spaces around dep expression (authored by zack).
requirements.txt: add spaces around dep expression
Sep 15 2018, 2:21 PM

Sep 14 2018

zack committed rDDOC2d5673ba30b1: getting started: fix non-referencable page anchor (authored by zack).
getting started: fix non-referencable page anchor
Sep 14 2018, 5:49 PM
zack committed rDDOC37eb63ec3f40: sphinx configuration: use explicit prefix for Python stdlib (authored by zack).
sphinx configuration: use explicit prefix for Python stdlib
Sep 14 2018, 5:49 PM
zack committed rDDOCdb135ffe7313: getting started: add local TOC and improve preamble (authored by zack).
getting started: add local TOC and improve preamble
Sep 14 2018, 5:30 PM
zack committed rDDOCf32dd91bcbb5: getting started doc: major additions, up to how to ingest repos (authored by zack).
getting started doc: major additions, up to how to ingest repos
Sep 14 2018, 5:23 PM
zack committed rDLDG5c0926072ddd: Git updated: make --origin-url CLI option required (authored by zack).
Git updated: make --origin-url CLI option required
Sep 14 2018, 5:21 PM
zack triaged T1195: git loader: fail to ingest our own hello world repository as Normal priority.
Sep 14 2018, 5:01 PM · Git loader
zack triaged T1194: storage API server: nicer landing page as Low priority.
Sep 14 2018, 4:26 PM · Storage manager
zack committed rDENV05a89d469460: bin/update: update to auto-trust .mrconfig upon first use (authored by zack).
bin/update: update to auto-trust .mrconfig upon first use
Sep 14 2018, 1:47 PM
zack committed rDDOC6800366534b0: skeleton of a getting-started walk-through for developers (authored by zack).
skeleton of a getting-started walk-through for developers
Sep 14 2018, 11:50 AM
zack changed the status of T1193: doc: write a developer-oriented walk-through on how to run a minimal swh stack locally from Open to Work in Progress.
Sep 14 2018, 11:49 AM · Documentation
zack renamed T1193: doc: write a developer-oriented walk-through on how to run a minimal swh stack locally from doc: write developer-oriented walkthrough on how to run a minimal swh stack locally to doc: write a developer-oriented walk-through on how to run a minimal swh stack locally.
Sep 14 2018, 11:49 AM · Documentation
zack triaged T1193: doc: write a developer-oriented walk-through on how to run a minimal swh stack locally as Normal priority.
Sep 14 2018, 11:49 AM · Documentation

Sep 12 2018

zack requested changes to D409: Use mercurial tags as named pointer (referenced in the snapshot).

So, as discussed today f2f, I don't like getting rid of release objects. For at least a couple of reasons.

Sep 12 2018, 1:12 PM
zack added a comment to T1186: Web-app: save code now accepts url of users for github and fails.

The idea of using a chain of responsibility where loaders can check specific URL is indeed nice and elegant.

Sep 12 2018, 12:00 PM · Web app

Sep 11 2018

zack added a comment to T570: svn loader: CRLF/LF mess in svn history results in hash computations divergence.

Based on my understanding, this property does not seem to be taken into account
when using the remote access replay api and thus the reconstructed files may
contain different line endings as those generated by 'svn export', so there is a
tree divergence.

Sep 11 2018, 8:21 AM · SVN Loader

Sep 10 2018

zack added a comment to T1186: Web-app: save code now accepts url of users for github and fails.

Nice catch.

Sep 10 2018, 5:05 PM · Web app
zack added a comment to T1185: Web-app: change wording of title for save code now feature.

less is more, I like "Save code now" best :-)

Sep 10 2018, 5:01 PM · Web app
zack triaged T1184: add ipres 2018 paper to the publication page as Normal priority.
Sep 10 2018, 9:01 AM · Website

Sep 7 2018

zack committed rDDOCf7e270a4838f: sphinx: create one apidoc page per module, including submodules (authored by zack).
sphinx: create one apidoc page per module, including submodules
Sep 7 2018, 1:45 PM
zack triaged T1183: doc generation for swh-web spits traceback(s) as Normal priority.
Sep 7 2018, 1:35 PM · Documentation, Web app
zack committed rDSTO384b12006403: docs: add description of the archive copies layout diagram (authored by zack).
docs: add description of the archive copies layout diagram
Sep 7 2018, 1:29 PM
zack added a project to T1182: deposit: apidoc generation fails on settings.production module with traceback: Documentation.
Sep 7 2018, 11:49 AM · Documentation, SWORD deposit
zack triaged T1182: deposit: apidoc generation fails on settings.production module with traceback as Normal priority.
Sep 7 2018, 11:49 AM · Documentation, SWORD deposit
zack committed rDSTOa66745a0d1e7: docs: add layout diagram describing existing archive copies (authored by zack).
docs: add layout diagram describing existing archive copies
Sep 7 2018, 11:39 AM

Sep 6 2018

zack renamed T1180: add munin monitoring of snapshot objects count from add over time monitoring of the amount of snapshot objects to add munin monitoring of snapshot objects count.
Sep 6 2018, 2:45 PM · Metrics/monitoring, System administration
zack triaged T1180: add munin monitoring of snapshot objects count as Normal priority.
Sep 6 2018, 2:45 PM · Metrics/monitoring, System administration
zack committed rDARC98284fd8f63c: docs: add link to archiver blueprint from homepage (authored by zack).
docs: add link to archiver blueprint from homepage
Sep 6 2018, 12:21 PM
zack committed rDSTO19c0344e3f59: algos/diff.py: fix typo in comment (authored by zack).
algos/diff.py: fix typo in comment
Sep 6 2018, 12:20 PM
zack committed rDSTO8ccac076d058: docs: add general intro, drop bogus reference to archiver blueprint (authored by zack).
docs: add general intro, drop bogus reference to archiver blueprint
Sep 6 2018, 12:20 PM
zack lowered the priority of T1176: Enable NUMA and PCID options on all VMs from Unbreak Now! to High.
Sep 6 2018, 12:00 PM · System administration

Sep 5 2018

zack triaged T1177: Vault: do a manual directory recursion in the directory builder as Normal priority.

rDSTO329d0f920895f22aa6c34cd317b8ce1674e869af is in fact a work-around for this

Sep 5 2018, 4:26 PM · Vault
zack accepted D405: cookers: readable message for SQL timeouts.

looks good to me, just two minor nits for your consideration:

Sep 5 2018, 2:35 PM
zack added a project to T1117: Origin search is *slow* when you look for very common words: Web app.
Sep 5 2018, 9:10 AM · Web app, Storage manager
zack updated subscribers of T1117: Origin search is *slow* when you look for very common words.

(pinging this issue, because it's 2018, and it really looks bad that we're apparently not capable of quickly returning results in our main search :-))

Sep 5 2018, 9:09 AM · Web app, Storage manager

Sep 4 2018

zack triaged T1175: renews SSL certificats for {www,}softwareheritage.org as Normal priority.
Sep 4 2018, 3:05 PM · System administration
zack raised the priority of T1173: Huge slowdowns on louvre since 2018-08-20 from Normal to Unbreak Now!.
Sep 4 2018, 3:02 PM · System administration
zack edited projects for T421: PyPI loader, added: PyPI loader; removed Developers.
Sep 4 2018, 10:30 AM · PyPI loader, Origin-Pypi
zack edited Description on PyPI loader.
Sep 4 2018, 10:27 AM
zack edited Description on PyPI loader.
Sep 4 2018, 10:27 AM
zack created PyPI loader.
Sep 4 2018, 10:24 AM
zack committed rDWAPPS60af24b871cc: git ignore npm cruft (authored by zack).
git ignore npm cruft
Sep 4 2018, 10:18 AM
zack committed rDWAPPSf738b47528b3: minor improvements to the titles of main web views (authored by zack).
minor improvements to the titles of main web views
Sep 4 2018, 10:18 AM
zack committed rDWAPPS2c151c5ad56b: fix a bunch of typos (authored by zack).
fix a bunch of typos
Sep 4 2018, 10:18 AM

Aug 31 2018

zack added a comment to T1174: Vault Integration tests & QA.

[ updated the message above in-place to add 3 and 4 ]

Aug 31 2018, 11:36 AM · System administration, Vault
zack added a project to T1174: Vault Integration tests & QA: System administration.

We want to test the end-to-end functionalities of the vault. Various use cases should hence be tested:

Aug 31 2018, 11:35 AM · System administration, Vault

Aug 29 2018

zack added a comment to T1163: anti SPAM measure for contact form.

Thanks @anlambert , SPAM originating from the contact form dropped to zero after this change!

Aug 29 2018, 6:00 PM · Website, System administration

Aug 25 2018

zack added a project to T1164: Dar backups fill up disk space on client machines: System administration.
Aug 25 2018, 4:25 PM · System administration
zack triaged T1167: web app: return (best-guess) Content-Type on /content/raw/ to ease in-browser rendering as Wishlist priority.
Aug 25 2018, 4:24 PM · Web app

Aug 23 2018

zack added a comment to T421: PyPI loader.
In T421#21693, @olasd wrote:
  • Unpack all the sdist formats
  • If things are well, the contents are identical. In that case, the revision objects would end up with the same id; we can ignore that there ever was multiple formats, and just have a single branch pointing to a single revision for that version of the package in the snapshot
  • If the contents are different, load both and make the snapshot have a branch pointing to each format.
Aug 23 2018, 9:40 AM · PyPI loader, Origin-Pypi

Aug 22 2018

zack committed rMSLD4e776136f3da: check in slides for OpenSym 2018 talk (authored by zack).
check in slides for OpenSym 2018 talk
Aug 22 2018, 1:19 PM
zack committed rMSLDfb31e995aaba: status module: add detailed version of DAG image (authored by zack).
status module: add detailed version of DAG image
Aug 22 2018, 1:19 PM

Aug 7 2018

zack triaged T1163: anti SPAM measure for contact form as Normal priority.
Aug 7 2018, 10:40 AM · Website, System administration