Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 9 2017

zack added a project to T670: add icinga check for graph-navigation API endpoints: Easy hack.
Oct 9 2017, 11:52 AM · Restricted Project, System administration
zack removed a project from T792: Make the elasticsearch logging cluster actually a cluster: Easy hack.
Oct 9 2017, 11:47 AM · System administration (Elasticsearch consolidation (W24/2018))
zack added a project to T362: plugin to monitor the amount of visits per origin: Easy hack.
Oct 9 2017, 11:45 AM · System administration
zack renamed T491: Web UI: misc calendar issues from Miscellaneous calendar issues to Web UI: misc calendar issues.
Oct 9 2017, 11:41 AM · Web app
zack renamed T761: upgrade all machines to Debian Stretch from upgrade all machines to debian stretch to upgrade all machines to Debian Stretch.
Oct 9 2017, 11:37 AM · System administration
zack added a project to T782: Web API: make endpoints that expose extracted metadata return *lists* of factual information: Easy hack.
Oct 9 2017, 11:37 AM · Indexer, Easy hack, Web app
zack added a project to T789: Logrotate for systemd-journald: Easy hack.
Oct 9 2017, 11:37 AM · System administration
zack added a project to T790: Turn off syslog: Easy hack.
Oct 9 2017, 11:36 AM · System administration
zack added a project to T792: Make the elasticsearch logging cluster actually a cluster: Easy hack.
Oct 9 2017, 11:36 AM · System administration (Elasticsearch consolidation (W24/2018))
zack added a comment to T755: icinga notification spam: pending package upgrades.

Do you mean just dropping monitoring of pending package upgrades?
I agree that notifications for "there are pending upgrades" is pointless. But it'd be nice to be nagged for pending security upgrades.
Would that be an acceptable middle ground?

Oct 9 2017, 11:35 AM · System administration
zack added a project to T796: Icinga monitoring of mdadm raid on louvre and beaubourg: Easy hack.
Oct 9 2017, 11:33 AM · System administration
zack added a project to T797: Icinga monitoring of hardware raid on louvre, beaubourg and banco: Easy hack.
Oct 9 2017, 11:32 AM · System administration
zack added a project to T800: web UI: sort the list of origin visits in reverse chronological order: Easy hack.
Oct 9 2017, 11:32 AM · Easy hack, Web app
zack created Easy hack.
Oct 9 2017, 11:31 AM
zack created T800: web UI: sort the list of origin visits in reverse chronological order.
Oct 9 2017, 11:24 AM · Easy hack, Web app
zack created T799: web UI: links to visits from the calendar widget are broken (404).
Oct 9 2017, 11:23 AM · Web app

Oct 8 2017

zack added a comment to T434: Update mediawiki to current Debian version.

updated description to reflect the fact that mediawiki is now back into Debian proper, including stable (!)

Oct 8 2017, 8:37 PM · System administration
zack renamed T434: Update mediawiki to current Debian version from Update mediawiki to an upstream tarball to Update mediawiki to current Debian version.
Oct 8 2017, 8:37 PM · System administration

Oct 6 2017

zack renamed T713: Index existing contents (mimetype, language, license) from Indexing existing contents (mimetype, language, license) to Index existing contents (mimetype, language, license).
Oct 6 2017, 3:04 PM · Indexer
zack closed T89: refactor common behavior between git loader and dir loader as Resolved.

(since quite a while, thanks to swh.loader.core)

Oct 6 2017, 2:59 PM · Git loader, Directory loader
zack closed T5: pg_hash: postgres datatype for checksums as Wontfix.
Oct 6 2017, 2:55 PM · General

Oct 2 2017

zack added a comment to T787: abstract data model (Merkle DAG) documentation.

I've marked this as dependent on T709 as I'd like to avoid re-documenting details that are already coming in the docstrings of D248, and instead just point to them if/when appropriate.

Oct 2 2017, 1:58 PM · Documentation
zack added a subtask for T787: abstract data model (Merkle DAG) documentation: T709: Clean up the swh.model.git API.
Oct 2 2017, 1:57 PM · Documentation
zack added a parent task for T709: Clean up the swh.model.git API: T787: abstract data model (Merkle DAG) documentation.
Oct 2 2017, 1:57 PM · Data Model
zack created T787: abstract data model (Merkle DAG) documentation.
Oct 2 2017, 1:57 PM · Documentation
zack added a comment to D246: swh web ui: first implementation of source tree graphical navigation feature by providing HTML views for swh directory and content objects.

I've added some minor comments in-line.

Oct 2 2017, 12:05 PM

Oct 1 2017

zack added inline comments to D248: from_disk: convert on-disk data to Software Heritage archive objects.
Oct 1 2017, 9:06 AM
zack added a comment to D248: from_disk: convert on-disk data to Software Heritage archive objects.

I've re-looked at this after the switch to the Merkle AST, and it looks good to me.

Oct 1 2017, 9:04 AM

Sep 27 2017

zack committed rMSLDadd1c200a534: ipres talk: mention all authors on title page (authored by zack).
ipres talk: mention all authors on title page
Sep 27 2017, 3:05 AM
zack committed rMSLDdc9a5f93dbf6: check in slides for iPRES 2017 talk (authored by zack).
check in slides for iPRES 2017 talk
Sep 27 2017, 2:15 AM

Sep 26 2017

zack committed rMSLD94cf715cae6e: status module: update archive coverage slide (authored by zack).
status module: update archive coverage slide
Sep 26 2017, 8:51 AM
zack committed rMSLD811646aa85f4: common modules: more sober rendering of GPL quote (authored by zack).
common modules: more sober rendering of GPL quote
Sep 26 2017, 8:51 AM
zack committed rMSLD71213ac51cf4: update growt graphs (authored by zack).
update growt graphs
Sep 26 2017, 7:06 AM

Sep 23 2017

zack renamed T782: Web API: make endpoints that expose extracted metadata return *lists* of factual information from Preparer JSON output for storing multiple value/tool entries to Web API: make endpoints that expose extracted metadata return *lists* of factual information.
Sep 23 2017, 9:29 AM · Indexer, Easy hack, Web app
zack triaged T782: Web API: make endpoints that expose extracted metadata return *lists* of factual information as Normal priority.

right, we should make that JSON output a list of, rather than single dictionary

Sep 23 2017, 9:27 AM · Indexer, Easy hack, Web app

Sep 20 2017

zack added a comment to T781: monitoring of pending Wordpress upgrades.

I've just added a webmaster@ email alias (via the gandi console) pointing to… you :-) @anlambert (via your Inria email address). You can use that for wordpress upgrade notifications.

Sep 20 2017, 4:11 PM · Website, Web masters
zack added a comment to T781: monitoring of pending Wordpress upgrades.

And of course right now there are a bunch of pending Wordpress upgrades, including a major version upgrade of the Layers theme :-)

Sep 20 2017, 3:30 PM · Website, Web masters
zack created T781: monitoring of pending Wordpress upgrades.
Sep 20 2017, 3:29 PM · Website, Web masters
zack committed rDENV1d9e1e618731: python Makefile: add "lint" target to pylint current module (authored by zack).
python Makefile: add "lint" target to pylint current module
Sep 20 2017, 12:24 PM
zack added a comment to D248: from_disk: convert on-disk data to Software Heritage archive objects.

I really like this module, the API is very clean and what I'd like to use.

Sep 20 2017, 11:04 AM

Sep 19 2017

zack committed rDDOC7ba6936bd34d: architecture: new doc with python module overview (authored by zack).
architecture: new doc with python module overview
Sep 19 2017, 5:28 PM
zack committed rDDOCc68dbaccd3be: also generate module dependency graphs in SVG format (authored by zack).
also generate module dependency graphs in SVG format
Sep 19 2017, 5:28 PM
zack committed rDMODac3df91ae682: docs/: add sub document data-model.rst (authored by zack).
docs/: add sub document data-model.rst
Sep 19 2017, 5:09 PM
zack committed rDDOC9251192bb61d: swh.docs.conf: mock more (and moar) django modules (authored by zack).
swh.docs.conf: mock more (and moar) django modules
Sep 19 2017, 4:09 PM
zack committed rDDOCa43404a9f48a: swh.docs.conf: django/sphinx whac-a-mole, mock moar modules (authored by zack).
swh.docs.conf: django/sphinx whac-a-mole, mock moar modules
Sep 19 2017, 3:59 PM
zack removed a reviewer for D247: Web API: move content checksums under a common JSON key: zack.
Sep 19 2017, 2:30 PM
zack added inline comments to D247: Web API: move content checksums under a common JSON key.
Sep 19 2017, 2:23 PM
zack edited reviewers for D229: added the debian lister, added: olasd; removed: Reviewers.
Sep 19 2017, 11:29 AM
zack edited reviewers for D232: Added method for downloading source packages, added: olasd; removed: Reviewers.
Sep 19 2017, 11:29 AM
zack requested changes to D247: Web API: move content checksums under a common JSON key.

(no change or additional comment, just updating the review status to reflect the discussion)

Sep 19 2017, 11:28 AM
zack requested changes to D246: swh web ui: first implementation of source tree graphical navigation feature by providing HTML views for swh directory and content objects.

The main thing we agreed upon when discussing F2F about all this yesterday is that we want to do rendering on the client side, leveraging the information our indexer have extracted from the blob if available.
We mentioned highlight.js, but it might make sense to check what github is using (if it's client side), given we already use it on the indexer.

Sep 19 2017, 11:27 AM

Sep 18 2017

zack accepted D244: cache: objstorage implementation independant (no longer requires pathslicing).
Sep 18 2017, 2:45 PM
zack added a comment to D247: Web API: move content checksums under a common JSON key.

Looks good as a fix T779.

Sep 18 2017, 1:06 PM
zack added a comment to T712: Update existing contents with new hash blake2s256.

Good call in pausing this to avoid uffizi hangs (assuming this was the cause).
We want the different object storage copies to converge, so I think waiting for the archiver to close the gap (possibly increasing resources to it if that helps) before restarting this is the right solution here.

Sep 18 2017, 9:37 AM · Indexer

Sep 17 2017

zack renamed T779: Web API: move content checksums under a common JSON key from Web API: move all content checksums under a common key to Web API: move content checksums under a common JSON key.
Sep 17 2017, 5:14 PM · Web app
zack created T779: Web API: move content checksums under a common JSON key.
Sep 17 2017, 5:13 PM · Web app

Sep 16 2017

zack added a parent task for T775: Ingest Adullact forge: Unknown Object (Maniphest Task).
Sep 16 2017, 2:13 PM · Archive coverage, FusionForge Forge
zack removed a parent task for T775: Ingest Adullact forge: Unknown Object (Maniphest Task).
Sep 16 2017, 2:13 PM · Archive coverage, FusionForge Forge
zack added a parent task for T718: SWORD deposit: backend server: Unknown Object (Maniphest Task).
Sep 16 2017, 2:10 PM · SWORD deposit
zack renamed T778: FusionForge lister from Write lister for FusionForge to FusionForge lister.
Sep 16 2017, 2:09 PM · FusionForge Forge
zack added a parent task for T778: FusionForge lister: Unknown Object (Maniphest Task).
Sep 16 2017, 2:08 PM · FusionForge Forge

Sep 15 2017

zack removed a member for Interns: moranegg.
Sep 15 2017, 4:24 PM
zack committed rDDOCa609e29a65e1: remove whitespace mixture from ln-sphinx-subprojects (authored by zack).
remove whitespace mixture from ln-sphinx-subprojects
Sep 15 2017, 3:23 PM
zack updated the task description for T761: upgrade all machines to Debian Stretch.
Sep 15 2017, 3:06 PM · System administration
zack added inline comments to D244: cache: objstorage implementation independant (no longer requires pathslicing).
Sep 15 2017, 10:55 AM
zack accepted D245: tests: add cache tests.

when committing this, do not forget to mention T747 in the commit message (mentioning this just because it happened in other recently accepted diffs related to the vault)

Sep 15 2017, 10:53 AM
zack added a reviewer for D245: tests: add cache tests: Reviewers.
Sep 15 2017, 10:51 AM
zack added a reviewer for D244: cache: objstorage implementation independant (no longer requires pathslicing): Reviewers.
Sep 15 2017, 10:51 AM
zack closed T40: prevent git push --force to master as Resolved.

This is now implemented by H22, e.g.:

git push  --force
Counting objects: 3, done.
Delta compression using up to 4 threads.
Compressing objects: 100% (2/2), done.
Writing objects: 100% (3/3), 281 bytes | 281.00 KiB/s, done.
Total 3 (delta 1), reused 0 (delta 0)
remote: *** PUSH REJECTED BY COMMIT HOOK ***
remote: 
remote: This push was rejected by Herald push rule H22.
remote:     Change: branch/master
remote:       Rule: forbid dangerous changes to the master branch in any repository
remote:     Reason: dangerous changes to master branch are forbidden
remote: Transcript: https://forge.softwareheritage.org/herald/transcript/58415/
remote: 
To ssh://forge.softwareheritage.org/source/sandbox.git
 ! [remote rejected] master -> master (pre-receive hook declined)
error: failed to push some refs to 'ssh://git@forge.softwareheritage.org/source/sandbox.git'

while it works when force-pushing to branches other than master.

Sep 15 2017, 10:39 AM · Phabricator
zack added a comment to T727: Provide a version of swh_directory_walk/_one without the join on the contents table.
Sep 15 2017, 10:37 AM · Storage manager
zack committed rTSBX8ee98766f44b: some other changes to qux (authored by zack).
some other changes to qux
Sep 15 2017, 10:35 AM
zack committed rTSBX1ecb4c166282: some changes to qux (authored by zack).
some changes to qux
Sep 15 2017, 10:35 AM
zack committed rTSBX2d8389da57fc: new file: qux (authored by zack).
new file: qux
Sep 15 2017, 10:35 AM
zack committed rTSBXbda305af85db: some changes to bar (authored by zack).
some changes to bar
Sep 15 2017, 10:34 AM
zack committed rTSBXd8307482cf83: some additional changes to bar (authored by zack).
some additional changes to bar
Sep 15 2017, 10:33 AM
zack committed rTSBXc480199d6803: some changes to bar (authored by zack).
some changes to bar
Sep 15 2017, 10:33 AM
zack committed rTSBXd8a63af7931c: new file: bar.txt (authored by zack).
new file: bar.txt
Sep 15 2017, 10:33 AM
zack committed rTSBX7e77556e3c62: non dangerous change to foo.txt (authored by zack).
non dangerous change to foo.txt
Sep 15 2017, 10:32 AM
zack closed T746: Objstorage: add a way to delete items (with a filter for production environments) as Resolved.

this has been fixed in rDOBJS350c2e7bc94e

Sep 15 2017, 10:21 AM · Object storage
zack closed T746: Objstorage: add a way to delete items (with a filter for production environments), a subtask of T745: Vault: Add cache expiration feature, as Resolved.
Sep 15 2017, 10:21 AM · Vault
zack removed a parent task for T759: Web-based interface for browsing the archive (1st public version): T739: Implement SWH Web applications using Django .
Sep 15 2017, 10:19 AM · Restricted Project, Web app
zack removed a subtask for T739: Implement SWH Web applications using Django : T759: Web-based interface for browsing the archive (1st public version).
Sep 15 2017, 10:19 AM · Web app
zack closed T739: Implement SWH Web applications using Django as Resolved.

I'm closing this "parent" task because the porting work from flask to django is now done.
Additional features (e.g., web-based browsing) are still TODO, but no longer related to switching stack.

Sep 15 2017, 10:19 AM · Web app
zack created T762: integrate lister tutorial into development documentation.
Sep 15 2017, 10:13 AM · Documentation
zack added a project to T508: prototype: git archive from SWH: Vault.
Sep 15 2017, 10:12 AM · Vault, General
zack closed T342: add nagios check for disk size on saatchi as Resolved.

AFAICT this is now done as part of the generalization of default icinga2 checks on all our machines. (Please reopen if it's not the case.)

Sep 15 2017, 10:10 AM · Restricted Project, System administration, Puppet recipes
zack added a project to T67: prototype: git clone from SWH: Vault.
Sep 15 2017, 10:03 AM · Vault, General
zack closed T111: Performance analysis of read queries as Wontfix.

looks like this is no longer of interest

Sep 15 2017, 10:02 AM · Storage manager
zack closed T753: use a better example for the /content/ API endpoint as Resolved.

fixed by @anlambert in 49bfa06aff5c8fc97ac5217a74991d9557726463

Sep 15 2017, 10:00 AM · Web app
zack assigned T647: support software deposit via SWORD protocol (meta task) to ardumont.
Sep 15 2017, 9:58 AM · SWORD deposit, General
zack closed T598: Store content -> revision cache in azure table storage as Wontfix.

we're taking a different route for this now, based on @grouss WIP

Sep 15 2017, 9:58 AM · Storage manager
zack closed T598: Store content -> revision cache in azure table storage, a subtask of T547: Azure prototype: Content provenance information API, as Wontfix.
Sep 15 2017, 9:58 AM · General
zack closed T547: Azure prototype: Content provenance information API as Wontfix.

we're taking a different route for this now, based on @grouss WIP

Sep 15 2017, 9:57 AM · General
zack placed T454: object storage backend that can read from/write to S3 up for grabs.
Sep 15 2017, 9:55 AM · Storage manager
zack assigned T712: Update existing contents with new hash blake2s256 to ardumont.
Sep 15 2017, 9:50 AM · Indexer

Sep 14 2017

zack changed the status of T761: upgrade all machines to Debian Stretch from Open to Work in Progress.
Sep 14 2017, 10:03 PM · System administration
zack created T761: upgrade all machines to Debian Stretch.
Sep 14 2017, 10:03 PM · System administration
zack removed a member for Interns: sushant5.
Sep 14 2017, 10:40 AM
zack removed a member for Staff: sushant5.
Sep 14 2017, 10:40 AM
zack removed a member for Developers: sushant5.
Sep 14 2017, 10:40 AM