Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 15 2018

zack renamed T1261: migrate tests from nose to pytest from Discuss the opportunity of migrating tests to pytest to migrate tests from nose to pytest.
Oct 15 2018, 3:14 PM · Development environment
zack claimed T1269: swh-storage: `make distclean` in docs/ deletes committed files.
Oct 15 2018, 11:22 AM · Documentation, Storage manager
zack removed 1 blocking reviewer(s) for D267: [WIP] add first implementation of FusionForge lister: Reviewers.
Oct 15 2018, 10:43 AM
zack accepted D490: Add OriginIndexer + OriginHeadIndexer..
Oct 15 2018, 10:43 AM
zack added inline comments to D490: Add OriginIndexer + OriginHeadIndexer..
Oct 15 2018, 10:32 AM
zack requested changes to D490: Add OriginIndexer + OriginHeadIndexer..
Oct 15 2018, 10:06 AM

Oct 12 2018

zack triaged T1267: document default branch naming convention for snapshots as Low priority.
Oct 12 2018, 8:09 PM · Documentation
zack closed T1257: Formalize the default branch convention for snapshots as Resolved.

I'm closing this as it was about defining the naming convention and we have done so. I'm going to file a task about documenting it as part of the data model documentation.

Oct 12 2018, 8:07 PM · Archive content
zack edited projects for T1250: create a jenkins job to build and publish debian packages, added: Continuous Integration; removed System administration.
Oct 12 2018, 4:08 PM · Restricted Project, Continuous Integration
zack edited projects for T1249: create a jenkins job to build and publish the sphinx documentation, added: Continuous Integration; removed System administration.
Oct 12 2018, 4:07 PM · Continuous Integration, Documentation
zack edited projects for T1248: create a jenkins job to automatically publish python packages on pypi , added: Continuous Integration; removed System administration.
Oct 12 2018, 4:07 PM · Restricted Project, Continuous Integration
zack edited projects for T1247: add a tox.ini file in most repos, added: Continuous Integration; removed System administration.
Oct 12 2018, 4:07 PM · Continuous Integration
zack added a project to T1027: Setup a continuous integration machine: Continuous Integration.
Oct 12 2018, 4:06 PM · Continuous Integration, System administration
zack edited projects for T1025: Survey of continuous integration systems, added: Continuous Integration; removed System administration.
Oct 12 2018, 4:06 PM · Continuous Integration
zack added a project to T1024: Proper continuous integration setup: Continuous Integration.
Oct 12 2018, 4:06 PM · Restricted Project, Continuous Integration, System administration
zack edited projects for T1029: CI: Testing of Python modules, added: Continuous Integration; removed System administration.
Oct 12 2018, 4:05 PM · Continuous Integration
zack created Continuous Integration.
Oct 12 2018, 4:05 PM
zack edited Description on Indexer.
Oct 12 2018, 4:02 PM
zack closed T1245: Factorize setup.py files as Wontfix.

as per discussion, we'd rather keep them self-contained than gain something out of code deduplication

Oct 12 2018, 4:00 PM · Core & foundations, Easy hack
zack accepted D527: tests: kill DbTestFixture.__init__ method.
Oct 12 2018, 3:30 PM
zack removed 1 blocking reviewer(s) for D398: [WIP] "packing" object storage design documentation: Reviewers.
Oct 12 2018, 3:24 PM · Object storage
zack removed 1 blocking reviewer(s) for D518: Add tests using Celery.: Reviewers.
Oct 12 2018, 3:23 PM
zack removed 1 blocking reviewer(s) for D519: tests: add a CeleryTestFixture that allows to specify a celery broker URL: Reviewers.
Oct 12 2018, 3:21 PM
zack triaged T1266: automatically generate archive coverage page as Wishlist priority.
Oct 12 2018, 2:53 PM · Web app
zack added a comment to T1265: kill swh-storage-testdata [was: make swh-storage-testdata a python package].

yes I'm aware of this logic in the makefile. Not sure yet what's the best to do with this. Move it up in swh-development?

Oct 12 2018, 2:07 PM · Storage manager
zack added a comment to T1262: wiki: Update suggestion box if `all Debian derivatives` can be noted as ingested.

My point was just that you didn't list here the entries that you think have to be updated, so it wasn't actionable.
It would be great if you can update the task description with all the entries that you think deserve an update (even if you've doubts about them).

Oct 12 2018, 11:13 AM · Archive coverage
zack added a comment to T757: Memory leak in swh.storage.api.server.

potentially useful related tooling: http://carsonip.me/posts/debugging-memory-usage-python-tracemalloc/

Oct 12 2018, 10:00 AM · Storage manager

Oct 11 2018

zack edited projects for T1265: kill swh-storage-testdata [was: make swh-storage-testdata a python package], added: Storage manager; removed System administration.
Oct 11 2018, 8:26 PM · Storage manager
zack added a comment to T1264: Documentation top bar eats the anchor targets.

(BTW, it's incredible how many websites out there are plagued by this
very same issue…)

Oct 11 2018, 8:25 PM · Documentation
zack added a comment to T1262: wiki: Update suggestion box if `all Debian derivatives` can be noted as ingested.

Can you clarify the scope of this task?

Oct 11 2018, 8:22 PM · Archive coverage
zack added a comment to T1261: migrate tests from nose to pytest.

No objections here either.

Oct 11 2018, 8:21 PM · Development environment
zack added a comment to T1255: getting started guide: db-init fails with "relation entity_history does not exist".

Oh, yeah, that makes sense. We're doing some refactoring work on
swh-storage these days, so if you did part of the DB setup back then and
part now, weird things might have happened :-)

Oct 11 2018, 8:18 PM · Unreproducible, Documentation
zack added a comment to T1251: archive page: visually show archive coverage.

Thanks for the update, looks even greater now :-)

Oct 11 2018, 8:16 PM · Web app, Website
zack added a project to T1261: migrate tests from nose to pytest: Development environment.
Oct 11 2018, 11:56 AM · Development environment
zack added a comment to T1251: archive page: visually show archive coverage.

That is awesome, thanks a lot!

Oct 11 2018, 11:46 AM · Web app, Website
zack added a comment to D512: loader-svn: Rename default branch to HEAD.

I didn't think of this in relation to T1257, but it's indeed a very valid point.
For consistency we should certainly have HEAD in svn snapshots too.

Oct 11 2018, 9:05 AM
zack retitled D512: loader-svn: Rename default branch to HEAD from loader: Rename default branch as HEAD to loader: Rename default branch to HEAD.
Oct 11 2018, 9:01 AM

Oct 10 2018

zack accepted D509: Drop unused entity tables.

AOL !

Oct 10 2018, 4:43 PM
zack claimed T1254: Generated API documentation sometimes misses function signatures.

I see the problem in your screenshots, but right now I cannot find any instance of it in the docs deployed at docs.s.o.
Please let me know if/when you find one.
Also, next time you can reproduce it locally it would be great if you can paste somewhere the full log of your sphinx build.

Oct 10 2018, 1:52 PM · Documentation
zack triaged T1259: detailed/formal documentation of the abstract data model as Normal priority.
Oct 10 2018, 1:26 PM · Documentation
zack added a comment to T1257: Formalize the default branch convention for snapshots.
  • the default branch for snapshots is defined to be HEAD.
    • if the concept of HEAD exists with the same name in the upstream VCS (f.e. git, svn), this branch should be a literal pointer to the corresponding archived object
    • if the concept of HEAD doesn't exist with the same name in the upstream VCS (f.e. mercurial), this branch should be an alias pointing at the default branch, named using the upstream VCS context (f.e. in the mercurial case, that would be an alias for the tip of the default branch)
    • if the concept of a default branch/version doesn't exist in the upstream VCS, no HEAD branch should exist in the snapshot
Oct 10 2018, 1:21 PM · Archive content
zack renamed T1255: getting started guide: db-init fails with "relation entity_history does not exist" from Issues with getting started guide. to getting started guide: db-init fails with "relation entity_history does not exist".
Oct 10 2018, 11:22 AM · Unreproducible, Documentation
zack added a project to T1255: getting started guide: db-init fails with "relation entity_history does not exist": Unreproducible.
Oct 10 2018, 11:22 AM · Unreproducible, Documentation
zack added a comment to T1255: getting started guide: db-init fails with "relation entity_history does not exist".

Thanks for this bug report!

Oct 10 2018, 11:21 AM · Unreproducible, Documentation
zack committed rDDOCa6aa308cb02b: getting-started: add -p to mkdir where needed (authored by zack).
getting-started: add -p to mkdir where needed
Oct 10 2018, 11:18 AM

Oct 9 2018

zack added a project to T1252: Document snapshot target types: Documentation.

here's a git repo i've just built for you:

$ git br
* master
  not-a-branch
$ git show-ref not-a-branch
72955907aa477d43dc1c03ee6f5a13c2c49534bd refs/heads/not-a-branch
$ git cat-file -p 72955907aa477d43dc1c03ee6f5a13c2c49534bd
040000 tree 8535775197eeced6f90e9116618c61472ebccb9f	foo
Oct 9 2018, 10:56 AM · Documentation
zack added a comment to T1252: Document snapshot target types.

I still think my answer applies, no?

Oct 9 2018, 10:33 AM · Documentation
zack added a comment to T1252: Document snapshot target types.

I'm not sure I understand your question (or the purpose of this task). Can you elaborate?

Oct 9 2018, 10:09 AM · Documentation

Oct 8 2018

zack triaged T1251: archive page: visually show archive coverage as High priority.
Oct 8 2018, 3:48 PM · Web app, Website
zack edited projects for T1242: Make every public swh.xxx package available on pypi, added: Development environment; removed System administration.
Oct 8 2018, 3:36 PM · Development environment
zack added a project to T1249: create a jenkins job to build and publish the sphinx documentation: Documentation.
Oct 8 2018, 3:35 PM · Continuous Integration, Documentation
zack closed T1030: Provide a pip-compatible index of python modules as Wontfix.
Oct 8 2018, 3:22 PM · System administration
zack closed T1030: Provide a pip-compatible index of python modules, a subtask of T1029: CI: Testing of Python modules, as Wontfix.
Oct 8 2018, 3:22 PM · Continuous Integration

Oct 6 2018

zack added inline comments to D467: loader.core.tests: Add loader core fixtures to ease loaders' tests.
Oct 6 2018, 8:28 PM

Oct 5 2018

zack added a project to T1139: ingest major gitlab instances: Archive coverage.
Oct 5 2018, 4:34 PM · Archive coverage, Origin-GitLab
zack renamed T1139: ingest major gitlab instances from List other gitlab instances to ingest major gitlab instances.
Oct 5 2018, 4:30 PM · Archive coverage, Origin-GitLab
zack closed T865: update team page in spanish as Wontfix.

closing as wontfix as the whole website in spanish needs an update in fact...

Oct 5 2018, 11:18 AM
zack lowered the priority of T1173: Huge slowdowns on louvre since 2018-08-20 from Unbreak Now! to High.
Oct 5 2018, 11:16 AM · System administration
zack added inline comments to D467: loader.core.tests: Add loader core fixtures to ease loaders' tests.
Oct 5 2018, 10:58 AM
zack requested changes to D490: Add OriginIndexer + OriginHeadIndexer..

only minor issues for me, looks good otherwise

Oct 5 2018, 10:54 AM

Oct 4 2018

zack added a comment to T1233: use CNAME for upcoming jenkins CI.

nice!

Oct 4 2018, 5:17 PM · System administration
zack closed T338: manifest browser / renderer as Wontfix.

closing to match T337 status

Oct 4 2018, 12:32 PM · Web app
zack closed T318: TLS hardening for swh2.inria.fr:25 as Wontfix.
Oct 4 2018, 12:32 PM · System administration
zack closed T16: cleanup and publish phabricator puppet module as Wontfix.

we no longer use a puppet module for phabricator

Oct 4 2018, 12:31 PM · Puppet recipes, Language-Puppet
zack raised the priority of T1175: renews SSL certificats for {www,}softwareheritage.org from Normal to High.
Oct 4 2018, 12:29 PM · System administration
zack claimed T1015: document registration of swh: identifiers on identifiers.org.
Oct 4 2018, 12:25 PM · Documentation
zack claimed T1003: Register a SWH uri scheme with IANA.
Oct 4 2018, 12:23 PM · Data Model
zack added a comment to T838: SQL storage: drop the entity tables.

agreed, they should be removed (I've updated the task title accordingly)

Oct 4 2018, 12:19 PM · Storage manager, Archive content
zack renamed T838: SQL storage: drop the entity tables from Decide what to do with the entity tables to SQL storage: drop the entity tables.
Oct 4 2018, 12:18 PM · Storage manager, Archive content
zack closed T337: specify a manifest format for documenting archived software, a subtask of T338: manifest browser / renderer, as Resolved.
Oct 4 2018, 12:13 PM · Web app
zack closed T337: specify a manifest format for documenting archived software as Resolved.

The identification part of this task has been done with documenting/implementing our PIDs, the rest is more suited for the software citation work on which @moranegg is actively working.

Oct 4 2018, 12:13 PM · General
zack closed T284: investigate XFS tuning slowdown on uffizi w.r.t. banco as Wontfix.

task death by a thousand cuts

Oct 4 2018, 12:11 PM · System administration
zack added a subtask for T1024: Proper continuous integration setup: T1233: use CNAME for upcoming jenkins CI.
Oct 4 2018, 12:09 PM · Restricted Project, Continuous Integration, System administration
zack added a parent task for T1233: use CNAME for upcoming jenkins CI: T1024: Proper continuous integration setup.
Oct 4 2018, 12:09 PM · System administration
zack added a comment to T1069: fully host the web UI on Azure.

@olasd @ardumont can this be closed now? if yes, please do; if not, please add subtask(s) about what needs to be done to complete this

Oct 4 2018, 12:02 PM · Web app, System administration
zack closed T1116: Azure webapp performance tests as Invalid.

this is now T1117

Oct 4 2018, 12:00 PM · Web app, System administration
zack closed T1116: Azure webapp performance tests, a subtask of T1069: fully host the web UI on Azure, as Invalid.
Oct 4 2018, 12:00 PM · Web app, System administration
zack assigned T1024: Proper continuous integration setup to douardda.
Oct 4 2018, 11:58 AM · Restricted Project, Continuous Integration, System administration
zack added a project to T1087: facet/metadata-based project search: Metadata workflow.
Oct 4 2018, 11:55 AM · Metadata workflow, General, Web app
zack raised the priority of T1087: facet/metadata-based project search from Low to Normal.
Oct 4 2018, 11:55 AM · Metadata workflow, General, Web app
zack closed T1098: Add full contextual information in a swh-id of an object as Resolved.

this has been done in bc30e8bc60ac3a310f91a15b5692e6b9bc6a30a3

Oct 4 2018, 11:53 AM · Web app, General
zack removed subtasks for T807: dogfooding: ingest the Software Heritage forge into the archive (via the canonical URLs): T329: hg / mercurial loader, T328: svn / subversion loader.
Oct 4 2018, 11:51 AM · General
zack removed a parent task for T329: hg / mercurial loader: T807: dogfooding: ingest the Software Heritage forge into the archive (via the canonical URLs).
Oct 4 2018, 11:51 AM · Mercurial loader
zack removed a parent task for T328: svn / subversion loader: T807: dogfooding: ingest the Software Heritage forge into the archive (via the canonical URLs).
Oct 4 2018, 11:51 AM · SVN Loader
zack closed T336: "save code now", a subtask of T1022: SWORD deposit requesting to save content existing on an external code hosting platform, as Resolved.
Oct 4 2018, 11:47 AM · Core Loader, SWORD deposit
zack closed T336: "save code now" as Resolved.
Oct 4 2018, 11:47 AM · General
zack added a comment to T336: "save code now".

this is now done (YAY :-)), closing the task to reflect current status

Oct 4 2018, 11:47 AM · General
zack removed a parent task for T1156: Fix release targets of already loaded mercurial type origins: T336: "save code now".
Oct 4 2018, 11:46 AM · Archive content
zack removed a subtask for T336: "save code now": T1156: Fix release targets of already loaded mercurial type origins.
Oct 4 2018, 11:46 AM · General
zack committed rMSLD09a96d8a994a: status module: update archive growth picture (authored by zack).
status module: update archive growth picture
Oct 4 2018, 11:14 AM
zack committed rMSLD1db37d23df52: add skeleton for PyConFr talk (authored by zack).
add skeleton for PyConFr talk
Oct 4 2018, 11:14 AM
zack committed rMSLDf6aaa495cf80: status module: update archive coverage and features (authored by zack).
status module: update archive coverage and features
Oct 4 2018, 11:14 AM
zack renamed T1238: Loader: refactor loader tests to avoid code duplication from Loader: Refactor the loader tests to reuse to Loader: refactor loader tests to avoid code duplication.
Oct 4 2018, 9:06 AM · Core Loader

Oct 3 2018

zack added a member for Reviewers: vlorentz.
Oct 3 2018, 8:17 PM
zack added a member for Reviewers: douardda.
Oct 3 2018, 8:17 PM
zack added a comment to D465: tox: add a simple tox file that runs tests, flake8 and check-manifest.

not a blocker for integrating this (assuming tox isn't run automatically by pybuild), but fwiw pifpaf isn't in debian yet, there's an RFP though

Oct 3 2018, 8:17 PM
zack accepted D472: Remove the occurrence table.
Oct 3 2018, 7:59 PM
zack accepted D471: Remove some unused SQL functions.
Oct 3 2018, 7:57 PM
zack committed rDTPL3e3a2db5adeb: add tests dir (authored by zack).
add tests dir
Oct 3 2018, 5:39 PM
zack accepted D464: doc: use inkscape instead of dia to generate pdf and svg image files.
Oct 3 2018, 3:53 PM