Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 25 2015

zack removed a parent task for T19: transfer antelink content from sesi-pv-lc2 to SWH infra: T6: backup: postgres DB.
Sep 25 2015, 5:07 PM
zack added a comment to T6: backup: postgres DB.

we now have this space available:

Sep 25 2015, 5:07 PM

Sep 24 2015

ardumont created T48: upload-based content search.
Sep 24 2015, 3:16 PM · Web app
ardumont created T47: lookup one hash and returns information about it (origin, revision, etc...).
Sep 24 2015, 3:15 PM
ardumont closed T46: lookup one hash to check presence, a subtask of T32: web UI: checksum search, as Resolved.
Sep 24 2015, 3:07 PM
ardumont closed T46: lookup one hash to check presence as Resolved.
Sep 24 2015, 3:07 PM
ardumont created T46: lookup one hash to check presence.
Sep 24 2015, 3:07 PM
olasd triaged T43: Convention for error passing from storage "backend" to storage "API server" to storage "API client" as High priority.
Sep 24 2015, 3:03 PM
olasd created T45: Fix swh.storage.storage.occurrence_add for overlapping intervals.
Sep 24 2015, 3:02 PM · Storage manager
zack added a comment to T43: Convention for error passing from storage "backend" to storage "API server" to storage "API client".

the {exception:.../args:....} proposal + re-raising in the client looks good to me

Sep 24 2015, 2:58 PM
olasd created T44: Rename swh.storage.api to swh.storage.api.server, swh.storage.remote_storage to swh.storage.api.client.
Sep 24 2015, 2:56 PM
olasd added a comment to T43: Convention for error passing from storage "backend" to storage "API server" to storage "API client".

We should standardize on :

  • an HTTP error code (400 / Bad Request ?)
  • a serialization format for the answer (JSON, probably serializing the error type and error args), e.g.
{
    'exception': e.__class__.__name__,
    'args': e.args,
}

and then deserialize that and raise in the client.

Sep 24 2015, 2:49 PM
olasd created T43: Convention for error passing from storage "backend" to storage "API server" to storage "API client".
Sep 24 2015, 2:45 PM
olasd closed T42: swh-git-loader: merge bulk-git-loader into master as Resolved by committing rDLDG62aa44fb0097: Merge branch 'bulk-git-loader'.
Sep 24 2015, 12:12 PM
olasd closed T42: swh-git-loader: merge bulk-git-loader into master, a subtask of T41: add actual content to swh-storage-testdata, as Resolved.
Sep 24 2015, 12:12 PM · Storage manager
olasd moved T42: swh-git-loader: merge bulk-git-loader into master from Backlog to Today on the Staff board.
Sep 24 2015, 11:35 AM
zack added a parent task for T42: swh-git-loader: merge bulk-git-loader into master: T41: add actual content to swh-storage-testdata.
Sep 24 2015, 11:21 AM
zack added a subtask for T41: add actual content to swh-storage-testdata: T42: swh-git-loader: merge bulk-git-loader into master.
Sep 24 2015, 11:21 AM · Storage manager
zack created T42: swh-git-loader: merge bulk-git-loader into master.
Sep 24 2015, 11:21 AM
ardumont added a comment to T33: Git cloner: catch up with new GitHub repositories after the summer.
Sep 24 2015, 11:15 AM
zack renamed T41: add actual content to swh-storage-testdata from add actual content to swh-content-testdata to add actual content to swh-storage-testdata.
Sep 24 2015, 11:10 AM · Storage manager
zack added a comment to T41: add actual content to swh-storage-testdata.

As a first step to address this, in rDSTOTb841c72f6a240eac8131e40614c9ce20d75b1c96 I've checked into swh-storage-testdata several sample repositories, both as submodules and fast-export dumps.
Starting from those, we now need a Makefile target that batch import them into the SWH DB, and recreate the test database dumps.

Sep 24 2015, 11:10 AM · Storage manager
ardumont closed T34: Git cloner: port to generic task scheduling interface as Resolved.
Sep 24 2015, 11:08 AM

Sep 23 2015

zack created T41: add actual content to swh-storage-testdata.
Sep 23 2015, 5:54 PM · Storage manager
zack moved T39: git conf: allow git push --force on all repos referenced by swh-environment (at least) from Today to Done on the Staff board.
Sep 23 2015, 12:09 PM
zack closed T39: git conf: allow git push --force on all repos referenced by swh-environment (at least) as Resolved.
Sep 23 2015, 12:09 PM
zack moved T23: Storage API: object writing methods from This week to Done on the Staff board.
Sep 23 2015, 12:09 PM
zack moved T25: Storage API: occurrence writing method from Today to Done on the Staff board.
Sep 23 2015, 12:08 PM
zack moved T26: Install a local debian repository for patched packages from This week to Done on the Staff board.
Sep 23 2015, 12:08 PM
zack moved T24: Storage API: release writing method from Today to Done on the Staff board.
Sep 23 2015, 12:08 PM
zack moved T10: Statistics from Git loading testdrive from Today to Done on the Staff board.
Sep 23 2015, 12:08 PM
zack created T40: prevent git push --force to master.
Sep 23 2015, 12:08 PM · Phabricator
zack created T39: git conf: allow git push --force on all repos referenced by swh-environment (at least).
Sep 23 2015, 12:02 PM
zack moved T21: gzip antelink content on sesi-pv-lc2 from Today to Backlog on the Staff board.
Sep 23 2015, 12:02 PM
zack added a comment to T21: gzip antelink content on sesi-pv-lc2.

now blocked due to the issues on sesi-pv-lc2 after the reboot :-/

Sep 23 2015, 12:02 PM

Sep 22 2015

zack closed T31: shw.core: generic API for (celery) task scheduling, a subtask of T34: Git cloner: port to generic task scheduling interface, as Resolved.
Sep 22 2015, 2:21 PM
zack closed T31: shw.core: generic API for (celery) task scheduling as Resolved.
Sep 22 2015, 2:21 PM
zack closed T31: shw.core: generic API for (celery) task scheduling, a subtask of T35: port git-bulk-loader to generic task scheduling API, as Resolved.
Sep 22 2015, 2:21 PM
zack claimed T31: shw.core: generic API for (celery) task scheduling.
Sep 22 2015, 1:43 PM
zack added a parent task for T31: shw.core: generic API for (celery) task scheduling: T35: port git-bulk-loader to generic task scheduling API.
Sep 22 2015, 1:31 PM
zack added a subtask for T35: port git-bulk-loader to generic task scheduling API: T31: shw.core: generic API for (celery) task scheduling.
Sep 22 2015, 1:31 PM

Sep 21 2015

zack added a parent task for T30: port ghlister to swh.* namespace and conventions: T37: port ghlister to swh task interface - daily updates.
Sep 21 2015, 8:53 PM · GitHub lister
zack added a subtask for T37: port ghlister to swh task interface - daily updates: T30: port ghlister to swh.* namespace and conventions.
Sep 21 2015, 8:53 PM · GitHub lister
zack added a subtask for T38: port ghlister to swh task interface - list all / catch up: T30: port ghlister to swh.* namespace and conventions.
Sep 21 2015, 8:53 PM · GitHub lister
zack added a parent task for T30: port ghlister to swh.* namespace and conventions: T38: port ghlister to swh task interface - list all / catch up.
Sep 21 2015, 8:53 PM · GitHub lister
zack created T38: port ghlister to swh task interface - list all / catch up.
Sep 21 2015, 8:50 PM · GitHub lister
zack triaged T37: port ghlister to swh task interface - daily updates as Normal priority.
Sep 21 2015, 8:48 PM · GitHub lister
zack created T37: port ghlister to swh task interface - daily updates.
Sep 21 2015, 8:47 PM · GitHub lister
zack renamed T30: port ghlister to swh.* namespace and conventions from post ghlister to swh.* namespace and conventions to port ghlister to swh.* namespace and conventions.
Sep 21 2015, 10:49 AM · GitHub lister
zack added a parent task for T19: transfer antelink content from sesi-pv-lc2 to SWH infra: T6: backup: postgres DB.
Sep 21 2015, 10:49 AM
zack added a subtask for T6: backup: postgres DB: T19: transfer antelink content from sesi-pv-lc2 to SWH infra.
Sep 21 2015, 10:49 AM
zack closed T26: Install a local debian repository for patched packages as Resolved.
Sep 21 2015, 10:48 AM
zack closed T26: Install a local debian repository for patched packages, a subtask of T8: Git loader - 1st deployable version, as Resolved.
Sep 21 2015, 10:48 AM
zack created T36: performance estimation: how long will it take to git-bulk-load all the GitHub repos we have.
Sep 21 2015, 10:48 AM · Git loader
zack created T35: port git-bulk-loader to generic task scheduling API.
Sep 21 2015, 10:47 AM
zack triaged T34: Git cloner: port to generic task scheduling interface as Normal priority.
Sep 21 2015, 10:46 AM
zack added a subtask for T34: Git cloner: port to generic task scheduling interface: T31: shw.core: generic API for (celery) task scheduling.
Sep 21 2015, 10:46 AM
zack added a parent task for T31: shw.core: generic API for (celery) task scheduling: T34: Git cloner: port to generic task scheduling interface.
Sep 21 2015, 10:46 AM
zack created T34: Git cloner: port to generic task scheduling interface.
Sep 21 2015, 10:46 AM
zack created T33: Git cloner: catch up with new GitHub repositories after the summer.
Sep 21 2015, 10:46 AM
zack triaged T31: shw.core: generic API for (celery) task scheduling as Normal priority.
Sep 21 2015, 10:45 AM
zack created T32: web UI: checksum search.
Sep 21 2015, 10:44 AM
zack created T31: shw.core: generic API for (celery) task scheduling.
Sep 21 2015, 10:44 AM

Sep 18 2015

zack added a comment to T19: transfer antelink content from sesi-pv-lc2 to SWH infra.

just pinged Laurent, Cc:-ing swh-devel

Sep 18 2015, 11:31 AM
zack created T30: port ghlister to swh.* namespace and conventions.
Sep 18 2015, 9:23 AM · GitHub lister

Sep 17 2015

olasd added a comment to T26: Install a local debian repository for patched packages.

The repository is now setup on pergamon:/srv/softwareheritage/repository

Sep 17 2015, 10:46 PM
olasd closed T23: Storage API: object writing methods, a subtask of T8: Git loader - 1st deployable version, as Resolved.
Sep 17 2015, 10:45 PM
olasd closed T23: Storage API: object writing methods as Resolved.

All the methods for git loading are written as of rDSTO2ccb3a502449

Sep 17 2015, 10:45 PM
olasd closed T25: Storage API: occurrence writing method, a subtask of T23: Storage API: object writing methods, as Resolved.
Sep 17 2015, 10:45 PM
olasd closed T25: Storage API: occurrence writing method as Resolved.

Done in rDSTOaf41d2084f46

Sep 17 2015, 10:45 PM
olasd closed T27: Storage API: origin writing method as Resolved.

done in rDSTOcc82413b4ee0

Sep 17 2015, 10:44 PM
olasd closed T27: Storage API: origin writing method, a subtask of T23: Storage API: object writing methods, as Resolved.
Sep 17 2015, 10:44 PM
olasd updated the task description for T24: Storage API: release writing method.
Sep 17 2015, 10:44 PM
olasd closed T24: Storage API: release writing method as Resolved.
Sep 17 2015, 10:43 PM
olasd closed T24: Storage API: release writing method, a subtask of T23: Storage API: object writing methods, as Resolved.
Sep 17 2015, 10:43 PM
zack created T29: evaluate conffile/argparse Python module.
Sep 17 2015, 1:57 PM · Core & foundations

Sep 16 2015

olasd created T27: Storage API: origin writing method.
Sep 16 2015, 3:28 PM
olasd moved T23: Storage API: object writing methods from Backlog to This week on the Staff board.
Sep 16 2015, 3:20 PM
olasd moved T26: Install a local debian repository for patched packages from Backlog to This week on the Staff board.
Sep 16 2015, 3:19 PM
olasd created T26: Install a local debian repository for patched packages.
Sep 16 2015, 3:19 PM
olasd moved T25: Storage API: occurrence writing method from Backlog to Today on the Staff board.
Sep 16 2015, 3:18 PM
olasd moved T24: Storage API: release writing method from Backlog to Today on the Staff board.
Sep 16 2015, 3:18 PM
olasd created T25: Storage API: occurrence writing method.
Sep 16 2015, 3:17 PM
olasd created T24: Storage API: release writing method.
Sep 16 2015, 3:17 PM
olasd created T23: Storage API: object writing methods.
Sep 16 2015, 3:15 PM
zack added a project to T4: SSL certificate for *.softwareheritage.org: Restricted Project.
Sep 16 2015, 11:37 AM · Restricted Project
zack triaged T22: DB schema: add metadata field to revision table as Normal priority.
Sep 16 2015, 11:36 AM · Storage manager
zack created T22: DB schema: add metadata field to revision table.
Sep 16 2015, 11:36 AM · Storage manager

Sep 15 2015

zack added a comment to T21: gzip antelink content on sesi-pv-lc2.

gzip (+ checksum verification) started on sesi-pv-lc2, using code in P8.
17 jobs being run in parallel, one for each store under /antelink/

Sep 15 2015, 3:47 PM
ardumont closed T10: Statistics from Git loading testdrive as Resolved.
Sep 15 2015, 1:44 PM
ardumont added a comment to T10: Statistics from Git loading testdrive.

https://intranet.softwareheritage.org/index.php/Swh_git_loader_stats_round_1

Sep 15 2015, 1:43 PM
zack moved T21: gzip antelink content on sesi-pv-lc2 from Backlog to Today on the Staff board.
Sep 15 2015, 11:30 AM
zack added a parent task for T21: gzip antelink content on sesi-pv-lc2: T19: transfer antelink content from sesi-pv-lc2 to SWH infra.
Sep 15 2015, 11:29 AM
zack added a subtask for T19: transfer antelink content from sesi-pv-lc2 to SWH infra: T21: gzip antelink content on sesi-pv-lc2.
Sep 15 2015, 11:29 AM
zack created T21: gzip antelink content on sesi-pv-lc2.
Sep 15 2015, 11:29 AM
olasd triaged T13: setup inbound email for forge as Normal priority.
Sep 15 2015, 8:57 AM
olasd triaged T11: cleanup network setup for louvre as Normal priority.
Sep 15 2015, 8:57 AM
olasd triaged T12: setup auto-deployment hook for the puppet environment as Low priority.
Sep 15 2015, 8:57 AM · Puppet recipes, Language-Puppet
olasd triaged T15: add systemd service file for forge IRC bot as Normal priority.
Sep 15 2015, 8:57 AM
olasd triaged T14: puppetize forge IRC bot config as Normal priority.
Sep 15 2015, 8:57 AM · Puppet recipes, Language-Puppet