Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 23 2015

ardumont closed T105: make worker01 stop consuming swh_loader_git messages as Resolved.
Oct 23 2015, 12:07 PM · Tarball loader, Directory loader
ardumont added a project to T105: make worker01 stop consuming swh_loader_git messages: Tarball loader.
Oct 23 2015, 12:01 PM · Tarball loader, Directory loader
ardumont added a project to T106: Test on worker01: producing and consuming one swh_loader_tar message: Tarball loader.
Oct 23 2015, 12:01 PM · Tarball loader, Directory loader
ardumont closed T127: release swh-loader-tar, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 12:01 PM · Tarball loader, Directory loader
ardumont closed T127: release swh-loader-tar as Resolved.
Oct 23 2015, 12:01 PM · Tarball loader, Directory loader
ardumont added a project to T90: swh-loader-tar - Load gnu tarballs in swh-storage: Tarball loader.
Oct 23 2015, 12:00 PM · Tarball loader, Directory loader
ardumont added a project to T127: release swh-loader-tar: Tarball loader.
Oct 23 2015, 11:59 AM · Tarball loader, Directory loader
ardumont closed T104: release swh-loader-dir, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 11:44 AM · Tarball loader, Directory loader
ardumont renamed T104: release swh-loader-dir from release of swh-loader-dir when ready to release swh-loader-dir.
Oct 23 2015, 11:44 AM · Directory loader
olasd added a comment to T3: Discuss the project <-> origin mapping.
In T3#1275, @olasd wrote:
  • GitHub
    • GitHub git hosting -> GitHub lister, generates suborganizations for "GitHub organizations"
      • hylang -> no specific lister, "shallow" organization
      • zacchiro
      • olasd
      • ...
    • GitHub asset hosting -> T17
Oct 23 2015, 11:43 AM · Storage manager
ardumont closed T126: release swh-core, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 11:20 AM · Tarball loader, Directory loader
ardumont closed T126: release swh-core as Resolved.
Oct 23 2015, 11:20 AM · Directory loader
ardumont created T127: release swh-loader-tar.
Oct 23 2015, 11:19 AM · Tarball loader, Directory loader
ardumont created T126: release swh-core.
Oct 23 2015, 11:19 AM · Directory loader
ardumont closed T98: Produce list of tarballs message as Resolved.
Oct 23 2015, 10:53 AM · Directory loader
ardumont closed T125: Permits loading of tarball subsets from a file as Resolved.
Oct 23 2015, 10:53 AM · Directory loader
ardumont closed T125: Permits loading of tarball subsets from a file, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 10:53 AM · Tarball loader, Directory loader
ardumont closed T124: Tryouts run on gnu to complete the tarball listing exhaustiveness as Resolved.
Oct 23 2015, 10:53 AM · Directory loader
ardumont closed T124: Tryouts run on gnu to complete the tarball listing exhaustiveness, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 10:53 AM · Tarball loader, Directory loader
ardumont closed T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness as Resolved.
Oct 23 2015, 10:52 AM · Directory loader
ardumont closed T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 10:52 AM · Tarball loader, Directory loader
ardumont created T125: Permits loading of tarball subsets from a file.
Oct 23 2015, 10:51 AM · Directory loader
ardumont created T124: Tryouts run on gnu to complete the tarball listing exhaustiveness.
Oct 23 2015, 10:50 AM · Directory loader
ardumont created T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness.
Oct 23 2015, 10:50 AM · Directory loader
olasd added a comment to T3: Discuss the project <-> origin mapping.

I've had some thoughts about this problem, and here are my propositions.

Oct 23 2015, 10:01 AM · Storage manager

Oct 22 2015

olasd created T121: Populate fetch_history.
Oct 22 2015, 2:31 PM · Storage manager
olasd created T120: regular debian archive producer.
Oct 22 2015, 12:33 PM · Debian loader, Origin-Debian
olasd created T119: snapshot.debian.org producer.
Oct 22 2015, 12:32 PM · Origin-Debian, Debian loader
olasd created T118: Create swh-loader-debian.
Oct 22 2015, 12:30 PM · Debian loader, Origin-Debian
zack closed T117: factor out common code from git/dir loader as Invalid.

duplicate of T89

Oct 22 2015, 10:54 AM · Directory loader, Git loader
zack renamed T89: refactor common behavior between git loader and dir loader from Extract common behavior between swh-loader-git and swh-loader-dir ~> swh-loader-core to refactor common behavior between git loader and dir loader.
Oct 22 2015, 10:53 AM · Git loader, Directory loader
zack created T117: factor out common code from git/dir loader.
Oct 22 2015, 10:50 AM · Directory loader, Git loader

Oct 21 2015

olasd added a comment to T116: Add storage endpoints to help with repository updates.

Inspiration :

Oct 21 2015, 6:05 PM · Storage manager
olasd added a subtask for T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too): T116: Add storage endpoints to help with repository updates.
Oct 21 2015, 5:59 PM · Git cloner, Git loader
olasd added a parent task for T116: Add storage endpoints to help with repository updates: T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too).
Oct 21 2015, 5:59 PM · Storage manager
olasd removed a parent task for T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too): T116: Add storage endpoints to help with repository updates.
Oct 21 2015, 5:58 PM · Git cloner, Git loader
olasd removed a subtask for T116: Add storage endpoints to help with repository updates: T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too).
Oct 21 2015, 5:58 PM · Storage manager
olasd added a parent task for T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too): T116: Add storage endpoints to help with repository updates.
Oct 21 2015, 5:58 PM · Git cloner, Git loader
olasd added a subtask for T116: Add storage endpoints to help with repository updates: T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too).
Oct 21 2015, 5:58 PM · Storage manager
olasd triaged T116: Add storage endpoints to help with repository updates as Normal priority.
Oct 21 2015, 5:58 PM · Storage manager
olasd updated the task description for T116: Add storage endpoints to help with repository updates.
Oct 21 2015, 5:57 PM · Storage manager
olasd created T116: Add storage endpoints to help with repository updates.
Oct 21 2015, 5:56 PM · Storage manager
olasd added a comment to T62: DB schema: add directory→tarball provenance information.

We should make sure our abstraction works for things where the original artifact has several files (e.g. a debian source package)

Oct 21 2015, 5:38 PM · Storage manager
olasd closed T113: deploy SSL cert for intranet.softwareheritage.org as Resolved.

Deployed via puppet during the migration of T18.

Oct 21 2015, 12:24 PM
olasd closed T18: migrate intranet.softwareheritage.org (mediawiki) to SWH infrastructure as Resolved.

Deployed via puppet and DNS updated.

Oct 21 2015, 12:24 PM
olasd closed T18: migrate intranet.softwareheritage.org (mediawiki) to SWH infrastructure, a subtask of T113: deploy SSL cert for intranet.softwareheritage.org, as Resolved.
Oct 21 2015, 12:24 PM

Oct 20 2015

olasd added a comment to T51: smart, all-in-one git cloner/loader/ (+ dealing with updates too).

Started playing with dulwich's git smart protocol client.

Oct 20 2015, 7:18 PM · Git cloner, Git loader
zack closed T114: provide data dumps and conffile of the current intranet.softwareheritage.org deployment as Resolved.

this has been scripted on the current hosting site, dumps can be generated whenever we want them to be available

Oct 20 2015, 3:59 PM
zack closed T114: provide data dumps and conffile of the current intranet.softwareheritage.org deployment, a subtask of T18: migrate intranet.softwareheritage.org (mediawiki) to SWH infrastructure, as Resolved.
Oct 20 2015, 3:59 PM
zack created T114: provide data dumps and conffile of the current intranet.softwareheritage.org deployment.
Oct 20 2015, 11:15 AM
zack added a subtask for T113: deploy SSL cert for intranet.softwareheritage.org: T18: migrate intranet.softwareheritage.org (mediawiki) to SWH infrastructure.
Oct 20 2015, 11:15 AM
zack added a parent task for T18: migrate intranet.softwareheritage.org (mediawiki) to SWH infrastructure: T113: deploy SSL cert for intranet.softwareheritage.org.
Oct 20 2015, 11:15 AM
zack created T113: deploy SSL cert for intranet.softwareheritage.org.
Oct 20 2015, 11:11 AM
zack lowered the priority of T71: update database/storage size estimation using current content of SWH DB from High to Normal.
Oct 20 2015, 10:59 AM · Restricted Project

Oct 19 2015

olasd closed T4: SSL certificate for *.softwareheritage.org as Resolved.

Signed certificates and private keys for *.softwareheritage.org and *.internal.softwareheritage.org are now available in rPWD.

Oct 19 2015, 3:14 PM · Restricted Project
olasd added a comment to T111: Performance analysis of read queries.

shortcut query:

explain (analyze,buffers,verbose)     select origin, branch, revision                                                                                                          
    from occurrence_history as occ_hist
    where occ_hist.revision = '\x1140811ebed3b33b496a3aed32ed16b068ebffab'
    order by upper(occ_hist.validity)  -- TODO filter by authority?
    limit 1;
Oct 19 2015, 2:34 PM · Storage manager
olasd added a comment to T111: Performance analysis of read queries.

swh_content_find_directory query :

Oct 19 2015, 2:28 PM · Storage manager
olasd created T111: Performance analysis of read queries.
Oct 19 2015, 2:26 PM · Storage manager
ardumont added a comment to T110: JSONP support in the public API.

Installed on /api/1/stat/counters

Oct 19 2015, 12:37 PM · Web app
ardumont closed T110: JSONP support in the public API as Resolved by committing rDWAPPSad9eafcd611d: Add jsonp decorator.
Oct 19 2015, 12:27 PM · Web app
zack raised the priority of T110: JSONP support in the public API from Normal to High.
Oct 19 2015, 10:00 AM · Web app
zack assigned T110: JSONP support in the public API to ardumont.
Oct 19 2015, 10:00 AM · Web app

Oct 18 2015

zack added a comment to T110: JSONP support in the public API.

we can use this flask decorator:

Oct 18 2015, 6:10 PM · Web app
zack closed T108: add COPYING files to software modules and templates as Resolved.
Oct 18 2015, 9:54 AM · Restricted Project
zack closed T87: fix object storage file permissions on uffizi as Resolved.
Oct 18 2015, 9:53 AM

Oct 16 2015

zack removed a project from T110: JSONP support in the public API: Restricted Project.
Oct 16 2015, 8:50 PM · Web app
zack added a project to T110: JSONP support in the public API: Web app.
Oct 16 2015, 6:14 PM · Web app
zack created T110: JSONP support in the public API.
Oct 16 2015, 6:13 PM · Web app
zack created T109: browsable JSON API.
Oct 16 2015, 4:57 PM · Web app
olasd added a comment to T97: public API backend, with method to return stats.

after rSPROLEf55466f and rSPSITEfe51482 + deployment, https://base.softwareheritage.org/api/1/stat/counters is now available.

Oct 16 2015, 3:52 PM · Web app
zack added a comment to T108: add COPYING files to software modules and templates.

done in all modules registered under swh-environment

Oct 16 2015, 3:05 PM · Restricted Project
ardumont lowered the priority of T98: Produce list of tarballs message from High to Normal.
Oct 16 2015, 2:16 PM · Directory loader
ardumont lowered the priority of T90: swh-loader-tar - Load gnu tarballs in swh-storage from High to Normal.
Oct 16 2015, 2:16 PM · Tarball loader, Directory loader
ardumont lowered the priority of T105: make worker01 stop consuming swh_loader_git messages from High to Normal.
Oct 16 2015, 2:16 PM · Tarball loader, Directory loader
ardumont placed T48: upload-based content search up for grabs.
Oct 16 2015, 2:14 PM · Web app
ardumont closed T107: Load an actual tarball in swh as Resolved.
Oct 16 2015, 12:47 PM · Directory loader
ardumont closed T107: Load an actual tarball in swh, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 16 2015, 12:47 PM · Tarball loader, Directory loader
ardumont claimed T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 16 2015, 12:46 PM · Tarball loader, Directory loader
ardumont claimed T98: Produce list of tarballs message.
Oct 16 2015, 12:46 PM · Directory loader
ardumont closed T99: Make release optional as Resolved.
Oct 16 2015, 12:45 PM · Directory loader
ardumont added a project to T100: Make possible the creation of multiple occurrences: Developers.
Oct 16 2015, 12:45 PM · Directory loader
ardumont added a project to T101: Add synthetic flag to True for swh-loader-dir, tar: Developers.
Oct 16 2015, 12:45 PM · Directory loader
ardumont added a project to T102: Add synthetic flag to false for swh-loader-git: Developers.
Oct 16 2015, 12:45 PM · Git loader
ardumont edited projects for T103: Add synthetic flag in release/revision tables, added: Storage manager, Developers; removed Core & foundations.
Oct 16 2015, 12:44 PM · Storage manager
ardumont claimed T105: make worker01 stop consuming swh_loader_git messages.
Oct 16 2015, 12:43 PM · Tarball loader, Directory loader
ardumont claimed T104: release swh-loader-dir.
Oct 16 2015, 12:43 PM · Directory loader
zack created T108: add COPYING files to software modules and templates.
Oct 16 2015, 12:41 PM · Restricted Project
ardumont added a project to T106: Test on worker01: producing and consuming one swh_loader_tar message: Directory loader.
Oct 16 2015, 12:41 PM · Tarball loader, Directory loader
ardumont created T107: Load an actual tarball in swh.
Oct 16 2015, 12:41 PM · Directory loader
ardumont created T106: Test on worker01: producing and consuming one swh_loader_tar message.
Oct 16 2015, 12:40 PM · Tarball loader, Directory loader
ardumont created T105: make worker01 stop consuming swh_loader_git messages.
Oct 16 2015, 12:40 PM · Tarball loader, Directory loader
ardumont created T104: release swh-loader-dir.
Oct 16 2015, 12:39 PM · Directory loader
ardumont closed T100: Make possible the creation of multiple occurrences as Resolved.
Oct 16 2015, 12:38 PM · Directory loader
ardumont closed T101: Add synthetic flag to True for swh-loader-dir, tar as Resolved.
Oct 16 2015, 12:38 PM · Directory loader
ardumont closed T102: Add synthetic flag to false for swh-loader-git as Resolved.
Oct 16 2015, 12:38 PM · Git loader
ardumont closed T103: Add synthetic flag in release/revision tables as Resolved.
Oct 16 2015, 12:37 PM · Storage manager
ardumont created T103: Add synthetic flag in release/revision tables.
Oct 16 2015, 12:37 PM · Storage manager
ardumont created T102: Add synthetic flag to false for swh-loader-git.
Oct 16 2015, 12:36 PM · Git loader
ardumont created T101: Add synthetic flag to True for swh-loader-dir, tar.
Oct 16 2015, 12:35 PM · Directory loader
ardumont created T100: Make possible the creation of multiple occurrences.
Oct 16 2015, 12:34 PM · Directory loader