Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 16 2015

ardumont created T99: Make release optional.
Oct 16 2015, 12:33 PM · Directory loader
ardumont added a project to T98: Produce list of tarballs message: Directory loader.
Oct 16 2015, 12:33 PM · Directory loader
ardumont created T98: Produce list of tarballs message.
Oct 16 2015, 12:32 PM · Directory loader
zack reassigned T4: SSL certificate for *.softwareheritage.org from zack to olasd.

Status update: Nicolas has submitted the CSR(s), waiting for DigiCert to ack.

Oct 16 2015, 12:16 PM · Restricted Project
olasd closed T97: public API backend, with method to return stats as Resolved.
Oct 16 2015, 12:09 PM · Web app
olasd claimed T97: public API backend, with method to return stats.
Oct 16 2015, 10:23 AM · Web app

Oct 15 2015

zack added a comment to T97: public API backend, with method to return stats.

this will go into the current webui, as the first endpoint that returns json stuff instead of rendering an html page

Oct 15 2015, 4:57 PM · Web app
zack added a project to T97: public API backend, with method to return stats: Web app.
Oct 15 2015, 4:56 PM · Web app
zack created T97: public API backend, with method to return stats.
Oct 15 2015, 4:54 PM · Web app
ardumont closed T79: Improve coverage test as Resolved.
Oct 15 2015, 11:15 AM · Directory loader
zack lowered the priority of T29: evaluate conffile/argparse Python module from Normal to Low.
Oct 15 2015, 10:35 AM · Core & foundations
zack lowered the priority of T4: SSL certificate for *.softwareheritage.org from Normal to Low.
Oct 15 2015, 10:34 AM · Restricted Project
zack raised the priority of T87: fix object storage file permissions on uffizi from Low to Normal.
Oct 15 2015, 10:34 AM
zack added a comment to T87: fix object storage file permissions on uffizi.

current status: about 1/3 done (by the look of it…)

Oct 15 2015, 10:34 AM

Oct 14 2015

zack added a project to T91: puppetize backup of the public SWH website: Language-Puppet.
Oct 14 2015, 4:23 PM · Puppet recipes, Language-Puppet
zack created T91: puppetize backup of the public SWH website.
Oct 14 2015, 4:23 PM · Puppet recipes, Language-Puppet
zack closed T86: backup the swh public website off-gandi as Resolved.
Oct 14 2015, 4:22 PM
zack added a comment to T86: backup the swh public website off-gandi.

This is now done. Some details:

Oct 14 2015, 4:22 PM
zack closed T70: document phabricator callsign conventions for git repositories as Resolved.
Oct 14 2015, 2:16 PM · Documentation
zack added a comment to T70: document phabricator callsign conventions for git repositories.

done at https://intranet.softwareheritage.org/index.php/Phabricator_callsign_naming_convention

Oct 14 2015, 2:16 PM · Documentation
olasd closed T60: deploy webapp at http://base.softwareheritage.org as Resolved.

And apache through to rSPPROFa11a325c.

Oct 14 2015, 12:10 PM · Web app
olasd added a comment to T60: deploy webapp at http://base.softwareheritage.org.

uWSGI has been deployed through rSPPROFb76ea39d4

Oct 14 2015, 10:44 AM · Web app
zack added a project to T90: swh-loader-tar - Load gnu tarballs in swh-storage: Developers.
Oct 14 2015, 10:14 AM · Tarball loader, Directory loader

Oct 13 2015

olasd claimed T60: deploy webapp at http://base.softwareheritage.org.
Oct 13 2015, 3:49 PM · Web app
ardumont created T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 13 2015, 3:38 PM · Tarball loader, Directory loader
ardumont created T89: refactor common behavior between git loader and dir loader.
Oct 13 2015, 3:38 PM · Git loader, Directory loader
ardumont closed T82: Tryouts using linux directory as root directory as Resolved.
Oct 13 2015, 3:34 PM · Directory loader
ardumont added a comment to T82: Tryouts using linux directory as root directory.
  • Runs in ~53s
  • Checks everything got in
Oct 13 2015, 3:34 PM · Directory loader
zack closed T88: DB: add index on content.ctime as Resolved.
Oct 13 2015, 3:11 PM · Storage manager
zack added a comment to T88: DB: add index on content.ctime.

done in rDSTO793fb06f89d27c6ed94ab9392594dab14a941e3f

Oct 13 2015, 3:11 PM · Storage manager
zack closed T56: "devis" for server + disk array to be used as backup for the object storage as Resolved.
Oct 13 2015, 3:10 PM · Restricted Project
zack added a comment to T56: "devis" for server + disk array to be used as backup for the object storage.

Final quotation obtained from Dell, and forwarded to Anna for placing the order.

Oct 13 2015, 3:10 PM · Restricted Project
zack claimed T87: fix object storage file permissions on uffizi.
Oct 13 2015, 2:05 PM
zack added a comment to T87: fix object storage file permissions on uffizi.

chmods restarted in a scren session of root@uffizi

Oct 13 2015, 2:04 PM
zack added a comment to T88: DB: add index on content.ctime.

"create index concurrently ..." is now running on prado, in a screen section

Oct 13 2015, 1:59 PM · Storage manager
zack created T88: DB: add index on content.ctime.
Oct 13 2015, 1:59 PM · Storage manager
olasd added a comment to T87: fix object storage file permissions on uffizi.

committed rDSTO672dd1c as mkstemp creates files with mode 0o600

Oct 13 2015, 12:33 PM
zack updated the task description for T87: fix object storage file permissions on uffizi.
Oct 13 2015, 11:51 AM
zack placed T87: fix object storage file permissions on uffizi up for grabs.
Oct 13 2015, 11:51 AM
zack added a comment to T87: fix object storage file permissions on uffizi.

chmods interrupted, as we just discovered that uwsgi is currently creating object files with perms 0600, which are not the right ones.
We need to first fix that, and then restart the chmods.

Oct 13 2015, 11:51 AM

Oct 12 2015

zack added a comment to T87: fix object storage file permissions on uffizi.

current status: 16 chmods (one for each physical disk) are currently running on uffizi, in a screen session of user root

Oct 12 2015, 5:03 PM
zack created T87: fix object storage file permissions on uffizi.
Oct 12 2015, 5:03 PM
zack created T86: backup the swh public website off-gandi.
Oct 12 2015, 3:49 PM
olasd closed T69: backup: log dar output to file as Resolved by committing rSPDARea479fcd9dd9: dar::backup: add logfile and silence output.
Oct 12 2015, 10:44 AM
olasd added a comment to T15: add systemd service file for forge IRC bot.

The systemd service file has been added, but it doesn't go well with the other phabricator daemons that are running...

Oct 12 2015, 10:20 AM
olasd closed T76: Reload repositories whose import failed due to connection issues as Resolved.

Those repositories have been rescheduled with the rest of the 13 million repos that hadn't been imported yet.

Oct 12 2015, 10:17 AM · Git loader
zack added a comment to T56: "devis" for server + disk array to be used as backup for the object storage.

Just pinged the Dell commercial. I've been waiting for 1 week now for a quotation from him.

Oct 12 2015, 9:50 AM · Restricted Project
ardumont closed T81: Alternate implementation using pygit as Invalid.
Oct 12 2015, 9:44 AM · Directory loader

Oct 11 2015

olasd closed T74: Reload repositories with skipped content as Resolved.

In progress.

Oct 11 2015, 1:47 PM
olasd closed T73: Reload repositories with null tag names as Resolved.

The tasks are currently running.

Oct 11 2015, 12:57 PM · Git loader

Oct 9 2015

ardumont claimed T82: Tryouts using linux directory as root directory.
Oct 9 2015, 5:27 PM · Directory loader
olasd claimed T57: git commit IRC notifications on #swh-devel.
Oct 9 2015, 3:19 PM · General
olasd added a comment to T57: git commit IRC notifications on #swh-devel.
Oct 9 2015, 3:15 PM · General
olasd added a comment to T57: git commit IRC notifications on #swh-devel.

Added another setting "notification.types" : ["task", "cmit"]

Oct 9 2015, 3:13 PM · General
olasd added a comment to T57: git commit IRC notifications on #swh-devel.

Added a setting "notifications.verbosity" in the bot config file. The default disabled notifications...

Oct 9 2015, 3:06 PM · General
olasd closed T85: test Fri, 09 Oct 2015 14:29:42 +0200 as Invalid.
Oct 9 2015, 2:41 PM
olasd added a comment to T13: setup inbound email for forge.

We can configure "application emails" to route inbound email to phabricator applications. We can then use Herald rules to route those addresses properly.

Oct 9 2015, 2:40 PM
olasd created T85: test Fri, 09 Oct 2015 14:29:42 +0200.
Oct 9 2015, 2:29 PM
olasd closed T13: setup inbound email for forge as Resolved.

Pending DNS propagation, this should be done.

Oct 9 2015, 2:15 PM
olasd closed T84: Add parameters for relaying to puppet postfix as Resolved.

done in rSPPFIX840582c1d52c and rSPPFIXf97729a999d3

Oct 9 2015, 12:39 PM
olasd closed T84: Add parameters for relaying to puppet postfix, a subtask of T13: setup inbound email for forge, as Resolved.
Oct 9 2015, 12:39 PM
olasd created T84: Add parameters for relaying to puppet postfix.
Oct 9 2015, 11:47 AM
zack closed T83: open inbound port 25 to forge.softwareheritage.org, a subtask of T13: setup inbound email for forge, as Invalid.
Oct 9 2015, 11:03 AM
zack closed T83: open inbound port 25 to forge.softwareheritage.org as Invalid.
Oct 9 2015, 11:03 AM
zack created T83: open inbound port 25 to forge.softwareheritage.org.
Oct 9 2015, 10:59 AM
ardumont created T82: Tryouts using linux directory as root directory.
Oct 9 2015, 10:32 AM · Directory loader
ardumont closed T80: Improve README as Resolved by committing rDLDDIR4bb7d6ac77e0: Add minimal information needed for running loader.
Oct 9 2015, 10:29 AM · Directory loader
ardumont renamed T79: Improve coverage test from swh-loader-dir - Improve coverage test to Improve coverage test.
Oct 9 2015, 9:52 AM · Directory loader
ardumont added a project to T80: Improve README: Staff.
Oct 9 2015, 9:51 AM · Directory loader
ardumont added a comment to T60: deploy webapp at http://base.softwareheritage.org.

swh's puppet state of art - https://forge.softwareheritage.org/diffusion/SENV/

Oct 9 2015, 9:49 AM · Web app
ardumont created T81: Alternate implementation using pygit.
Oct 9 2015, 9:48 AM · Directory loader
ardumont triaged T80: Improve README as Normal priority.
Oct 9 2015, 9:47 AM · Directory loader
ardumont created T80: Improve README.
Oct 9 2015, 9:40 AM · Directory loader
ardumont closed T9: directory (= extracted archive) loader - 1st deployable version as Resolved.
Oct 9 2015, 9:40 AM · Directory loader
ardumont created T79: Improve coverage test.
Oct 9 2015, 9:39 AM · Directory loader

Oct 8 2015

ardumont added a comment to T9: directory (= extracted archive) loader - 1st deployable version.
  • Inject content
  • Inject directories
  • Inject revision
  • Inject release
  • Inject occurrence
  • Add tests on lower level
  • Tag + Release + Install to make sure the packaging is ok
  • pep8 compliance + tests ok
  • Orchestration test
Oct 8 2015, 10:19 AM · Directory loader

Oct 7 2015

zack added a comment to T67: prototype: git clone from SWH.

In light of issues like T78 , the ideal test based on "git cloning" from SWH would include both:

  • verifying that the top-most commits have the right sha1_git checksum, and
  • verifying that the Git object store contains all and only the objects we started with
Oct 7 2015, 3:15 PM · Vault, General
olasd created T78: Unable to perfectly round-trip releases pointed at by occurrences.
Oct 7 2015, 1:57 PM · Storage manager
zack removed a project from T77: continuous integration to run test suite and static code checks: Restricted Project.
Oct 7 2015, 9:41 AM · Phabricator
zack created T77: continuous integration to run test suite and static code checks.
Oct 7 2015, 9:25 AM · Phabricator

Oct 6 2015

zack added a project to T74: Reload repositories with skipped content: Developers.
Oct 6 2015, 2:46 PM
olasd created T76: Reload repositories whose import failed due to connection issues.
Oct 6 2015, 2:42 PM · Git loader
olasd renamed T75: Check integrity of directories, revisions, and releases from Check integrity of Revisions and Tags to Check integrity of Revisions and Releases.
Oct 6 2015, 2:37 PM · Archive content, Restricted Project
olasd created T75: Check integrity of directories, revisions, and releases.
Oct 6 2015, 2:36 PM · Archive content, Restricted Project
olasd closed T65: Support authors with non-utf8-encoded names as Resolved by committing rDSTOe80adb87444c: swh-schema: person (name, email) -> bytea.
Oct 6 2015, 2:02 PM · Storage manager, Git loader
olasd created T74: Reload repositories with skipped content.
Oct 6 2015, 12:46 PM
olasd added projects to T73: Reload repositories with null tag names: Developers, Git loader.
Oct 6 2015, 12:43 PM · Git loader
olasd created T73: Reload repositories with null tag names.
Oct 6 2015, 12:43 PM · Git loader
olasd closed T64: Support tags with empty or non-utf8 messages as Resolved.

Done in rDLDG61e2b1ecd061

Oct 6 2015, 12:28 PM · Git loader
zack created T72: occurrence history table: use an array of timestamps instead of intervals.
Oct 6 2015, 10:52 AM · Storage manager
zack created T71: update database/storage size estimation using current content of SWH DB.
Oct 6 2015, 10:00 AM · Restricted Project
zack added a comment to T56: "devis" for server + disk array to be used as backup for the object storage.

Status update: after a couple of round of discussions with dell commercial and pre-sale engineers, they now get what we need.
We're now waiting on them to send us a proper quotation.

Oct 6 2015, 9:58 AM · Restricted Project
zack created T70: document phabricator callsign conventions for git repositories.
Oct 6 2015, 9:56 AM · Documentation
zack created T69: backup: log dar output to file.
Oct 6 2015, 9:54 AM

Oct 5 2015

olasd closed T45: Fix swh.storage.storage.occurrence_add for overlapping intervals as Resolved by committing rDSTO1f7ca7c960a7: swh.storage.storage: make occurrence_add support overlapping intervals.
Oct 5 2015, 6:47 PM · Storage manager
zack created T68: support for git tags that point to arbitrary git objects, instead of revisions.
Oct 5 2015, 2:24 PM · Git loader
olasd closed T2: mail forwarding on all VMs as Resolved by committing rSPPROFd2553fd7edf5: profile::base: add mail aliases.
Oct 5 2015, 12:30 PM
olasd closed T63: Fix backups failing when a file changes as Resolved by committing rSPDARd1b5b9618f3b: swh-dar-backup: allow dar to backup "moving" files.
Oct 5 2015, 11:55 AM
zack closed T6: backup: postgres DB as Resolved.
Oct 5 2015, 9:38 AM

Oct 4 2015

zack renamed T66: clone and load fork GitHub repositories from clone and load non-fork GitHub repositories to clone and load fork GitHub repositories.
Oct 4 2015, 5:45 PM · Restricted Project, General