Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 12 2016

ardumont closed T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, a subtask of T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] , as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont closed T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, a subtask of T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ , as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont closed T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, a subtask of T252: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/directory/[<PATH>] , as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont closed T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/ as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont closed T261: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/ as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont closed T261: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, a subtask of T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, as Resolved.
Jan 12 2016, 4:14 PM · Web app
ardumont added subtasks for T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] : T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ .
Jan 12 2016, 4:06 PM · Web app
ardumont added a parent task for T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/: T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] .
Jan 12 2016, 4:06 PM · Web app
ardumont added a parent task for T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ : T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] .
Jan 12 2016, 4:06 PM · Web app
ardumont added a subtask for T252: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/directory/[<PATH>] : T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Jan 12 2016, 4:06 PM · Web app
ardumont added a parent task for T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/: T252: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/directory/[<PATH>] .
Jan 12 2016, 4:06 PM · Web app
ardumont added a subtask for T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ : T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Jan 12 2016, 4:05 PM · Web app
ardumont added a parent task for T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/: T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ .
Jan 12 2016, 4:05 PM · Web app
zack added a comment to T262: Upgrade postgresql to 9.5.

Agreed, pgbouncer would be nice (and IIRC also the choice that Dimitri recommended to us a while back).

Jan 12 2016, 3:45 PM
olasd added a comment to T262: Upgrade postgresql to 9.5.

The latest pgbouncer release (1.7) supports TLS, hba and unix peer authentification so looks like a good candidate. I submitted a bug to Debian to ask for an update of the package : https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=810816

Jan 12 2016, 3:30 PM
olasd created T262: Upgrade postgresql to 9.5.
Jan 12 2016, 2:39 PM
olasd added a comment to T111: Performance analysis of read queries.

The object_id column looks like something that we want.

Jan 12 2016, 2:30 PM · Storage manager

Jan 11 2016

ardumont claimed T261: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Jan 11 2016, 4:56 PM · Web app
ardumont closed T260: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>], a subtask of T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, as Resolved.
Jan 11 2016, 4:56 PM · Web app
ardumont closed T260: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>] as Resolved.
Jan 11 2016, 4:56 PM · Web app
ardumont closed T259: Open /api/1/revision/origin/<ORIG_ID>, a subtask of T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/, as Resolved.
Jan 11 2016, 4:55 PM · Web app
ardumont closed T259: Open /api/1/revision/origin/<ORIG_ID> as Resolved.
Jan 11 2016, 4:55 PM · Web app

Jan 8 2016

ardumont claimed T259: Open /api/1/revision/origin/<ORIG_ID>.
Jan 8 2016, 4:20 PM · Web app
ardumont created T261: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Jan 8 2016, 4:20 PM · Web app
ardumont created T260: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>].
Jan 8 2016, 4:19 PM · Web app
ardumont created T259: Open /api/1/revision/origin/<ORIG_ID>.
Jan 8 2016, 4:19 PM · Web app
ardumont created T258: /api/revision/<sha1_git>/log/ uses a limit which should not exist.
Jan 8 2016, 3:54 PM · Web app
olasd added a comment to T111: Performance analysis of read queries.

I'm currently toying around with another approach for those recursive queries:

Jan 8 2016, 12:07 PM · Storage manager
ardumont closed T257: Open /revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/directory/[<PATH>] as Resolved by committing rDWAPPS3af2cea26f18: Tests '/api/1/revision/<string….
Jan 8 2016, 11:43 AM · Web app

Jan 7 2016

ardumont created T257: Open /revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/directory/[<PATH>].
Jan 7 2016, 4:42 PM · Web app
ardumont closed T249: Open /api/1/revision/<SHA1_GIT>/directory/[<PATH>] as Resolved.
Jan 7 2016, 4:41 PM · Web app
ardumont claimed T249: Open /api/1/revision/<SHA1_GIT>/directory/[<PATH>] .
Jan 7 2016, 10:40 AM · Web app

Jan 6 2016

ardumont added a comment to T256: Improve browsable api rendering view.
  • 29cf070 * master origin/master Unify docstring with ending point sentence.
  • 39063c8 * Open 'limit' get query parameter to revision_log and revision_history api
  • 35e4d04 * Use h4 to clearly separate subtitle from text.
  • efc7802 * service.lookup_revision_log: Add a limit to the number of commits
  • f6a48f8 * Improve browsable api rendering style
  • 32380e9 * Fix typo in jquery.min.js link
  • 24fec0c * Improve browsable api rendering with links
Jan 6 2016, 5:21 PM · Web app
ardumont closed T256: Improve browsable api rendering view as Resolved.
Jan 6 2016, 4:06 PM · Web app
ardumont created T256: Improve browsable api rendering view.
Jan 6 2016, 4:06 PM · Web app

Jan 5 2016

ardumont closed T248: Open /api/1/revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/ as Resolved by committing rDWAPPS4b94346ad2b8: Proper contextual navigation for revision history api.
Jan 5 2016, 5:49 PM · Web app

Jan 4 2016

zack triaged T255: Don't let swh.loader.dir block on special files (block devices, fifos) as Normal priority.
Jan 4 2016, 2:05 PM · Data Model, Restricted Project, Directory loader
ardumont claimed T248: Open /api/1/revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/.
Jan 4 2016, 10:52 AM · Web app

Jan 2 2016

olasd created T255: Don't let swh.loader.dir block on special files (block devices, fifos).
Jan 2 2016, 1:07 AM · Data Model, Restricted Project, Directory loader
olasd closed T118: Create swh-loader-debian as Resolved.

The loader has been running over christmas break and is working.

Jan 2 2016, 1:06 AM · Debian loader, Origin-Debian
olasd closed T213: Create synthetic releases for Debian packages as Resolved.

as of rDLDDEB7ff7ecd22592c9f4dafb44a99ac91f803fd9cac2

Jan 2 2016, 1:06 AM · Origin-Debian, Debian loader
olasd closed T213: Create synthetic releases for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Jan 2 2016, 1:06 AM · Debian loader, Origin-Debian
olasd closed T214: Create occurrences for Debian packages as Resolved.

rDLDDEBe7108fed5a4a9ece62ad4e52d4fa9a8f95377844 creates the "Software Heritage has seen this package at date <foo> in snapshot.d.o" occurrence

Jan 2 2016, 1:02 AM · Origin-Debian, Debian loader
olasd closed T214: Create occurrences for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Jan 2 2016, 1:02 AM · Debian loader, Origin-Debian

Dec 17 2015

ardumont closed T254: api - Update links in data to improve context-independent browsing as Resolved by committing rDWAPPS9d8c9614b94a: Unify release api to target revision.
Dec 17 2015, 3:14 PM
ardumont triaged T254: api - Update links in data to improve context-independent browsing as High priority.
Dec 17 2015, 3:06 PM
ardumont created T254: api - Update links in data to improve context-independent browsing.
Dec 17 2015, 3:00 PM
zack added a comment to T237: test postgres db restore.
Dec 17 2015, 12:25 PM
ardumont updated the task description for T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] .
Dec 17 2015, 10:50 AM · Web app
ardumont updated the task description for T252: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/directory/[<PATH>] .
Dec 17 2015, 10:50 AM · Web app
ardumont updated the task description for T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ .
Dec 17 2015, 10:49 AM · Web app
ardumont updated the task description for T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ .
Dec 17 2015, 10:48 AM · Web app
ardumont updated the task description for T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Dec 17 2015, 10:47 AM · Web app
ardumont created T253: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/directory/[<PATH>] .
Dec 17 2015, 10:46 AM · Web app
ardumont created T252: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/directory/[<PATH>] .
Dec 17 2015, 10:46 AM · Web app
ardumont created T251: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/history/<SHA1>/ .
Dec 17 2015, 10:44 AM · Web app
ardumont created T250: Open /api/1/revision/origin/<ORIG_ID>[/branch/<BRANCH>][/ts/<TIMESTAMP>]/.
Dec 17 2015, 10:44 AM · Web app
ardumont updated the task description for T248: Open /api/1/revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/.
Dec 17 2015, 10:20 AM · Web app
ardumont created T249: Open /api/1/revision/<SHA1_GIT>/directory/[<PATH>] .
Dec 17 2015, 10:19 AM · Web app
ardumont created T248: Open /api/1/revision/<SHA1_GIT_ROOT>/history/<SHA1_GIT>/.
Dec 17 2015, 10:14 AM · Web app
ardumont renamed T246: Open /browse/entity/<uuid> view from Open /entity/<uuid> view to Open /browse/entity/<uuid> view.
Dec 17 2015, 10:07 AM · Web app
ardumont added a subtask for T246: Open /browse/entity/<uuid> view: T247: Open /api/1/entity/<uuid>.
Dec 17 2015, 10:06 AM · Web app
ardumont added a parent task for T247: Open /api/1/entity/<uuid>: T246: Open /browse/entity/<uuid> view.
Dec 17 2015, 10:06 AM · Web app
ardumont created T247: Open /api/1/entity/<uuid>.
Dec 17 2015, 10:05 AM · Web app
ardumont created T246: Open /browse/entity/<uuid> view.
Dec 17 2015, 10:05 AM · Web app

Dec 16 2015

ardumont closed T245: Autodoc browsable api endpoint as Resolved.
Dec 16 2015, 10:23 AM · Web app
ardumont closed T244: Open /browse/revision view as Resolved.
Dec 16 2015, 10:23 AM · Web app
ardumont closed T243: Open /browse/release view as Resolved.
Dec 16 2015, 10:23 AM · Web app
ardumont closed T242: Open /browse/person/ as Resolved.
Dec 16 2015, 10:22 AM · Web app
ardumont closed T241: Open /browse/origin/ as Resolved.
Dec 16 2015, 10:06 AM · Web app
ardumont created T245: Autodoc browsable api endpoint.
Dec 16 2015, 10:06 AM · Web app
ardumont created T244: Open /browse/revision view.
Dec 16 2015, 10:02 AM · Web app
ardumont created T243: Open /browse/release view.
Dec 16 2015, 10:01 AM · Web app
ardumont created T242: Open /browse/person/.
Dec 16 2015, 10:01 AM · Web app
ardumont created T241: Open /browse/origin/.
Dec 16 2015, 10:00 AM · Web app

Dec 15 2015

zack closed T237: test postgres db restore as Resolved.

This is now done. It worked well, but it's really slow.

Dec 15 2015, 10:03 AM

Dec 14 2015

zack added a comment to T240: content archiver.

Draft blueprint of the content archiver is available at https://intranet.softwareheritage.org/index.php?title=Content_archiver_blueprint

Dec 14 2015, 6:19 PM · Storage manager
zack created T240: content archiver.
Dec 14 2015, 6:17 PM · Storage manager
zack created T239: preserve at least 2 copies of each content object.
Dec 14 2015, 6:15 PM · General
olasd closed T229: louvre: restart the swhdata{1,2,3} multipath devices to pick up config changes as Resolved.

Done during the 2015-12 reboot

Dec 14 2015, 4:07 PM

Dec 12 2015

zack added a comment to T238: barman@banco:~$ ssh postgres@db-public: connection refused on port 10022.
In T238#2777, @olasd wrote:

Added DNAT configuration to louvre:/etc/network/interfaces.

Dec 12 2015, 5:53 PM
olasd added a comment to T237: test postgres db restore.
Starting local restore for server swh using backup 20151204T074046
Destination directory: /srv/storage/0/barman-backup-restore-test-T237/
Copying the base backup.
Copying required WAL segments.
Generating archive status files
Identify dangerous settings in destination directory.
Dec 12 2015, 4:25 PM
olasd closed T238: barman@banco:~$ ssh postgres@db-public: connection refused on port 10022 as Resolved.

Added DNAT configuration to louvre:/etc/network/interfaces.

Dec 12 2015, 2:07 PM
zack created T238: barman@banco:~$ ssh postgres@db-public: connection refused on port 10022.
Dec 12 2015, 10:56 AM

Dec 10 2015

zack changed the status of T237: test postgres db restore from Open to Work in Progress.
Dec 10 2015, 12:12 PM
zack claimed T237: test postgres db restore.

this is now ongoing on banco, in a screen session of user barman

Dec 10 2015, 12:11 PM

Dec 9 2015

olasd closed T231: banco: prepare object storage as Resolved.
  • foreach $i in 0..f
    • Created 10TB logical volume vg-swhbackup/backup$i
    • Created XFS filesystem on /dev/mapper/vg--swhbackup-backup$i
    • Created directory /srv/storage/space/$i
    • Mounted /dev/mapper/vg--swhbackup-backup$i on /srv/storage/space/$i
    • foreach $j in 0..f
      • Created directories /srv/storage/space/$i/$i$j and /srv/softwareheritage/objects/$i$j
      • Mounted directory /srv/storage/space/$i/$i$j on /srv/softwareheritage/objects/$i$j
Dec 9 2015, 8:09 PM
olasd closed T232: banco: prepare barman storage as Resolved.

Done (lv name: vg-swhbackup/barman, size = 20TB)

Dec 9 2015, 7:07 PM
olasd closed T230: banco: make the raid device + lvm volume group on top of the three logical volumes, a subtask of T231: banco: prepare object storage, as Resolved.
Dec 9 2015, 7:06 PM
olasd closed T230: banco: make the raid device + lvm volume group on top of the three logical volumes as Resolved.

Done (vg name: vg-swhbackup).

Dec 9 2015, 7:06 PM
olasd closed T230: banco: make the raid device + lvm volume group on top of the three logical volumes, a subtask of T232: banco: prepare barman storage, as Resolved.
Dec 9 2015, 7:06 PM
olasd closed T228: banco: restart the swhbackup1 multipath device to pick up multipath config changes as Resolved.

Done.

Dec 9 2015, 7:06 PM
olasd closed T228: banco: restart the swhbackup1 multipath device to pick up multipath config changes, a subtask of T230: banco: make the raid device + lvm volume group on top of the three logical volumes, as Resolved.
Dec 9 2015, 7:06 PM
ardumont closed T203: /api/1/organization/<ORGANIZATION_ID>: show organization information as Invalid.
Dec 9 2015, 4:52 PM · Web app
ardumont closed T202: /api/1/project/<PROJECT_ID>: show project information as Invalid.
Dec 9 2015, 4:52 PM · Web app
ardumont closed T197: /api/1/directory/<SHA1_GIT>/path/to/file-or-dir: ditto, but for file or directory pointed by path as Invalid.
Dec 9 2015, 4:52 PM · Web app
ardumont closed T204: /api/1/directory/<SHA1_GIT>/path/to/file-or-dir?timestamp=<TIMESTAMP>&origin=<ORIGIN>&branch<BRANCH> as Invalid.
Dec 9 2015, 4:52 PM · Web app
ardumont closed T205: /api/1/revision/<SHA1_GIT>?timestamp=<TIMESTAMP>&origin=<ORIGIN> as Invalid.
Dec 9 2015, 4:52 PM · Web app
olasd closed T212: Create synthetic revisions for Debian packages as Resolved.

Done in rDLDDEBa05fc523fd.

Dec 9 2015, 3:56 PM · Origin-Debian, Debian loader
olasd closed T212: Create synthetic revisions for Debian packages, a subtask of T118: Create swh-loader-debian, as Resolved.
Dec 9 2015, 3:56 PM · Debian loader, Origin-Debian