Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Oct 29 2015

ardumont closed T156: Package latest swh-storage, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 2:10 PM · Directory loader, Tarball loader
ardumont closed T157: Package latest swh-loader-dir as Resolved.
Oct 29 2015, 10:51 AM · Directory loader, Tarball loader
ardumont closed T157: Package latest swh-loader-dir, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 10:51 AM · Directory loader, Tarball loader
ardumont closed T158: Package latest swh-loader-tar, a subtask of T155: Deploy and load tarballs from worker01, as Resolved.
Oct 29 2015, 10:46 AM · Directory loader, Tarball loader
ardumont closed T158: Package latest swh-loader-tar as Resolved.
Oct 29 2015, 10:46 AM · Tarball loader, Directory loader
zack closed T36: performance estimation: how long will it take to git-bulk-load all the GitHub repos we have as Resolved.
Oct 29 2015, 10:04 AM · Git loader
olasd closed T167: anacron logrotate failure on prado: /var/log/syslog.1.xz: File exists as Resolved.

Actually, I ran logrotate -f /etc/logrotate.conf and it ran okay.

Oct 29 2015, 8:06 AM
olasd claimed T167: anacron logrotate failure on prado: /var/log/syslog.1.xz: File exists.

I removed the culprit file (which was empty). I suppose it's a side effect of the out of disk issue of last week.

Oct 29 2015, 8:05 AM
zack created T167: anacron logrotate failure on prado: /var/log/syslog.1.xz: File exists.
Oct 29 2015, 7:59 AM

Oct 28 2015

zack added a comment to T166: functional tests for the web UI, with actual data.

FWIW, my preference is for (2), i.e., object mocking.

Oct 28 2015, 7:01 PM · Web app
zack created T166: functional tests for the web UI, with actual data.
Oct 28 2015, 7:01 PM · Web app
zack renamed T48: upload-based content search from Upload a file, computes its sha1 hash and sha256 hash and check its existence in swh's storage to upload-based content search.
Oct 28 2015, 6:58 PM · Web app
zack created T165: web app initialized twice(?).
Oct 28 2015, 6:53 PM · Web app
olasd added a comment to T119: snapshot.debian.org producer.

We should likely do the snapshot.d.o import in several passes:

Oct 28 2015, 6:47 PM · Origin-Debian, Debian loader
olasd added a parent task for T163: Add entry points to create / request entities in swh.storage: T164: Port GitHub lister to swh.storage instead of sqlalchemy.
Oct 28 2015, 6:42 PM · Storage manager
olasd added a subtask for T164: Port GitHub lister to swh.storage instead of sqlalchemy: T163: Add entry points to create / request entities in swh.storage.
Oct 28 2015, 6:42 PM · GitHub lister
olasd created T164: Port GitHub lister to swh.storage instead of sqlalchemy.
Oct 28 2015, 6:42 PM · GitHub lister
olasd created T163: Add entry points to create / request entities in swh.storage.
Oct 28 2015, 6:41 PM · Storage manager
olasd added a comment to T62: DB schema: add directory→tarball provenance information.

We're settling on a new table:

Oct 28 2015, 5:31 PM · Storage manager
ardumont removed a parent task for T62: DB schema: add directory→tarball provenance information: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 28 2015, 4:58 PM · Storage manager
ardumont removed a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T62: DB schema: add directory→tarball provenance information.
Oct 28 2015, 4:58 PM · Tarball loader, Directory loader
olasd added a comment to T121: Populate fetch_history.

fetch_history is now getting populated by swh.loader.git.

Oct 28 2015, 3:32 PM · Storage manager
ardumont created T158: Package latest swh-loader-tar.
Oct 28 2015, 12:07 PM · Tarball loader, Directory loader
ardumont added a parent task for T157: Package latest swh-loader-dir: T155: Deploy and load tarballs from worker01.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont added a subtask for T155: Deploy and load tarballs from worker01: T157: Package latest swh-loader-dir.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont removed a parent task for T157: Package latest swh-loader-dir: T156: Package latest swh-storage.
Oct 28 2015, 12:07 PM · Directory loader, Tarball loader
ardumont removed a subtask for T156: Package latest swh-storage: T157: Package latest swh-loader-dir.
Oct 28 2015, 12:07 PM · Tarball loader, Directory loader
ardumont created T157: Package latest swh-loader-dir.
Oct 28 2015, 12:06 PM · Directory loader, Tarball loader
ardumont created T156: Package latest swh-storage.
Oct 28 2015, 12:06 PM · Tarball loader, Directory loader
ardumont created T155: Deploy and load tarballs from worker01.
Oct 28 2015, 12:06 PM · Directory loader, Tarball loader
ardumont closed T142: reload missing tarballs, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Invalid.
Oct 28 2015, 12:05 PM · Tarball loader, Directory loader
ardumont closed T142: reload missing tarballs as Invalid.
Oct 28 2015, 12:05 PM · Directory loader, Tarball loader
ardumont closed T154: Send tarball checksums along the revision, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 28 2015, 12:04 PM · Tarball loader, Directory loader
ardumont closed T154: Send tarball checksums along the revision as Resolved.
Oct 28 2015, 12:04 PM · Directory loader, Tarball loader
ardumont created T154: Send tarball checksums along the revision.
Oct 28 2015, 11:30 AM · Directory loader, Tarball loader
ardumont closed T22: DB schema: add metadata field to revision table as Resolved by committing rDSTOba31ca32cb01: Add metadata field to revision table.
Oct 28 2015, 11:29 AM · Storage manager
ardumont closed T22: DB schema: add metadata field to revision table, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 28 2015, 11:29 AM · Tarball loader, Directory loader

Oct 27 2015

ardumont claimed T22: DB schema: add metadata field to revision table.
Oct 27 2015, 5:25 PM · Storage manager
ardumont added a parent task for T22: DB schema: add metadata field to revision table: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 27 2015, 4:03 PM · Storage manager
ardumont added a parent task for T148: Populate fetch_history: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 27 2015, 4:03 PM · Tarball loader
ardumont added subtasks for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T149: Populate fetch_history table, T148: Populate fetch_history, T22: DB schema: add metadata field to revision table.
Oct 27 2015, 4:03 PM · Tarball loader, Directory loader
ardumont added a parent task for T149: Populate fetch_history table: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 27 2015, 4:03 PM · Directory loader
ardumont closed T148: Populate fetch_history as Resolved by committing rDLDTARa370bb45254a: Refactor - Create an actual tarloader.
Oct 27 2015, 2:47 PM · Tarball loader
ardumont closed T148: Populate fetch_history, a subtask of T121: Populate fetch_history, as Resolved.
Oct 27 2015, 2:47 PM · Storage manager
olasd closed T30: port ghlister to swh.* namespace and conventions as Resolved by committing rDLScabf83613c76: ghlister: move to swh.lister.github as per swh convention.
Oct 27 2015, 2:38 PM · GitHub lister
olasd closed T30: port ghlister to swh.* namespace and conventions, a subtask of T37: port ghlister to swh task interface - daily updates, as Resolved.
Oct 27 2015, 2:38 PM · GitHub lister
olasd closed T30: port ghlister to swh.* namespace and conventions, a subtask of T38: port ghlister to swh task interface - list all / catch up, as Resolved.
Oct 27 2015, 2:38 PM · GitHub lister
zack placed T38: port ghlister to swh task interface - list all / catch up up for grabs.
Oct 27 2015, 2:04 PM · GitHub lister
zack placed T37: port ghlister to swh task interface - daily updates up for grabs.
Oct 27 2015, 2:03 PM · GitHub lister
zack placed T30: port ghlister to swh.* namespace and conventions up for grabs.
Oct 27 2015, 2:03 PM · GitHub lister
ardumont closed T149: Populate fetch_history table as Resolved by committing rDLDDIRf2240d1fc22f: Populate fetch history when loading a directory.
Oct 27 2015, 1:14 PM · Directory loader
ardumont closed T149: Populate fetch_history table, a subtask of T121: Populate fetch_history, as Resolved.
Oct 27 2015, 1:14 PM · Storage manager
ardumont removed a parent task for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:38 AM · Directory loader
ardumont removed a subtask for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:38 AM · Tarball loader
ardumont renamed T149: Populate fetch_history table from Populate optionally fetch_history table (default to true but overridable) to Populate fetch_history table.
Oct 27 2015, 10:38 AM · Directory loader
ardumont updated the task description for T149: Populate fetch_history table.
Oct 27 2015, 10:37 AM · Directory loader
ardumont added a parent task for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:11 AM · Directory loader
ardumont added a subtask for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont removed a subtask for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:11 AM · Directory loader
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont added a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:11 AM · Tarball loader
ardumont added a subtask for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:11 AM · Directory loader
ardumont removed a subtask for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:10 AM · Directory loader
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:10 AM · Tarball loader
ardumont added a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
Oct 27 2015, 10:08 AM · Tarball loader
ardumont added a subtask for T149: Populate fetch_history table: T148: Populate fetch_history.
Oct 27 2015, 10:08 AM · Directory loader
ardumont renamed T149: Populate fetch_history table from Use optionally fetch_history table (default to true but overridable) to Populate optionally fetch_history table (default to true but overridable).
Oct 27 2015, 10:07 AM · Directory loader
ardumont renamed T148: Populate fetch_history from Use fetch_history table to Populate fetch_history.
Oct 27 2015, 10:06 AM · Tarball loader
ardumont renamed T148: Populate fetch_history from swh-loader-tar - Use fetch history to Use fetch_history table.
Oct 27 2015, 10:05 AM · Tarball loader
ardumont created T149: Populate fetch_history table.
Oct 27 2015, 10:04 AM · Directory loader
ardumont created T148: Populate fetch_history.
Oct 27 2015, 10:03 AM · Tarball loader

Oct 26 2015

ardumont closed T147: Migrate code to use latest schema improvments from T3 as Invalid.
Oct 26 2015, 4:59 PM · Directory loader, Tarball loader
ardumont closed T147: Migrate code to use latest schema improvments from T3, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Invalid.
Oct 26 2015, 4:59 PM · Tarball loader, Directory loader
ardumont created T147: Migrate code to use latest schema improvments from T3.
Oct 26 2015, 4:56 PM · Directory loader, Tarball loader
olasd closed T3: Discuss the project <-> origin mapping as Resolved by committing rDSTO5c2a6fc2dc6b: sql: update schema of organizations and projects.
Oct 26 2015, 4:26 PM · Storage manager
olasd added a comment to T121: Populate fetch_history.

rDSTO04bb5cb is a first approach for this.

Oct 26 2015, 4:24 PM · Storage manager
ardumont added a subtask for T90: swh-loader-tar - Load gnu tarballs in swh-storage: T62: DB schema: add directory→tarball provenance information.
Oct 26 2015, 3:25 PM · Tarball loader, Directory loader
ardumont added a parent task for T62: DB schema: add directory→tarball provenance information: T90: swh-loader-tar - Load gnu tarballs in swh-storage.
Oct 26 2015, 3:25 PM · Storage manager
ardumont closed T140: analysis errors on first loading batch, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 26 2015, 3:20 PM · Tarball loader, Directory loader
ardumont closed T140: analysis errors on first loading batch as Resolved.
Oct 26 2015, 3:20 PM · Directory loader, Tarball loader
ardumont closed T141: compute missing tarballs list for reloading the ones missing, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 26 2015, 3:19 PM · Tarball loader, Directory loader
ardumont closed T141: compute missing tarballs list for reloading the ones missing as Resolved.
Oct 26 2015, 3:19 PM · Directory loader, Tarball loader
ardumont closed T143: understand why errors does not appear in log db as Resolved.
Oct 26 2015, 3:19 PM · Directory loader, Tarball loader
ardumont closed T143: understand why errors does not appear in log db, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 26 2015, 3:19 PM · Tarball loader, Directory loader
ardumont added a comment to T143: understand why errors does not appear in log db.

They do, i just need to:

  • fix the typo in logger dir (done)
  • look at the right column jsonb data
Oct 26 2015, 3:19 PM · Directory loader, Tarball loader
ardumont closed T136: Load tarballs in a production-like swh-storage instance on worker01 as Resolved.
Oct 26 2015, 12:33 PM · Directory loader, Tarball loader
ardumont closed T136: Load tarballs in a production-like swh-storage instance on worker01, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 26 2015, 12:33 PM · Tarball loader, Directory loader
ardumont created T143: understand why errors does not appear in log db.
Oct 26 2015, 12:33 PM · Directory loader, Tarball loader
ardumont created T142: reload missing tarballs.
Oct 26 2015, 12:30 PM · Directory loader, Tarball loader
ardumont created T141: compute missing tarballs list for reloading the ones missing.
Oct 26 2015, 12:30 PM · Directory loader, Tarball loader
ardumont created T140: analysis errors on first loading batch.
Oct 26 2015, 12:30 PM · Directory loader, Tarball loader

Oct 23 2015

ardumont added a comment to T136: Load tarballs in a production-like swh-storage instance on worker01.
  • old-gnu messages loaded in broker
  • loading gnu messages in broker

in progress...

Oct 23 2015, 5:22 PM · Directory loader, Tarball loader
ardumont created T136: Load tarballs in a production-like swh-storage instance on worker01.
Oct 23 2015, 5:22 PM · Directory loader, Tarball loader
ardumont renamed T90: swh-loader-tar - Load gnu tarballs in swh-storage from swh-loader-tar - Load a tarball in swh-storage to swh-loader-tar - Load tarballs in swh-storage.
Oct 23 2015, 5:21 PM · Tarball loader, Directory loader
ardumont closed T106: Test on worker01: producing and consuming one swh_loader_tar message, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 5:21 PM · Tarball loader, Directory loader
ardumont closed T106: Test on worker01: producing and consuming one swh_loader_tar message as Resolved.
Oct 23 2015, 5:21 PM · Tarball loader, Directory loader
olasd added a comment to T62: DB schema: add directory→tarball provenance information.

A few proposals:

Oct 23 2015, 3:12 PM · Storage manager
ardumont renamed T106: Test on worker01: producing and consuming one swh_loader_tar message from Test on worker01 producing and consuming one swh_loader_tar message is ok to Test on worker01: producing and consuming one swh_loader_tar message.
Oct 23 2015, 2:30 PM · Tarball loader, Directory loader
olasd added a comment to T3: Discuss the project <-> origin mapping.

@zack points out that organization does not feel like the right term anymore.

Oct 23 2015, 2:22 PM · Storage manager
ardumont closed T105: make worker01 stop consuming swh_loader_git messages, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015, 12:07 PM · Tarball loader, Directory loader
First
Prev
Next
About · Developer information · Legal