rDSTO04bb5cb is a first approach for this.
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Oct 27 2015
Oct 27 2015
ardumont closed T149: Populate fetch_history table as Resolved by committing rDLDDIRf2240d1fc22f: Populate fetch history when loading a directory.
ardumont closed T149: Populate fetch_history table, a subtask of T121: Populate fetch_history, as Resolved.
ardumont removed a parent task for T149: Populate fetch_history table: T148: Populate fetch_history.
ardumont renamed T149: Populate fetch_history table from Populate optionally fetch_history table (default to true but overridable) to Populate fetch_history table.
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
ardumont removed a parent task for T148: Populate fetch_history: T149: Populate fetch_history table.
ardumont renamed T149: Populate fetch_history table from Use optionally fetch_history table (default to true but overridable) to Populate optionally fetch_history table (default to true but overridable).
ardumont renamed T148: Populate fetch_history from Use fetch_history table to Populate fetch_history.
ardumont renamed T148: Populate fetch_history from swh-loader-tar - Use fetch history to Use fetch_history table.
Oct 26 2015
Oct 26 2015
ardumont closed T147: Migrate code to use latest schema improvments from T3, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Invalid.
olasd closed T3: Discuss the project <-> origin mapping as Resolved by committing rDSTO5c2a6fc2dc6b: sql: update schema of organizations and projects.
ardumont closed T140: analysis errors on first loading batch, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T141: compute missing tarballs list for reloading the ones missing, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T143: understand why errors does not appear in log db, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
They do, i just need to:
- fix the typo in logger dir (done)
- look at the right column jsonb data
ardumont closed T136: Load tarballs in a production-like swh-storage instance on worker01 as Resolved.
ardumont closed T136: Load tarballs in a production-like swh-storage instance on worker01, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
Oct 23 2015
Oct 23 2015
ardumont added a comment to T136: Load tarballs in a production-like swh-storage instance on worker01.
- old-gnu messages loaded in broker
- loading gnu messages in broker
in progress...
ardumont renamed T90: swh-loader-tar - Load gnu tarballs in swh-storage from swh-loader-tar - Load a tarball in swh-storage to swh-loader-tar - Load tarballs in swh-storage.
ardumont closed T106: Test on worker01: producing and consuming one swh_loader_tar message, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T106: Test on worker01: producing and consuming one swh_loader_tar message as Resolved.
A few proposals:
ardumont renamed T106: Test on worker01: producing and consuming one swh_loader_tar message from Test on worker01 producing and consuming one swh_loader_tar message is ok to Test on worker01: producing and consuming one swh_loader_tar message.
@zack points out that organization does not feel like the right term anymore.
ardumont closed T105: make worker01 stop consuming swh_loader_git messages, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont added a project to T105: make worker01 stop consuming swh_loader_git messages: Tarball loader.
ardumont closed T127: release swh-loader-tar, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T104: release swh-loader-dir, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont renamed T104: release swh-loader-dir from release of swh-loader-dir when ready to release swh-loader-dir.
- GitHub
- GitHub git hosting -> GitHub lister, generates suborganizations for "GitHub organizations"
- hylang -> no specific lister, "shallow" organization
- zacchiro
- olasd
- ...
- GitHub asset hosting -> T17
ardumont closed T126: release swh-core, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T125: Permits loading of tarball subsets from a file, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T124: Tryouts run on gnu to complete the tarball listing exhaustiveness as Resolved.
ardumont closed T124: Tryouts run on gnu to complete the tarball listing exhaustiveness, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
ardumont closed T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness as Resolved.
ardumont closed T123: Tryouts run on old-gnu to complete the tarball listing exhaustiveness, a subtask of T90: swh-loader-tar - Load gnu tarballs in swh-storage, as Resolved.
I've had some thoughts about this problem, and here are my propositions.
Oct 22 2015
Oct 22 2015
duplicate of T89
zack renamed T89: refactor common behavior between git loader and dir loader from Extract common behavior between swh-loader-git and swh-loader-dir ~> swh-loader-core to refactor common behavior between git loader and dir loader.
Oct 21 2015
Oct 21 2015
Inspiration :
test_update.py3 KBDownload
We should make sure our abstraction works for things where the original artifact has several files (e.g. a debian source package)
Oct 20 2015
Oct 20 2015
Started playing with dulwich's git smart protocol client.
test_update.py3 KBDownload
zack lowered the priority of T71: update database/storage size estimation using current content of SWH DB from High to Normal.
Oct 20 2015, 10:59 AM · Restricted Project
Oct 19 2015
Oct 19 2015
shortcut query:
explain (analyze,buffers,verbose) select origin, branch, revision from occurrence_history as occ_hist where occ_hist.revision = '\x1140811ebed3b33b496a3aed32ed16b068ebffab' order by upper(occ_hist.validity) -- TODO filter by authority? limit 1;
swh_content_find_directory query :