Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 10 2020

douardda closed D3908: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:19 PM
douardda committed rDDEPde0ab7f6f21f: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:17 PM
douardda closed D3909: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:17 PM
douardda committed rDGRPHc7df913df2b3: refactor and simplify test_cli as a pytest function (authored by douardda).
refactor and simplify test_cli as a pytest function
Sep 10 2020, 5:17 PM
douardda closed D3911: refactor and simplify test_cli as a pytest function.
Sep 10 2020, 5:17 PM
douardda committed rDGRPH4a643fcce445: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:17 PM
douardda closed D3910: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:17 PM
douardda committed rDICP981280cc866e: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:16 PM
douardda closed D3912: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:16 PM
douardda updated the diff for D3914: cli: speedup the `swh` cli command startup time.

rebase

Sep 10 2020, 5:16 PM
douardda committed rDLDBASE4ac177f39a62: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:14 PM
douardda closed D3915: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:14 PM
douardda committed rDMOD7404486d0c09: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:14 PM
douardda closed D3916: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:14 PM
douardda committed rDOBJSf793e63dca74: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:14 PM
douardda committed rDOBJSf6e9b0149a35: Use absolute import (authored by douardda).
Use absolute import
Sep 10 2020, 5:13 PM
douardda closed D3917: Use absolute import.
Sep 10 2020, 5:13 PM
douardda committed rDTSCN9ce6ddc05490: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:12 PM
douardda closed D3919: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:12 PM
douardda committed rDVAUc0c3a897420d: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:12 PM
douardda closed D3922: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:12 PM
douardda committed rDWCLIade9e0cf6e38: cli: speedup the `swh` cli command startup time (authored by douardda).
cli: speedup the `swh` cli command startup time
Sep 10 2020, 5:11 PM
douardda committed rDWCLIab96dae9f035: Remove WebAPIClient from the swh.web.client namespace (authored by douardda).
Remove WebAPIClient from the swh.web.client namespace
Sep 10 2020, 5:11 PM
douardda closed D3923: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 5:11 PM
douardda updated the diff for D3909: cli: speedup the `swh` cli command startup time.

fix test_cli

Sep 10 2020, 5:10 PM
douardda updated the diff for D3923: cli: speedup the `swh` cli command startup time.

fix test_cli

Sep 10 2020, 4:58 PM
douardda updated the diff for D3923: cli: speedup the `swh` cli command startup time.

Also update the doc

Sep 10 2020, 4:42 PM
douardda created D3923: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:30 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3923: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:30 PM · Development environment
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3922: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:27 PM · Development environment
douardda created D3922: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:27 PM
douardda created D3921: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:25 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3921: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:25 PM · Development environment
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3920: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:24 PM · Development environment
douardda created D3920: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:24 PM
douardda updated the diff for D3907: cli: speedup the `swh` cli command startup time.

add warnings

Sep 10 2020, 4:23 PM
douardda created D3919: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:21 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3919: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:21 PM · Development environment
douardda created D3918: Rename cli imported from objstorage as objstorage_cli_group.
Sep 10 2020, 4:20 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3917: Use absolute import.
Sep 10 2020, 4:19 PM · Development environment
douardda created D3917: Use absolute import.
Sep 10 2020, 4:19 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3916: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:19 PM · Development environment
douardda created D3916: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:19 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3915: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:17 PM · Development environment
douardda created D3915: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:17 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3914: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:16 PM · Development environment
douardda created D3914: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:16 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3913: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:14 PM · Development environment
douardda created D3913: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:14 PM
douardda created D3912: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:12 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3912: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:12 PM · Development environment
douardda created D3911: refactor and simplify test_cli as a pytest function.
Sep 10 2020, 4:11 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3910: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:11 PM · Development environment
douardda created D3910: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:11 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3909: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:09 PM · Development environment
douardda created D3909: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:09 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3908: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:07 PM · Development environment
douardda created D3908: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 4:07 PM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3907: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 3:59 PM · Development environment
douardda created D3907: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 3:59 PM
douardda edited P756 Masterwork From Distant Lands.
Sep 10 2020, 2:24 PM
douardda created D3902: cli: do not add sub sub commands to the main swh cli group.
Sep 10 2020, 10:26 AM
douardda added a revision to T2575: Investigate if/how we could improve `swh` cli command startup time: D3901: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 10:25 AM · Development environment
douardda created D3901: cli: speedup the `swh` cli command startup time.
Sep 10 2020, 10:25 AM

Sep 9 2020

douardda committed rDCIDXc231873d56e9: Import get_objstorage from swh.objstorage.factory (authored by douardda).
Import get_objstorage from swh.objstorage.factory
Sep 9 2020, 7:27 PM
douardda committed rDSTO93458a4665d9: Import get_objstorage from swh.objstorage.factory (authored by douardda).
Import get_objstorage from swh.objstorage.factory
Sep 9 2020, 7:26 PM
douardda committed rDOBJSRPL8b9db1a0c536: Import get_objstorage from swh.objstorage.factory (authored by douardda).
Import get_objstorage from swh.objstorage.factory
Sep 9 2020, 7:24 PM
douardda committed rDVAU5cc96ef49edb: Import get_objstorage from swh.objstorage.factory (authored by douardda).
Import get_objstorage from swh.objstorage.factory
Sep 9 2020, 7:23 PM
douardda added a comment to T2575: Investigate if/how we could improve `swh` cli command startup time.

FTR, many of the cli.py (or cli/ packages) do import way too much stuff by default.
For this swh command to behave half decently, we need to be as lazy as possible regarding importing stuff, i.e. only import when needed, in @cli.command functions.

Sep 9 2020, 1:53 PM · Development environment

Sep 8 2020

douardda triaged T2575: Investigate if/how we could improve `swh` cli command startup time as Normal priority.
Sep 8 2020, 12:44 PM · Development environment
douardda updated subscribers of T1340: Automate storage BBUs monitoring.

is this task still "a thing"? @olasd ?

Sep 8 2020, 12:36 PM · System administration
douardda added a comment to T2571: swh-identify: add support for --type revision.

do we mean something else than echo swh:1:rev:$(git rev-parse HEAD) ?
Do we want support for other (supported) VCS?

Sep 8 2020, 12:34 PM · Easy hack, Data Model
douardda added a comment to T2545: Dead on arrival disk in the kafka3 server.

thx

Sep 8 2020, 12:18 PM · System administration

Sep 4 2020

douardda added a comment to T2358: Deploy launchpad lister on staging.

FTR, I've run the launchpad lister in a docker and it executed fine, with fine being "it created 19340 load-git tasks"

Sep 4 2020, 5:01 PM · System administration, Lister, Archive coverage
douardda closed T2530: Write a simple "quick start" for swh-graph as Resolved.

closed by 8c937da20785699ae2a0a604104a9e458eced201

Sep 4 2020, 4:58 PM · Documentation, Compressed graph service
douardda committed rDGRPH8c937da20785: Add a short `quickstart` guide (authored by douardda).
Add a short `quickstart` guide
Sep 4 2020, 4:58 PM
douardda closed D3871: Add a short `quickstart` guide.
Sep 4 2020, 4:58 PM
douardda added a task to D3871: Add a short `quickstart` guide: T2530: Write a simple "quick start" for swh-graph.
Sep 4 2020, 4:57 PM
douardda added a revision to T2530: Write a simple "quick start" for swh-graph: D3871: Add a short `quickstart` guide.
Sep 4 2020, 4:57 PM · Documentation, Compressed graph service
douardda updated the diff for D3871: Add a short `quickstart` guide.

rebase

Sep 4 2020, 4:57 PM
douardda committed rDDOC4d8395a926ff: Add a RPC vault worker->objstorage link in the arch diagram (authored by douardda).
Add a RPC vault worker->objstorage link in the arch diagram
Sep 4 2020, 1:54 PM
douardda closed D3866: Add a RCP a vault worker->objstorage link in the arch diagram.
Sep 4 2020, 1:54 PM
douardda updated the diff for D3866: Add a RCP a vault worker->objstorage link in the arch diagram.

rebase + typos in ci msg

Sep 4 2020, 1:54 PM
douardda added a comment to D3866: Add a RCP a vault worker->objstorage link in the arch diagram.

Sep 4 2020, 11:06 AM

Sep 3 2020

douardda updated the diff for D3871: Add a short `quickstart` guide.

Add the magic touch

Sep 3 2020, 4:10 PM
douardda updated the diff for D3871: Add a short `quickstart` guide.

includes seirl's remarks (well the easy part of them)

Sep 3 2020, 3:44 PM
douardda added a comment to D3871: Add a short `quickstart` guide.
In D3871#95682, @seirl wrote:

Thanks, this looks good!

Apart from minor nitpicks, my only concern here is that it might not be 100% clear who this doc is addressing. I reckon that people clicking on the "quickstart" page of swh.graph can come from different situations:

  • people who want to use swh-graph without any consideration for the rest of the SWH infrastructure on an arbitrary graph (what you seem to have written here)
  • people who want to install swh-graph as part of their SWH development environment
  • people who would like to run topology experiments on our graph but have no idea where to start
  • ...

In that regard, I am not sure "quickstart" is appropriate here -- but I really don't have a better idea of how this doc should be written. I am okay for merging that as-is until we figure out what we want to show potential users. Maybe @zack would like to chime in here?

I guess it would probably be a good idea to at least start with an intro paragraph about what we're trying to achieve in this tutorial?

Sep 3 2020, 3:36 PM
douardda created D3871: Add a short `quickstart` guide.
Sep 3 2020, 2:32 PM
douardda resigned from D3861: tests: Unify lister initialization under the `initialized_lister` fixture.

okay-ish. I still don't really get the point of this diff. You still have as many fixtures as before, it's just that they all have the same same. For me it defies the simplification/clarification this diff claims it aims at. I won't reject but I'm not convinced neither (sorry).

Sep 3 2020, 9:21 AM

Sep 2 2020

douardda added a comment to D3863: Refactor revision_get storage API to return Revision objects.

looks ok but I find the commit message too cryptic.

Sep 2 2020, 5:09 PM
douardda requested changes to D3861: tests: Unify lister initialization under the `initialized_lister` fixture.

I'm not sure I get what problem this diff is solving (and the commit message gives no clue about it).
The "why", focus on the "why" (and "how", if needed) :-)

Sep 2 2020, 5:02 PM
douardda created D3866: Add a RCP a vault worker->objstorage link in the arch diagram.
Sep 2 2020, 4:37 PM
douardda committed rDENV71846b8131a1: Small fix in test_git_loader.py to make flake8 happy (authored by douardda).
Small fix in test_git_loader.py to make flake8 happy
Sep 2 2020, 2:47 PM

Sep 1 2020

douardda added a comment to D3857: test_cli: Exclude launchpad lister from the check.

we could argue that having the launchpad lister attempting a connection on instantiation is pretty bad, but yeah, ok

Sep 1 2020, 4:02 PM

Aug 27 2020

douardda closed D3843: Update a bit the architecture description.
Aug 27 2020, 5:05 PM
douardda closed T2478: backfill origin-visit and origin-visit-status topics, a subtask of T2310: Make origin visits immutable, as Wontfix.
Aug 27 2020, 4:43 PM · Storage manager, Data Model
douardda closed T2478: backfill origin-visit and origin-visit-status topics as Wontfix.

I guess this task can be closed, since this backfilling process will be part of the one we will run soon to fill the new kafka cluster

Aug 27 2020, 4:43 PM · Storage manager, Data Model
douardda added a comment to T995: Investigate and fix snapshots with broken links.

what's the status of this task today? is there a probe that tracks these broken links? (or a script one can run)

Aug 27 2020, 4:40 PM · Archive content
douardda added a comment to T645: Type swh-storage endpoints with swh.model objects.

what's missing for this task to be closed?

Aug 27 2020, 4:32 PM · Data Model, Storage manager
douardda raised the priority of T2313: Archive git.fsfe.org (Gitea) from Wishlist to High.
Aug 27 2020, 4:29 PM · Archive coverage, Lister