Page MenuHomeSoftware Heritage
Feed Advanced Search

Thu, Jun 10

anlambert closed T3369: swh.core.tarballl.uncompress: Some zip files fail to be uncompressed as Resolved by committing rDCOREcbf07d953e4a: tarball: Add support to unpack ZIP archive with implode compression.
Thu, Jun 10, 4:09 PM · Core & foundations
anlambert added a revision to T3369: swh.core.tarballl.uncompress: Some zip files fail to be uncompressed: D5850: tarball: Add support to unpack ZIP archive with implode compression.
Thu, Jun 10, 1:38 PM · Core & foundations

Tue, Jun 8

anlambert merged T177: Investigate `Not implemented 'compression type 6 implode'` into T3369: swh.core.tarballl.uncompress: Some zip files fail to be uncompressed.
Tue, Jun 8, 5:02 PM · Core & foundations
ardumont added a comment to T3369: swh.core.tarballl.uncompress: Some zip files fail to be uncompressed.

Related to T177 with way more stuff in it now (thanks ;)

Tue, Jun 8, 5:01 PM · Core & foundations
anlambert triaged T3369: swh.core.tarballl.uncompress: Some zip files fail to be uncompressed as Normal priority.
Tue, Jun 8, 4:55 PM · Core & foundations

Apr 16 2021

vsellier placed T2743: Investigate why logging is inconsistent up for grabs.
Apr 16 2021, 11:48 AM · Vault, Object storage, Core & foundations
vsellier placed T1410: Kill implicit configuration: new configuration scheme up for grabs.
Apr 16 2021, 11:48 AM · Core & foundations

Apr 6 2021

vlorentz closed T3207: RPC server broken since python-decorator v5.0.5 as Resolved.
Apr 6 2021, 12:56 PM · Core & foundations
vlorentz added a revision to T3207: RPC server broken since python-decorator v5.0.5: D5421: Remove dependency on 'decorator'.
Apr 6 2021, 12:01 PM · Core & foundations
vlorentz updated the task description for T3207: RPC server broken since python-decorator v5.0.5.
Apr 6 2021, 12:01 PM · Core & foundations
vlorentz updated the task description for T3207: RPC server broken since python-decorator v5.0.5.
Apr 6 2021, 12:01 PM · Core & foundations
vlorentz triaged T3207: RPC server broken since python-decorator v5.0.5 as High priority.
Apr 6 2021, 12:28 AM · Core & foundations

Apr 4 2021

KShivendu added a comment to T2634: swh-core: missing test dependency on requests.

Hi @zack Is this task still valid? If so how do I reproduce the error. I tried running pytest in swh-fuse and swh-core but that doesn't throw any error.

Apr 4 2021, 9:15 AM · Easy hack, Core & foundations

Mar 1 2021

vlorentz moved T2256: Add type annotations to swh.core.api from In progress to Done on the Easy hack board.
Mar 1 2021, 1:39 PM · Easy hack, Core & foundations

Feb 17 2021

ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5102: Separate loader-deposit from other loaders.
Feb 17 2021, 6:40 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5093: tests: Fix loader-git instantiation.
Feb 17 2021, 1:49 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5092: tests: Fix loader-git instantiation.
Feb 17 2021, 1:29 PM · Core & foundations

Feb 15 2021

ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5078: Rework loader instantiation logic according to loader core api.
Feb 15 2021, 6:12 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5077: Rework loader instantiation logic according to loader core api.
Feb 15 2021, 6:02 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5075: Rework loader instantiation logic according to loader core api.
Feb 15 2021, 6:01 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5076: loader: Expect visit_date as an optional date in constructors.
Feb 15 2021, 6:00 PM · Core & foundations

Feb 12 2021

ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D5071: Unify loader instantiation.
Feb 12 2021, 5:51 PM · Core & foundations

Feb 10 2021

swh-public-ci added a comment to D4731: WIP Configuration system.

Build is green

Feb 10 2021, 11:49 AM · feedback-required, Core & foundations
tenma updated the diff for D4731: WIP Configuration system.

Minor phrasing fixes

Feb 10 2021, 11:48 AM · feedback-required, Core & foundations

Feb 9 2021

swh-public-ci added a comment to D4731: WIP Configuration system.

Build is green

Feb 9 2021, 12:31 PM · feedback-required, Core & foundations
tenma updated the diff for D4731: WIP Configuration system.
  • config.spec: Submit first draft
  • config.spec: Adress remarks from @ardumont, @vlorentz
  • config.spec: Address remarks from @douardda
  • config.spec: Rename "singleton" to "record"
  • config.spec: Address @ardumont remarks, strip down some sections
Feb 9 2021, 12:30 PM · feedback-required, Core & foundations

Jan 29 2021

ardumont added inline comments to D4731: WIP Configuration system.
Jan 29 2021, 2:48 PM · feedback-required, Core & foundations
ardumont added inline comments to D4731: WIP Configuration system.
Jan 29 2021, 12:36 PM · feedback-required, Core & foundations

Jan 26 2021

swh-public-ci added a comment to D4731: WIP Configuration system.

Build is green

Jan 26 2021, 6:51 PM · feedback-required, Core & foundations
tenma updated the diff for D4731: WIP Configuration system.

Rename "singleton" to "record"

Jan 26 2021, 6:49 PM · feedback-required, Core & foundations

Jan 8 2021

swh-public-ci added a comment to D4731: WIP Configuration system.

Build is green

Jan 8 2021, 5:26 PM · feedback-required, Core & foundations
tenma updated the diff for D4731: WIP Configuration system.
  • Take into account feedback from ardumont and vlorentz
  • Take into account feedback from douardda
  • still TODO: rename "singletons"
Jan 8 2021, 5:24 PM · feedback-required, Core & foundations

Jan 7 2021

tenma added a comment to D4731: WIP Configuration system.

@douardda: taking into account your suggestions.

Jan 7 2021, 10:47 AM · feedback-required, Core & foundations

Jan 5 2021

douardda requested changes to D4731: WIP Configuration system.

not finished, but first burst of comments

Jan 5 2021, 2:42 PM · feedback-required, Core & foundations

Jan 4 2021

tenma lowered the priority of T2743: Investigate why logging is inconsistent from Normal to Low.
Jan 4 2021, 5:00 PM · Vault, Object storage, Core & foundations

Dec 23 2020

tenma added projects to D4731: WIP Configuration system: Core & foundations, feedback-required.
Dec 23 2020, 10:50 AM · feedback-required, Core & foundations

Dec 16 2020

tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Dec 16 2020, 10:48 AM · Core & foundations

Dec 11 2020

tenma added a revision to T1410: Kill implicit configuration: new configuration scheme: D4731: WIP Configuration system.
Dec 11 2020, 7:22 PM · Core & foundations

Dec 2 2020

olasd closed T2819: logger: allow to specify/override the loglevel for a specific module as Resolved by committing rDCORE68a35f8a7375: Support multiple log level specifications in the swh cli.
Dec 2 2020, 11:25 AM · Core & foundations

Nov 27 2020

olasd added a revision to T2819: logger: allow to specify/override the loglevel for a specific module: D4627: Support multiple log level specifications in the swh cli.
Nov 27 2020, 5:35 PM · Core & foundations
olasd claimed T2819: logger: allow to specify/override the loglevel for a specific module.
Nov 27 2020, 12:28 PM · Core & foundations
olasd updated the task description for T2819: logger: allow to specify/override the loglevel for a specific module.
Nov 27 2020, 12:10 PM · Core & foundations
zack triaged T2819: logger: allow to specify/override the loglevel for a specific module as Normal priority.
Nov 27 2020, 12:09 PM · Core & foundations

Nov 24 2020

tenma updated the title for P878 Config library WIP (does not run for now) from Config library WIP to Config library WIP (does not run for now).
Nov 24 2020, 2:54 PM · Core & foundations
tenma created P878 Config library WIP (does not run for now).
Nov 24 2020, 2:50 PM · Core & foundations

Nov 3 2020

tenma updated the task description for T2743: Investigate why logging is inconsistent.
Nov 3 2020, 10:45 AM · Vault, Object storage, Core & foundations
tenma updated the task description for T2743: Investigate why logging is inconsistent.
Nov 3 2020, 10:30 AM · Vault, Object storage, Core & foundations
tenma updated the task description for T2743: Investigate why logging is inconsistent.
Nov 3 2020, 10:23 AM · Vault, Object storage, Core & foundations

Oct 30 2020

ardumont closed T2741: swh.core.db.cli: Add tests on the db initialization cli as Resolved by committing rDCORE12b0e76defb1: core.db.cli: Add coverage and ensure `swh db *` works as expected.
Oct 30 2020, 4:06 PM · SWH command line interface, Core & foundations
tenma updated the task description for T2743: Investigate why logging is inconsistent.
Oct 30 2020, 2:47 PM · Vault, Object storage, Core & foundations
tenma updated the task description for T2743: Investigate why logging is inconsistent.
Oct 30 2020, 2:46 PM · Vault, Object storage, Core & foundations

Oct 29 2020

tenma triaged T2743: Investigate why logging is inconsistent as Normal priority.
Oct 29 2020, 6:19 PM · Vault, Object storage, Core & foundations
ardumont added a revision to T2741: swh.core.db.cli: Add tests on the db initialization cli: D4381: core.db.cli: Add coverage and ensure `swh db *` works as expected.
Oct 29 2020, 3:05 PM · SWH command line interface, Core & foundations
ardumont triaged T2741: swh.core.db.cli: Add tests on the db initialization cli as Normal priority.
Oct 29 2020, 9:29 AM · SWH command line interface, Core & foundations

Oct 16 2020

ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4294: swh.vault: Unify get_vault factory function with other factories.
Oct 16 2020, 7:33 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4284: scheduler: Type and unify get_scheduler factory with other factories.
Oct 16 2020, 1:13 PM · Core & foundations
tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Oct 16 2020, 10:13 AM · Core & foundations
tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Oct 16 2020, 10:12 AM · Core & foundations

Oct 15 2020

ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4272: swh.indexer.storage: Unify get_indexer_storage function with others.
Oct 15 2020, 3:46 PM · Core & foundations

Oct 7 2020

ardumont closed T1532: Cleanup deprecated configuration code in swh modules, a subtask of T1410: Kill implicit configuration: new configuration scheme, as Resolved.
Oct 7 2020, 2:04 PM · Core & foundations
ardumont closed T1532: Cleanup deprecated configuration code in swh modules as Resolved.
Oct 7 2020, 2:04 PM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4178: core.config: Drop no longer used SWHConfig.
Oct 7 2020, 1:49 PM · Core & foundations

Oct 5 2020

ardumont closed T826: Objects that implicitely load configuration are a nightmare to test as Resolved.
Oct 5 2020, 1:40 PM · Core & foundations
ardumont closed T826: Objects that implicitely load configuration are a nightmare to test, a subtask of T1410: Kill implicit configuration: new configuration scheme, as Resolved.
Oct 5 2020, 1:40 PM · Core & foundations
ardumont added a comment to T826: Objects that implicitely load configuration are a nightmare to test.

Closing now since this has been superseded:

  1. T1410 tries to summarize our current use in the goal to design a better configuration system.
  2. SWHMixin is currently being removed through T1532
  3. pytest fixtures helps a lot in bootstraping configuration in testing now. It's now mostly used everywhere.
  4. What's described in the description in details is no longer true though the gist of it is (but like i said, see 1.).
Oct 5 2020, 1:39 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4141: lister*: Migrate away from SWHConfig mixin.
Oct 5 2020, 12:53 PM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4141: lister*: Migrate away from SWHConfig mixin.
Oct 5 2020, 12:53 PM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4140: indexer*: Migrate away from SWHConfig mixin.
Oct 5 2020, 11:55 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4140: indexer*: Migrate away from SWHConfig mixin.
Oct 5 2020, 11:55 AM · Core & foundations
ardumont added a comment to T1532: Cleanup deprecated configuration code in swh modules.

In regards to cleaning up deprecated code (cf. T1532#48568):

Oct 5 2020, 8:47 AM · Core & foundations

Oct 3 2020

ardumont added a comment to T1410: Kill implicit configuration: new configuration scheme.

fallback to default config when the current necessary SWH_CONFIG_FILENAME is not set (instead of current failure)
a service without a configuration should be able to run by itself from a REPL (default-config should target swh services that runs in memory)

I'm not sure we really need these two to happen if the "configuration" of our components ends up being a set of explicit arguments to their initialization function.

Oct 3 2020, 6:25 PM · Core & foundations

Oct 2 2020

olasd added a comment to T1410: Kill implicit configuration: new configuration scheme.

Suggestions from irc discussion summary:

  • Move the configuration file loading out of the services themselves (loader, lister, indexer, ...) and moves within the scope of the entrypoints instead (swh cli, celery task, gunicorn wsgi, etc...)
Oct 2 2020, 4:19 PM · Core & foundations
tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Oct 2 2020, 4:18 PM · Core & foundations
douardda added a comment to T1410: Kill implicit configuration: new configuration scheme.

Maybe starting a pad/hackmd document would be easier at this point?

Oct 2 2020, 4:01 PM · Core & foundations
ardumont added a comment to T1410: Kill implicit configuration: new configuration scheme.

Suggestions from irc discussion summary:

Oct 2 2020, 3:58 PM · Core & foundations
tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Oct 2 2020, 3:48 PM · Core & foundations
tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Oct 2 2020, 3:35 PM · Core & foundations
ardumont added a comment to T1410: Kill implicit configuration: new configuration scheme.

Should have said as much here instead...
Nonethess, a way forward for simplifying loaders is described [1]
Implementation proposal is summarized [2] (with implementation diffs reference in summary).

Oct 2 2020, 10:58 AM · Core & foundations
ardumont renamed T1410: Kill implicit configuration: new configuration scheme from Kill implicit configuration : new configuration scheme to Kill implicit configuration: new configuration scheme.
Oct 2 2020, 10:54 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4128: git.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:42 AM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4128: git.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:42 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4127: mercurial.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:33 AM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4127: mercurial.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:33 AM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4126: svn.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:24 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4126: svn.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:24 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4125: package.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:00 AM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4125: package.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:00 AM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4124: core.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:00 AM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4124: core.loader: Migrate away from SWHConfig mixin.
Oct 2 2020, 10:00 AM · Core & foundations

Sep 23 2020

zack added a project to T2634: swh-core: missing test dependency on requests: Easy hack.
Sep 23 2020, 2:23 PM · Easy hack, Core & foundations
zack edited projects for T2634: swh-core: missing test dependency on requests, added: Core & foundations; removed Core Loader.
Sep 23 2020, 2:23 PM · Easy hack, Core & foundations

Sep 22 2020

ardumont triaged T2623: swh.core.tarball: Add support for more tarballs format as Normal priority.
Sep 22 2020, 3:07 PM · Core & foundations
ardumont added a revision to T1532: Cleanup deprecated configuration code in swh modules: D4007: loader*: Migrate to swh.core.config.load_from_envvar.
Sep 22 2020, 2:55 PM · Core & foundations
ardumont added a comment to T1410: Kill implicit configuration: new configuration scheme.

rpc servers, loaders, listers, ... (swh services really): They need a simple
configuration file to parse and load, with eventual checks on missing keys.
In such a case, it should fail early with a clear message about what's
missing (so we can fix fast and restart the service). [1]

Sep 22 2020, 2:53 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D4007: loader*: Migrate to swh.core.config.load_from_envvar.
Sep 22 2020, 1:51 PM · Core & foundations
ardumont added a revision to T1410: Kill implicit configuration: new configuration scheme: D3965: config: Deprecate SWHConfig in favor of load_from_envvar function.
Sep 22 2020, 11:35 AM · Core & foundations

Sep 21 2020

tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Sep 21 2020, 2:20 PM · Core & foundations

Sep 18 2020

ardumont added a comment to T1410: Kill implicit configuration: new configuration scheme.

For the configuration part, I see 2 use cases:

Sep 18 2020, 4:15 PM · Core & foundations

Sep 17 2020

tenma updated the task description for T1410: Kill implicit configuration: new configuration scheme.
Sep 17 2020, 6:12 PM · Core & foundations
tenma renamed T1410: Kill implicit configuration: new configuration scheme from Kill implicit configuration: new configuration scheme to Kill implicit configuration : new configuration scheme.
Sep 17 2020, 5:20 PM · Core & foundations