Page MenuHomeSoftware Heritage
Feed Advanced Search

May 16 2019

douardda retitled D1479: cli: add support for aliases in click command groups from cli: add spport for aliases in click command groups to cli: add support for aliases in click command groups.
May 16 2019, 4:19 PM
douardda added a comment to D1478: tests: make test_cli.py compatible with scheduler 0.0.56.

wat?

May 16 2019, 4:18 PM
douardda accepted D1462: developer-setup: Ensure to install wheel module before all swh ones.
May 16 2019, 4:12 PM
Herald added a reviewer for D1479: cli: add support for aliases in click command groups: Reviewers.
May 16 2019, 4:08 PM
douardda committed rDCOREc8aa76029507: Remove extras-needed depencies from the main requirements.txt (authored by douardda).
Remove extras-needed depencies from the main requirements.txt
May 16 2019, 2:56 PM
douardda committed rDCORE6b426eda7d5a: tests,tox: do test each 'extra' environment in a dedicated venv (authored by douardda).
tests,tox: do test each 'extra' environment in a dedicated venv
May 16 2019, 2:56 PM
douardda closed D1444: tox: split tests by 'extra' subpackage.
May 16 2019, 2:56 PM
douardda updated the diff for D1444: tox: split tests by 'extra' subpackage.

rebased

May 16 2019, 2:56 PM
douardda added a comment to D1463: cli: Some cleanup and add missing options in db-init.

Real word example of why using private members is a bad idea: https://github.com/Tulip-Dev/tulip/commit/cbb85d65da2cb262e0c20f2b9b16603b8a633aed#diff-675480f07686e76ad2b178ce3b9ccd4e

When Python 3.7 was released, some signatures in his private C API were updated.
We were using them to register internal Python modules written in C to an embedded interpreter (gdb did also the same, I found the proper fix from their mailing list) and thus compilation broke.

Ok this is a C example but the same could happen for Python code.

May 16 2019, 2:49 PM

May 15 2019

douardda committed rDTPLb4dd92e67833: add an example cli subcommand (authored by douardda).
add an example cli subcommand
May 15 2019, 5:51 PM
douardda closed D1476: add an example cli subcommand.
May 15 2019, 5:51 PM
douardda updated the diff for D1476: add an example cli subcommand.

import CONTEXT_SETTINGS fron swh.core

May 15 2019, 5:51 PM
douardda updated the diff for D1469: setup: register the indexer cli subcommand.

rebased on D1478

May 15 2019, 5:39 PM
Herald added a reviewer for D1478: tests: make test_cli.py compatible with scheduler 0.0.56: Reviewers.
May 15 2019, 5:34 PM
douardda updated the diff for D1469: setup: register the indexer cli subcommand.

cli: import CONTEXT_SETTINGS from swh.core

May 15 2019, 5:16 PM
Herald added a reviewer for D1477: cli: add a 'storage' cli group with a 'serve' subcommand: Reviewers.
May 15 2019, 5:13 PM
douardda added inline comments to D1469: setup: register the indexer cli subcommand.
May 15 2019, 4:55 PM
Herald added a reviewer for D1476: add an example cli subcommand: Reviewers.
May 15 2019, 3:57 PM
Herald added a reviewer for D1475: cli: register the 'objstorage' cli subcommand: Reviewers.
May 15 2019, 3:49 PM
douardda updated the diff for D1473: setup: register the 'identify' cli subcommand.

add support for --help on the 'identify' cli tool

May 15 2019, 3:45 PM
Herald added a reviewer for D1473: setup: register the 'identify' cli subcommand: Reviewers.
May 15 2019, 3:32 PM
Herald added a reviewer for D1472: cli: register the 'journal' cli subcommand: Reviewers.
May 15 2019, 3:18 PM
Herald added a reviewer for D1471: cli: register the 'lister' cli subcommand: Reviewers.
May 15 2019, 3:13 PM
Herald added a reviewer for D1470: setup: register the vault cli subcommand: Reviewers.
May 15 2019, 3:06 PM
Herald added a reviewer for D1469: setup: register the indexer cli subcommand: Reviewers.
May 15 2019, 2:59 PM
douardda resigned from D1463: cli: Some cleanup and add missing options in db-init.

Let someone else give the thumbs up/down

May 15 2019, 2:51 PM
douardda added a comment to D1463: cli: Some cleanup and add missing options in db-init.

I don't really understand why you did this. What is the problem with the current implementation. Sure it uses a 'private' API, but the logging module won't change any time soon...

Maybe but this is a bad practice and should be avoided.

<slightly_bad_faith_ mode>like keeping a hand written copy of a piece of data that is in fact defined somewhere else </>

May 15 2019, 2:50 PM
douardda added a comment to D1463: cli: Some cleanup and add missing options in db-init.

I don't really understand why you did this. What is the problem with the current implementation. Sure it uses a 'private' API, but the logging module won't change any time soon...

Maybe but this is a bad practice and should be avoided.

May 15 2019, 2:48 PM
douardda added inline comments to D1463: cli: Some cleanup and add missing options in db-init.
May 15 2019, 2:42 PM
douardda accepted D1464: cli: Fix swh-scheduler command.

I would have just written this as

setup_log_handler(
    loglevel=ctx.obj.get('log_level', logging.INFO), colorize=False,
    format='[%(levelname)s] %(name)s -- %(message)s',
    log_console=not no_stdout)

but meh

May 15 2019, 2:38 PM
douardda added inline comments to D1463: cli: Some cleanup and add missing options in db-init.
May 15 2019, 2:25 PM
douardda added a comment to D1463: cli: Some cleanup and add missing options in db-init.

Update:

  • cli: Remove use of private members from the logging module
May 15 2019, 2:24 PM
douardda committed rCDFD8d48959f9643: Dockerfile: update to python 3.7 (authored by douardda).
Dockerfile: update to python 3.7
May 15 2019, 1:44 PM
douardda committed rCDFD00d3f8f35840: README: update doc to use the new 'swh' master cli tool (authored by douardda).
README: update doc to use the new 'swh' master cli tool
May 15 2019, 1:44 PM
douardda closed D1468: Dockerfile: update to python 3.7.
May 15 2019, 1:44 PM
douardda closed D1467: README: update doc to use the new 'swh' master cli tool.
May 15 2019, 1:44 PM
Herald added a reviewer for D1468: Dockerfile: update to python 3.7: Reviewers.
May 15 2019, 11:44 AM
Herald added a reviewer for D1467: README: update doc to use the new 'swh' master cli tool: Reviewers.
May 15 2019, 11:44 AM
douardda triaged T1713: Vault 'Download' suboptimal UI/UX: no feedback that the bundle is being transferred as Normal priority.
May 15 2019, 9:35 AM · Web app

May 10 2019

douardda accepted D1459: Update docs (getting-started, metadata) with latest changes.

LGTM but I did not do a very punctilious review

May 10 2019, 11:12 AM
douardda accepted D1456: Explicitely implement from_dict instead of using introspection magic..
May 10 2019, 10:26 AM
douardda requested changes to D1456: Explicitely implement from_dict instead of using introspection magic..

I agree it's easier to read, so LGTM (just a small refactoring and I'm ok with this)

May 10 2019, 10:23 AM

May 9 2019

douardda closed D1453: bump dependency to swh.core[db,http] >= 0.0.60.

closed by b0fcdebc823fee02dd718c4526829476438daf6c

May 9 2019, 9:33 AM
douardda committed rDVAUb0fcdebc823f: bump dependency to swh.core[db,http] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[db,http] >= 0.0.60
May 9 2019, 9:33 AM
douardda committed rDSTO85b3da962810: bump dependency to swh.core[db,http] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[db,http] >= 0.0.60
May 9 2019, 9:31 AM
douardda closed D1452: bump dependency to swh.core[db,http] >= 0.0.60.
May 9 2019, 9:31 AM
douardda committed rDOBJS9a5b5b28b83e: bump dependency to swh.core[http] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[http] >= 0.0.60
May 9 2019, 9:31 AM
douardda closed D1451: bump dependency to swh.core[http] >= 0.0.60.
May 9 2019, 9:31 AM
douardda committed rDJNL1e4287efbfcd: bump dependency to swh.core[db] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[db] >= 0.0.60
May 9 2019, 9:30 AM
douardda closed D1450: bump dependency to swh.core[db] >= 0.0.60.
May 9 2019, 9:30 AM
douardda committed rDCIDX25a2e54744bc: bump dependency to swh.core[db,http] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[db,http] >= 0.0.60
May 9 2019, 9:30 AM
douardda closed D1449: bump dependency to swh.core[db,http] >= 0.0.60.
May 9 2019, 9:30 AM
douardda committed rDARC9b45b253784f: bump dependency to swh.core[db] >= 0.0.60 (authored by douardda).
bump dependency to swh.core[db] >= 0.0.60
May 9 2019, 9:29 AM
douardda closed D1448: bump dependency to swh.core[db] >= 0.0.60.
May 9 2019, 9:29 AM
douardda committed rDSCHedaf20251447: cli: split the main cli/__init__.py file in 4 parts (authored by douardda).
cli: split the main cli/__init__.py file in 4 parts
May 9 2019, 9:29 AM
douardda closed D1445: cli: split the main cli/__init__.py file in 4 parts.
May 9 2019, 9:29 AM
douardda accepted D1436: tests: Add integration tests for the Software Heritage stack.
May 9 2019, 9:28 AM

May 7 2019

douardda accepted D1447: cli.admin: Add an admin subcommand 'deposit reschedule'.

lgtm

May 7 2019, 5:39 PM · SWORD deposit
douardda accepted D1446: models: Keep scheduler task ids reference on deposit model.
May 7 2019, 5:35 PM · SWORD deposit
Herald added a reviewer for D1453: bump dependency to swh.core[db,http] >= 0.0.60: Reviewers.
May 7 2019, 5:17 PM
Herald added a reviewer for D1452: bump dependency to swh.core[db,http] >= 0.0.60: Reviewers.
May 7 2019, 5:15 PM
Herald added a reviewer for D1451: bump dependency to swh.core[http] >= 0.0.60: Reviewers.
May 7 2019, 5:10 PM
Herald added a reviewer for D1450: bump dependency to swh.core[db] >= 0.0.60: Reviewers.
May 7 2019, 5:06 PM
Herald added a reviewer for D1449: bump dependency to swh.core[db,http] >= 0.0.60: Reviewers.
May 7 2019, 4:23 PM
Herald added a reviewer for D1448: bump dependency to swh.core[db] >= 0.0.60: Reviewers.
May 7 2019, 4:12 PM
douardda requested changes to D1446: models: Keep scheduler task ids reference on deposit model.
May 7 2019, 3:55 PM · SWORD deposit
douardda added inline comments to D1446: models: Keep scheduler task ids reference on deposit model.
May 7 2019, 3:55 PM · SWORD deposit
douardda added a comment to D1444: tox: split tests by 'extra' subpackage.

Instead of swh/core/X/tests/, you should put tests in swh/core/tests/X/ (where X is the sub-component), for uniformity with other repos (deposit/indexer/storage/web)

let me check that

May 7 2019, 3:04 PM
douardda updated the diff for D1444: tox: split tests by 'extra' subpackage.

Add missing __init__.py files

May 7 2019, 2:38 PM
douardda added a comment to D1444: tox: split tests by 'extra' subpackage.

Instead of swh/core/X/tests/, you should put tests in swh/core/tests/X/ (where X is the sub-component), for uniformity with other repos (deposit/indexer/storage/web)

May 7 2019, 2:35 PM
douardda added a comment to D1444: tox: split tests by 'extra' subpackage.

Build fails with:

_______________ ERROR collecting swh/core/db/tests/test_db.py _________________
swh/core/db/tests/test_db.py:14: in <module>
    from .db_testing import (
E   SystemError: Parent module '' not loaded, cannot perform relative import
!!!!!!!!!!!!!!!!!!! Interrupted: 1 errors during collection !!!!!!!!!!!!!!!!!!!!
=

Wondering if we are not missing __init__.py files in the new subfolders created (db, api, server)?

May 7 2019, 2:34 PM
douardda added a comment to D1445: cli: split the main cli/__init__.py file in 4 parts.

debian related, i'm wondering how to package this ;)

May 7 2019, 2:33 PM
douardda accepted D1435: api.server: Fix client_max_size parameter transmission to aiohttp.

Not a big stuff, but I would have preferred to see the refactoring (of the get_local_backend's code) and the actual fix (add client_max_size arg when calling make_app) in 2 revisions.

May 7 2019, 2:32 PM
douardda added inline comments to D1446: models: Keep scheduler task ids reference on deposit model.
May 7 2019, 2:26 PM · SWORD deposit
douardda triaged T1704: increase object storage capacity as High priority.
May 7 2019, 12:16 PM · System administration
douardda created T1704: increase object storage capacity.
May 7 2019, 12:16 PM · System administration
Herald added a reviewer for D1445: cli: split the main cli/__init__.py file in 4 parts: Reviewers.
May 7 2019, 10:54 AM
douardda created D1444: tox: split tests by 'extra' subpackage.
May 7 2019, 10:43 AM
douardda closed T1651: Create a separate project for deposit-client, a subtask of T1671: Implement a uniform and consistent cli to be used by all SWH packages, as Wontfix.
May 7 2019, 10:12 AM · SWH command line interface
douardda closed T1651: Create a separate project for deposit-client as Wontfix.

This won't be done as a separate project, but rather from swh.core directly. see D1426

May 7 2019, 10:12 AM · SWH command line interface, SWORD deposit

May 6 2019

douardda committed rDSCH3f88069d020f: README: remove the deprecated tests section (authored by douardda).
README: remove the deprecated tests section
May 6 2019, 4:43 PM
douardda committed rDSCH84c0bd724b5d: cli: make swh-scheduler a subcommand of swh.core's main "swh" command (authored by douardda).
cli: make swh-scheduler a subcommand of swh.core's main "swh" command
May 6 2019, 4:43 PM
douardda committed rDSCHeb4263913c60: cli: make it a subpackage (authored by douardda).
cli: make it a subpackage
May 6 2019, 4:43 PM
douardda closed D1439: cli: make swh-scheduler a subcommand of swh.core's main "swh" command.
May 6 2019, 4:43 PM
douardda updated the diff for D1439: cli: make swh-scheduler a subcommand of swh.core's main "swh" command.

rebased + bump dep on swh.core 0.0.60

May 6 2019, 3:49 PM
douardda committed rDDEP02a2e91d2b9f: docs: update the getting-started document to use 'swh deposit upload' command (authored by douardda).
docs: update the getting-started document to use 'swh deposit upload' command
May 6 2019, 3:35 PM
douardda committed rDDEPf5624c801b68: cli: rename the 'deposit' subcommand as 'upload' (authored by douardda).
cli: rename the 'deposit' subcommand as 'upload'
May 6 2019, 3:35 PM
douardda closed D1429: docs: update the getting-started document to use 'swh deposit upload' command.
May 6 2019, 3:35 PM
douardda committed rDDEPc0b1d5467669: cli: make the deposit cli command a subcommand of the main 'swh' one (authored by douardda).
cli: make the deposit cli command a subcommand of the main 'swh' one
May 6 2019, 3:35 PM
douardda committed rDDEPbf2fb8692bc0: cli: rename cli/deposit.py as cli/client.py to prevent a name clash (authored by douardda).
cli: rename cli/deposit.py as cli/client.py to prevent a name clash
May 6 2019, 3:34 PM
douardda closed D1428: cli: make the deposit cli command a subcommand of the main 'swh' one.
May 6 2019, 3:34 PM
douardda updated the diff for D1429: docs: update the getting-started document to use 'swh deposit upload' command.

add missing \ and 's/^I/ /' as noticed by ardumont

May 6 2019, 3:34 PM
douardda updated the diff for D1429: docs: update the getting-started document to use 'swh deposit upload' command.

rebase

May 6 2019, 3:31 PM
douardda updated the diff for D1428: cli: make the deposit cli command a subcommand of the main 'swh' one.

depends on swh.core 0.0.60

May 6 2019, 3:31 PM
douardda committed rDCORE86eeb30ffd0e: setup: extract db and http related parts to dedicated optional 'extras' (authored by douardda).
setup: extract db and http related parts to dedicated optional 'extras'
May 6 2019, 3:23 PM
douardda closed T1678: Make the swh.core package define some 'extras' features to limit dependencies of the 'plain' swh.core package as Resolved by committing rDCORE86eeb30ffd0e: setup: extract db and http related parts to dedicated optional 'extras'.
May 6 2019, 3:23 PM · SWH command line interface
douardda closed T1678: Make the swh.core package define some 'extras' features to limit dependencies of the 'plain' swh.core package, a subtask of T1671: Implement a uniform and consistent cli to be used by all SWH packages, as Resolved.
May 6 2019, 3:23 PM · SWH command line interface
douardda committed rDCOREa057ad05c021: logger: kill the (now unused) PostresHandler (authored by douardda).
logger: kill the (now unused) PostresHandler
May 6 2019, 3:23 PM
douardda closed D1427: setup: extract db and http related parts in dedicated optional 'extras'.
May 6 2019, 3:23 PM
douardda committed rDCORE19b1bece67a3: cli: add a generic main 'swh' command (authored by douardda).
cli: add a generic main 'swh' command
May 6 2019, 3:23 PM