Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Files
F9124278
No One
Temporary
Actions
View File
Edit File
Delete File
View Transforms
Subscribe
Mute Notifications
Award Token
Flag For Later
Size
70 KB
Subscribers
None
View Options
diff --git a/PKG-INFO b/PKG-INFO
index 31ce201..5b43c3a 100644
--- a/PKG-INFO
+++ b/PKG-INFO
@@ -1,42 +1,40 @@
Metadata-Version: 2.1
Name: swh.core
-Version: 0.13.0
+Version: 0.13.1
Summary: Software Heritage core utilities
Home-page: https://forge.softwareheritage.org/diffusion/DCORE/
Author: Software Heritage developers
Author-email: swh-devel@inria.fr
License: UNKNOWN
Project-URL: Bug Reports, https://forge.softwareheritage.org/maniphest
Project-URL: Funding, https://www.softwareheritage.org/donate
Project-URL: Source, https://forge.softwareheritage.org/source/swh-core
Project-URL: Documentation, https://docs.softwareheritage.org/devel/swh-core/
-Description: .. _swh-core:
-
- Software Heritage - Core foundations
+Description: Software Heritage - Core foundations
====================================
Low-level utilities and helpers used by almost all other modules in the stack.
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
- database connection
- http-based RPC client/server
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Operating System :: OS Independent
Classifier: Development Status :: 5 - Production/Stable
Requires-Python: >=3.7
Description-Content-Type: text/x-rst
Provides-Extra: testing-core
Provides-Extra: logging
Provides-Extra: db
Provides-Extra: testing-db
Provides-Extra: http
Provides-Extra: testing
diff --git a/README.rst b/README.rst
index 7b3f051..f46ea70 100644
--- a/README.rst
+++ b/README.rst
@@ -1,15 +1,13 @@
-.. _swh-core:
-
Software Heritage - Core foundations
====================================
Low-level utilities and helpers used by almost all other modules in the stack.
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
- database connection
- http-based RPC client/server
diff --git a/debian/changelog b/debian/changelog
index 146e47a..d3ce796 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,1073 +1,1075 @@
-swh-core (0.13.0-1~swh1~bpo10+1) buster-swh; urgency=medium
+swh-core (0.13.1-1~swh1) unstable-swh; urgency=medium
- * Rebuild for buster-swh
+ * New upstream release 0.13.1 - (tagged by Antoine Lambert
+ <antoine.lambert@inria.fr> on 2021-04-29 14:21:29 +0200)
+ * Upstream changes: - version 0.13.1
- -- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 06 Apr 2021 17:08:24 +0000
+ -- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 29 Apr 2021 12:25:15 +0000
swh-core (0.13.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.13.0 - (tagged by Vincent SELLIER
<vincent.sellier@softwareheritage.org> on 2021-04-06 19:01:37 +0200)
* Upstream changes: - v0.13.0 - Support several backends on
RPCServerApp
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 06 Apr 2021 17:07:10 +0000
swh-core (0.12.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.12.1 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2021-04-06 12:34:34 +0200)
* Upstream changes: - v0.12.1 - * tests: Drop hypothesis < 6
requirement - * README.rst: Remove getting-started instructions,
they are duplicates - * Improve/fix documentation of
requests_mock_datadir - * Remove dependency on 'decorator'
(fixes a regression in decorator 5.0.5)
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 06 Apr 2021 10:37:17 +0000
swh-core (0.12.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.12.0 - (tagged by David Douard
<david.douard@sdfa3.org> on 2021-02-16 11:48:58 +0100)
* Upstream changes: - v0.12.0
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 16 Feb 2021 10:52:14 +0000
swh-core (0.11.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.11.0 - (tagged by David Douard
<david.douard@sdfa3.org> on 2020-12-08 15:35:05 +0100)
* Upstream changes: - v0.11.0
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 08 Dec 2020 14:38:23 +0000
swh-core (0.10.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.10.0 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2020-12-02 11:46:38 +0100)
* Upstream changes: - Release swh.core 0.10.0 -
db.tests.db_testing: Drop unused database test utilities. -
api.serializers: Add support for serializing large negative integers
with - msgpack. - Do not mutate api.serializers.ENCODERS or
DECODERS. - swh cli: Add support for setting up the log level of
multiple loggers.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 02 Dec 2020 10:50:35 +0000
swh-core (0.9.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.9.1 - (tagged by Antoine Lambert
<antoine.lambert@inria.fr> on 2020-11-23 11:24:50 +0100)
* Upstream changes: - version 0.9.1
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 23 Nov 2020 10:29:15 +0000
swh-core (0.9.0-1~swh2) unstable-swh; urgency=medium
* Split packages python3-swh.core and python3-swh.core.db.pytestplugin
-- Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org> Fri, 20 Nov 2020 16:37:00 +0000
swh-core (0.9.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.9.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-11-20 15:35:53
+0100)
* Upstream changes: - v0.9.0 - Clarify names around the
swh.core.db.pytest_plugin tests - setup: Separate pytest-
postgresql dependency and declare it when needed - RPCClient:
Fix reraise_exceptions regression - api/serializers: Add
Exception type encoder and decoder - Makefile.local: Ensure all
tests are executed when invoking make test - core.db.cli: Add
coverage and ensure `swh db *` works as expected - core tests:
disambiguate arg 'request' through typing
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 20 Nov 2020 14:37:00 +0000
swh-core (0.8.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.8.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-30 09:12:17
+0100)
* Upstream changes: - v0.8.0 - cli.db: Open init-admin subcmd
to initialize superuser-level scripts
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 30 Oct 2020 08:13:02 +0000
swh-core (0.7.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.7.1 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-22 18:51:16
+0200)
* Upstream changes: - v0.7.1 - Move SWHDatabaseJanitor to
db.pytest_plugin module
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Oct 2020 16:51:59 +0000
swh-core (0.7.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.7.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-22 18:31:18
+0200)
* Upstream changes: - v0.7.0 - remote_api_endpoint: Allow to
declare what http method to use - api.RPCServerApp: Adapt sync
rpc server with async rpc server
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Oct 2020 16:32:04 +0000
swh-core (0.6.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.6.1 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-22 13:53:41
+0200)
* Upstream changes: - v0.6.1 - Move pytest_plugin declaration
to top-level conftest
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Oct 2020 11:54:49 +0000
swh-core (0.6.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.6.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-22 13:24:55
+0200)
* Upstream changes: - v0.6.0 - asynchronous.RPCServerApp:
Align implementation with api.RPCServerApp
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Oct 2020 11:25:29 +0000
swh-core (0.5.0-1~swh2) unstable-swh; urgency=medium
* Bump new release with dependency updated
-- Antoine R. Dumont <ardumont@softwareheritage.org> thu, 22 Oct 2020 11:21:04 +0200
swh-core (0.5.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.5.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-22 11:11:29
+0200)
* Upstream changes: - v0.5.0 - Install postgresql_fact fixture
for faster postgres tests - api.tests.test_async: Simplify
fixture setup - core.config: Drop no longer used SWHConfig
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Oct 2020 09:12:14 +0000
swh-core (0.4.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.4.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-10-02 11:44:10
+0200)
* Upstream changes: - v0.4.0 - config: Deprecate SWHConfig in
favor of load_from_envvar function
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 02 Oct 2020 09:44:53 +0000
swh-core (0.3.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.3.1 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-10-01 12:38:08 +0200)
* Upstream changes: - v0.3.1 - * Add specific celery task
arguments to metadata sent to systemd-journald - * SortedList:
Don't inherit from UserList.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 01 Oct 2020 10:40:27 +0000
swh-core (0.3.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.3.0 - (tagged by David Douard
<david.douard@sdfa3.org> on 2020-09-23 16:24:40 +0200)
* Upstream changes: - v0.3.0
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 23 Sep 2020 14:27:08 +0000
swh-core (0.2.3-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.2.3 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-08-17 13:55:41 +0200)
* Upstream changes: - v0.2.3 - * tarball: add test for
permissions. - * Move SortedList from swh-storage.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 17 Aug 2020 11:57:43 +0000
swh-core (0.2.2-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.2.2 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-07-31 13:41:19
+0200)
* Upstream changes: - v0.2.2 - api.classes: Open
swh.core.api.classes.stream_results
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 31 Jul 2020 11:44:33 +0000
swh-core (0.2.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.2.1 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-07-30 19:16:57 +0200)
* Upstream changes: - v0.2.1 - Make @remote_api_endpoint
preserve typing information for mypy.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 30 Jul 2020 17:20:05 +0000
swh-core (0.2.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.2.0 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-07-29 11:18:37
+0200)
* Upstream changes: - v0.2.0 - core.api: Expose serializable
PagedResult object for pagination api - test_serializers:
Refactor using pytest - Migrate from vcversioner to setuptools-
scm
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 29 Jul 2020 09:20:56 +0000
swh-core (0.1.2-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.1.2 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-07-08 13:41:51
+0200)
* Upstream changes: - v0.1.2 - test_serializers: Move to
pytest for that specific erratic assertion
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 08 Jul 2020 11:43:25 +0000
swh-core (0.1.1-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.1.1 - (tagged by Antoine R. Dumont
(@ardumont) <ardumont@softwareheritage.org> on 2020-07-08 13:03:52
+0200)
* Upstream changes: - v0.1.1 - api.tests: Fix unsupported
matches keyword to match - requirements-db: Move typing-
extension from test to runtime deps
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 08 Jul 2020 11:07:55 +0000
swh-core (0.1.0-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.1.0 - (tagged by David Douard
<david.douard@sdfa3.org> on 2020-07-06 14:33:28 +0200)
* Upstream changes: - v0.1.0
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 06 Jul 2020 12:36:15 +0000
swh-core (0.0.95-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.95 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2020-04-17 17:20:35 +0200)
* Upstream changes: - Release swh.core v0.0.95 - support
serializing large integers in msgpack - add documentation for
CLI - move formatting to black
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 17 Apr 2020 16:05:01 +0000
swh-core (0.0.94-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.94 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-28 14:28:11 +0100)
* Upstream changes: - v0.0.94 - Allow subclasses of RPCClient
to override methods.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 28 Feb 2020 13:32:41 +0000
swh-core (0.0.93-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.93 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-26 15:26:29 +0100)
* Upstream changes: - v0.0.93 - Reintroduce support for
decoding legacy msgpack encoding
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 26 Feb 2020 14:29:46 +0000
swh-core (0.0.92-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.92 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-19 15:40:57 +0100)
* Upstream changes: - v0.0.92 - Add support for msgpack 1.0.0
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 19 Feb 2020 14:45:27 +0000
swh-core (0.0.91-1~swh2) unstable-swh; urgency=medium
* Add missing python3-iso8601 build dependency
-- Antoine Lambert <antoine.lambert@inria.fr> Wed, 19 Feb 2020 11:18:34 +0100
swh-core (0.0.91-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.91 - (tagged by Antoine Lambert
<antoine.lambert@inria.fr> on 2020-02-18 16:43:59 +0100)
* Upstream changes: - version 0.0.91
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 18 Feb 2020 15:51:39 +0000
swh-core (0.0.90-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.90 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-18 13:54:30 +0100)
* Upstream changes: - v0.0.90 - Remove exception pickling from
the async server, as in the sync server.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 18 Feb 2020 12:59:38 +0000
swh-core (0.0.89-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.89 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-18 11:35:01 +0100)
* Upstream changes: - v0.0.89 - * Change msgpack serialization
to be closer to the JSON one. - * Add support for extra
{de,en}coders. - * Add extra_type_encoders and
extra_type_decoders attributes to RPC clients and servers. - *
Use iso8601.parse_date instead of dateutil.parser.parse.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 18 Feb 2020 10:43:34 +0000
swh-core (0.0.88-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.88 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-02-14 12:22:23 +0100)
* Upstream changes: - v0.0.88 - In case of errors, return a
simple dictionary instead of pickled exception.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 14 Feb 2020 11:27:02 +0000
swh-core (0.0.87-1~swh2) unstable-swh; urgency=medium
* Fix package build
-- Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org> Thu, 30 Jan 2020 14:06:54 +0100
swh-core (0.0.87-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.87 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-01-29 12:21:48 +0100)
* Upstream changes: - v0.0.87 - Make db_transaction* remove
db/cur from the signature.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 29 Jan 2020 11:28:23 +0000
swh-core (0.0.86-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.86 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2020-01-23 09:08:56
+0100)
* Upstream changes: - v0.0.86 - sentry: Add environment
variable $SWH_SENTRY_ENVIRONMENT - pytest_plugin: Fix sphinx
warnings
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 23 Jan 2020 08:12:40 +0000
swh-core (0.0.85-1~swh2) unstable-swh; urgency=medium
* Fix package build on buster
-- Antoine Lambert <antoine.lambert@inria.fr> Thu, 16 Jan 2020 11:00:00 +0000
swh-core (0.0.85-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.85 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2020-01-15 13:07:36 +0100)
* Upstream changes: - v0.0.85 - Add env var SWH_MAIN_PACKAGE
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 15 Jan 2020 12:11:49 +0000
swh-core (0.0.84-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.84 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-12-13 09:08:00
+0100)
* Upstream changes: - v0.0.84 - Improve tarball support for
tar.lz, tar.x, tar.Z files
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 13 Dec 2019 08:14:23 +0000
swh-core (0.0.83-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.83 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-12-12 16:03:25
+0100)
* Upstream changes: - v0.0.83 - core.config: Rename
configuration key
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 12 Dec 2019 15:06:28 +0000
swh-core (0.0.82-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.82 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-12-11 15:04:09 +0100)
* Upstream changes: - Release swh.core 0.0.82 - Add missing
conftest.py to MANIFEST.in
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 11 Dec 2019 14:09:00 +0000
swh-core (0.0.81-1~swh2) unstable-swh; urgency=medium
* Add dependency to python3-sentry-sdk
-- Nicolas Dandrimont <olasd@debian.org> Wed, 11 Dec 2019 14:58:54 +0100
swh-core (0.0.81-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.81 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2019-12-10 13:59:17 +0100)
* Upstream changes: - v0.0.81 - * Include all requirements in
MANIFEST.in - * Split test requirements to try and properly
minimize dependencies - * Make the CLI initialize sentry-sdk
based on CLI options/envvars. - * Add gunicorn config script to
initialize sentry-sdk based on envvars.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 10 Dec 2019 13:03:13 +0000
swh-core (0.0.80-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.80 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-11-19 16:36:35 +0100)
* Upstream changes: - Release swh.core v0.0.80 - Let
TypeErrors pass through the RPC layer - Register SIGINT/SIGTERM
handlers for the CLI
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 19 Nov 2019 15:41:09 +0000
swh-core (0.0.79-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.79 - (tagged by Stefano Zacchiroli
<zack@upsilon.cc> on 2019-11-18 13:35:19 +0100)
* Upstream changes: - v0.0.79 ======= - * RPCClient: add
response attribute to RemoteException - * RPCClent: rename and
refactor check_status (now raise_for_status) - * RPCClient:
check HTTP status code for errors also when streaming - * cli:
Add support for loading a logging configuration file - * cli:
Allow adding a Notes section between Options and Commands - *
Add trailing dot to help texts for consistency - * logger: only
flatten dicts if all keys are strings - * Move to
@pytest.fixture from yield_fixture - *
test_rpc_client_server.py: fix typo in docstring
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 18 Nov 2019 12:42:12 +0000
swh-core (0.0.78-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.78 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-11-06 18:01:56 +0100)
* Upstream changes: - Release swh.core 0.0.78 - allow the swh
command to work even when a plugin fails - hardcode bytea and
bytea[] type oids in BaseDb
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 06 Nov 2019 17:05:38 +0000
swh-core (0.0.77-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.77 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-11-06 14:10:58
+0100)
* Upstream changes: - v0.0.77 - pytest_plugin: Decode url to
resolve filename - api/serializers: Force json module use to
decode requests text response
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 06 Nov 2019 13:15:03 +0000
swh-core (0.0.76-1~swh2) unstable-swh; urgency=medium
* Force using the swh.core pytest plugin
-- Nicolas Dandrimont <olasd@debian.org> Wed, 23 Oct 2019 14:50:04 +0200
swh-core (0.0.76-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.76 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-10-18 10:16:20 +0200)
* Upstream changes: - Release swh.core v0.0.76 - Make the
systemd dependency optional
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 18 Oct 2019 08:25:15 +0000
swh-core (0.0.75-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.75 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-10-14 17:51:58
+0200)
* Upstream changes: - v0.0.75 - pytest_plugin: Add support for
http requests
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 14 Oct 2019 15:57:05 +0000
swh-core (0.0.74-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.74 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-10-11 15:30:51 +0200)
* Upstream changes: - v0.0.74
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 11 Oct 2019 13:35:17 +0000
swh-core (0.0.73-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.73 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-10-09 14:16:04
+0200)
* Upstream changes: - v0.0.73 - Improve pytest-plugin fixture
to ease testing with pagination
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 09 Oct 2019 12:20:36 +0000
swh-core (0.0.72-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.72 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-10-09 10:59:28
+0200)
* Upstream changes: - v0.0.72 - Fix tox.ini's py3 environment
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 09 Oct 2019 09:02:51 +0000
swh-core (0.0.70-1~swh2) unstable-swh; urgency=medium
* Add new dependency on python3-tz
-- Nicolas Dandrimont <olasd@debian.org> Tue, 01 Oct 2019 15:07:09 +0200
swh-core (0.0.70-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.70 - (tagged by Stefano Zacchiroli
<zack@upsilon.cc> on 2019-09-27 10:16:41 +0200)
* Upstream changes: - v0.0.70 - init.py: switch to documented
way of extending path
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 27 Sep 2019 08:21:29 +0000
swh-core (0.0.69-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.69 - (tagged by Stefano Zacchiroli
<zack@upsilon.cc> on 2019-09-20 15:50:52 +0200)
* Upstream changes: - v0.0.69 - MANIFEST.in: ship py.typed
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 20 Sep 2019 13:54:15 +0000
swh-core (0.0.68-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.68 - (tagged by Stefano Zacchiroli
<zack@upsilon.cc> on 2019-09-20 15:05:29 +0200)
* Upstream changes: - v0.0.68 - * mypy: ignore django-stubs,
needed only by hypothesis - * mypy: use conffile to ignore
requests_mock - * typing: minimal changes to make a no-op mypy
run pass - * db_testing.py: do not explode when TEST_DB_DUMP =
None - * swh.core.config.parse_config_file: fix sphinx markup in
docstring - * statsd: protect access to the statsd's socket -
* tests: add tests for swh.logger and swh.tarball modules - *
Remove fallback when aiohttp_utils is not installed.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 20 Sep 2019 13:09:50 +0000
swh-core (0.0.67-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.67 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2019-08-22 13:56:36 +0200)
* Upstream changes: - v0.0.67 - Improve error handling in
Db.copy_to
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 22 Aug 2019 12:02:14 +0000
swh-core (0.0.66-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.66 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-07-30 13:55:16 +0200)
* Upstream changes: - v0.0.66
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 30 Jul 2019 11:58:47 +0000
swh-core (0.0.65-1~swh2) unstable-swh; urgency=medium
* debian/control: add missing dependencies.
-- David Douard <david.douard@sdfa3.org> Tue, 16 Jul 2019 14:46:43 +0200
swh-core (0.0.65-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.65 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-07-15 16:49:47 +0200)
* Upstream changes: - v0.0.65 - needed to fix my mess with
0.0.64 tag, since the wrong 0.0.64 version has - already been
pushed to pypi.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 15 Jul 2019 14:53:29 +0000
swh-core (0.0.64-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.64 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-07-15 16:33:32 +0200)
* Upstream changes: - v0.0.64
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 15 Jul 2019 14:37:04 +0000
swh-core (0.0.63-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.63 - (tagged by Antoine Lambert
<antoine.lambert@inria.fr> on 2019-05-21 13:12:11 +0200)
* Upstream changes: - version 0.0.63
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 21 May 2019 11:15:45 +0000
swh-core (0.0.62-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.62 - (tagged by Antoine Lambert
<antoine.lambert@inria.fr> on 2019-05-20 14:56:05 +0200)
* Upstream changes: - version 0.0.62
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 20 May 2019 13:01:38 +0000
swh-core (0.0.61-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.61 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-05-17 10:32:07 +0200)
* Upstream changes: - v0.0.61
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 17 May 2019 08:38:08 +0000
swh-core (0.0.60-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.60 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-05-06 15:27:44 +0200)
* Upstream changes: - v0.0.60
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Mon, 06 May 2019 13:32:48 +0000
swh-core (0.0.59-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.59 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2019-04-09 16:55:41 +0200)
* Upstream changes: - Explicitly give Db connections back to the
pool. - So they gracefully release the connection on error
instead - of relying on reference-counting to call the Db's
`__del__` - (which does not happen in Hypothesis tests) because
a ref - to it is kept via the traceback object.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 09 Apr 2019 16:12:32 +0000
swh-core (0.0.58-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.58 - (tagged by Antoine Lambert
<antoine.lambert@inria.fr> on 2019-04-02 17:19:05 +0200)
* Upstream changes: - version 0.0.58
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 02 Apr 2019 15:24:34 +0000
swh-core (0.0.57-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.57 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-03-28 15:51:27 +0100)
* Upstream changes: - Release swh.core v0.0.57 - Move to
native async primitives - Fix statsd.timed exceptional behavior
bug/misfeature - Fix SWHRemoteAPI post_stream method
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Thu, 28 Mar 2019 14:55:58 +0000
swh-core (0.0.56-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.56 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-03-19 10:17:06 +0100)
* Upstream changes: - v0.0.56
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 19 Mar 2019 09:27:18 +0000
swh-core (0.0.55-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.55 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-02-19 12:28:26
+0100)
* Upstream changes: - v0.0.55 - Fix runtime dependencies
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 19 Feb 2019 11:32:28 +0000
swh-core (0.0.54-1~swh2) unstable-swh; urgency=medium
* New upstream release 0.0.54
* Upstream changes: - Add missing build dependencies
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Tue, 12 Feb 2019 16:25:34 +0000
swh-core (0.0.54-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.54 - (tagged by Valentin Lorentz
<vlorentz@softwareheritage.org> on 2019-02-11 16:47:18 +0100)
* Upstream changes: - Add test for BaseDb.connect.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 12 Feb 2019 12:37:43 +0000
swh-core (0.0.53-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.53 - (tagged by Antoine R. Dumont
(@ardumont) <antoine.romain.dumont@gmail.com> on 2019-02-08 09:09:30
+0100)
* Upstream changes: - v0.0.53 - Fix debian build
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 08 Feb 2019 08:12:31 +0000
swh-core (0.0.52-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.52 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-02-06 15:24:04 +0100)
* Upstream changes: - v0.0.52
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 06 Feb 2019 14:27:14 +0000
swh-core (0.0.51-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.51 - (tagged by David Douard
<david.douard@sdfa3.org> on 2019-02-01 14:28:27 +0100)
* Upstream changes: - v0.0.51
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Fri, 01 Feb 2019 13:31:45 +0000
swh-core (0.0.50-1~swh1) unstable-swh; urgency=medium
* New upstream release 0.0.50 - (tagged by Nicolas Dandrimont
<nicolas@dandrimont.eu> on 2019-01-09 15:50:58 +0100)
* Upstream changes: - Release swh.core v0.0.50 - Add statsd
client module - Log used config files
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Wed, 09 Jan 2019 14:54:37 +0000
swh-core (0.0.49-1~swh1) unstable-swh; urgency=medium
* Make DbTestFixture.setUp() accept and pass *args and **kwargs.
-- Software Heritage autobuilder (on jenkins-debian1) <jenkins@jenkins-debian1.internal.softwareheritage.org> Tue, 08 Jan 2019 16:38:02 +0000
swh-core (0.0.48-1~swh1) unstable-swh; urgency=medium
* v0.0.48
* swh.core.cli: Update swh-db-init to make it idemtpotent
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Tue, 08 Jan 2019 15:33:15 +0000
swh-core (0.0.47-1~swh1) unstable-swh; urgency=medium
* v0.0.47
* swh.core.cli: Fix flag
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Tue, 08 Jan 2019 15:16:09 +0000
swh-core (0.0.46-1~swh1) unstable-swh; urgency=medium
* v0.0.46
* utils.grouper: Improve implementation
* Remove now-obsolete information about swh.core.worker
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Tue, 08 Jan 2019 14:37:34 +0000
swh-core (0.0.45-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.45
* Compatibility with recent msgpack
* Debian packaging-related cleanups
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 22 Nov 2018 21:09:53 +0100
swh-core (0.0.44-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.44
* Refactor the database testing fixtures
* Stop unsafe serialization/deserialization constructs
* Update tests to use nose
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 18 Oct 2018 18:20:12 +0200
swh-core (0.0.43-1~swh1) unstable-swh; urgency=medium
* v0.0.43
* Fix missing dependency declaration
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 11 Oct 2018 15:47:06 +0200
swh-core (0.0.42-1~swh1) unstable-swh; urgency=medium
* v0.0.42
* Fix missing dependency declaration
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 11 Oct 2018 15:45:25 +0200
swh-core (0.0.41-1~swh1) unstable-swh; urgency=medium
* Add functions to generate HTTP API clients and servers from
databases.
* Summary: This moves the interesting parts of D505 into the core, so
other components can use them as well.
* Test Plan: `make test`
* Reviewers: ardumont, seirl, #reviewers
* Reviewed By: ardumont, #reviewers
* Subscribers: douardda
* Differential Revision: https://forge.softwareheritage.org/D507
-- Valentin Lorentz <vlorentz@softwareheritage.org> Thu, 11 Oct 2018 10:57:27 +0200
swh-core (0.0.40-1~swh1) unstable-swh; urgency=medium
* v0.0.40
* swh.core.api.SWHRemoteAPI: Permit to set a query timeout option
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 24 May 2018 12:10:03 +0200
swh-core (0.0.39-1~swh1) unstable-swh; urgency=medium
* v0.0.39
* package: Add missing runtime dependency
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 26 Apr 2018 15:24:22 +0200
swh-core (0.0.38-1~swh1) unstable-swh; urgency=medium
* v0.0.38
* tests: Use more reasonable psql options for db restores
* swh.core.serializers: Add custom types serialization
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 26 Apr 2018 15:15:27 +0200
swh-core (0.0.37-1~swh1) unstable-swh; urgency=medium
* v0.0.37
* Move test fixture in swh.core.tests.server_testing module
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Wed, 25 Apr 2018 15:00:02 +0200
swh-core (0.0.36-1~swh1) unstable-swh; urgency=medium
* v0.0.36
* Migrate swh.loader.tar.tarball module in swh.core
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Wed, 06 Dec 2017 12:03:29 +0100
swh-core (0.0.35-1~swh1) unstable-swh; urgency=medium
* Release swh.core version 0.0.35
* Update packaging runes
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 12 Oct 2017 18:07:50 +0200
swh-core (0.0.34-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.34
* New modular database test fixture
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Mon, 07 Aug 2017 18:29:48 +0200
swh-core (0.0.33-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.33
* Be more conservative with remote API responses
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Mon, 19 Jun 2017 19:01:38 +0200
swh-core (0.0.32-1~swh1) unstable-swh; urgency=medium
* Release swh-core v0.0.32
* Add asynchronous streaming methods for internal APIs
* Remove task arguments from systemd-journal loggers
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 09 May 2017 14:04:22 +0200
swh-core (0.0.31-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.31
* Add explicit dependency on python3-systemd
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 07 Apr 2017 15:11:26 +0200
swh-core (0.0.30-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.30
* drop swh.core.hashutil (moved to swh.model.hashutil)
* add a systemd logger
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 07 Apr 2017 11:49:15 +0200
swh-core (0.0.29-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.29
* Catch proper exception in the base API client
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 02 Feb 2017 00:19:25 +0100
swh-core (0.0.28-1~swh1) unstable-swh; urgency=medium
* v0.0.28
* Refactoring some common code into swh.core
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 26 Jan 2017 14:54:22 +0100
swh-core (0.0.27-1~swh1) unstable-swh; urgency=medium
* v0.0.27
* Fix issue with default boolean value
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 20 Oct 2016 16:15:20 +0200
swh-core (0.0.26-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.26
* Raise an exception when a configuration file exists and is
unreadable
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Wed, 12 Oct 2016 10:16:09 +0200
swh-core (0.0.25-1~swh1) unstable-swh; urgency=medium
* v0.0.25
* Add new function utils.cwd
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 29 Sep 2016 21:29:37 +0200
swh-core (0.0.24-1~swh1) unstable-swh; urgency=medium
* v0.0.24
* Deal with edge case in logger regarding json
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Thu, 22 Sep 2016 12:21:09 +0200
swh-core (0.0.23-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.23
* Properly fix the PyYAML dependency
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 23 Aug 2016 16:20:29 +0200
swh-core (0.0.22-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.22
* Proper loading of yaml and ini files in all paths
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 19 Aug 2016 15:45:55 +0200
swh-core (0.0.21-1~swh1) unstable-swh; urgency=medium
* v0.0.21
* Update test tools
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Tue, 19 Jul 2016 14:47:01 +0200
swh-core (0.0.20-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.20
* Add some generic bytes <-> escaped unicode methods
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 14 Jun 2016 16:54:41 +0200
swh-core (0.0.19-1~swh1) unstable-swh; urgency=medium
* v0.0.19
* Resurrect swh.core.utils
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Fri, 15 Apr 2016 12:40:43 +0200
swh-core (0.0.18-1~swh1) unstable-swh; urgency=medium
* v0.0.18
* Add swh.core.utils
* serializers: support UUIDs all around
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Sat, 26 Mar 2016 11:16:33 +0100
swh-core (0.0.17-1~swh1) unstable-swh; urgency=medium
* Release swh.core v0.0.17
* Allow serialization of UUIDs
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 04 Mar 2016 11:40:56 +0100
swh-core (0.0.16-1~swh1) unstable-swh; urgency=medium
* Release swh.core version 0.0.16
* add bytehex_to_hash and hash_to_bytehex in hashutil
* move scheduling utilities to swh.scheduler
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 19 Feb 2016 18:12:10 +0100
swh-core (0.0.15-1~swh1) unstable-swh; urgency=medium
* Release v0.0.15
* Add hashutil.hash_git_object
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Wed, 16 Dec 2015 16:31:26 +0100
swh-core (0.0.14-1~swh1) unstable-swh; urgency=medium
* v0.0.14
* Add simple README
* Update license
* swh.core.hashutil.hashfile can now deal with filepath as bytes
-- Antoine R. Dumont (@ardumont) <antoine.romain.dumont@gmail.com> Fri, 23 Oct 2015 11:13:14 +0200
swh-core (0.0.13-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.13
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 09 Oct 2015 17:32:49 +0200
swh-core (0.0.12-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.12
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 06 Oct 2015 17:34:34 +0200
swh-core (0.0.11-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.11
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Sat, 03 Oct 2015 15:57:03 +0200
swh-core (0.0.10-1~swh1) unstable-swh; urgency=medium
* Prepare deploying swh.core v0.0.10
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Sat, 03 Oct 2015 12:28:52 +0200
swh-core (0.0.9-1~swh1) unstable-swh; urgency=medium
* Prepare deploying swh.core v0.0.9
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Sat, 03 Oct 2015 11:36:55 +0200
swh-core (0.0.8-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.8
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 01 Oct 2015 12:31:44 +0200
swh-core (0.0.7-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.7
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Thu, 01 Oct 2015 11:29:04 +0200
swh-core (0.0.6-1~swh1) unstable-swh; urgency=medium
* Prepare deployment of swh.core v0.0.6
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 29 Sep 2015 16:48:44 +0200
swh-core (0.0.5-1~swh1) unstable-swh; urgency=medium
* Prepare v0.0.5 deployment
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 29 Sep 2015 16:08:32 +0200
swh-core (0.0.4-1~swh1) unstable-swh; urgency=medium
* Tagging swh.core 0.0.4
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 25 Sep 2015 15:41:26 +0200
swh-core (0.0.3-1~swh1) unstable-swh; urgency=medium
* Tag swh.core v0.0.3
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Fri, 25 Sep 2015 11:07:10 +0200
swh-core (0.0.2-1~swh1) unstable-swh; urgency=medium
* Deploy v0.0.2
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Wed, 23 Sep 2015 12:08:50 +0200
swh-core (0.0.1-1~swh1) unstable-swh; urgency=medium
* Initial release
* Tag v0.0.1 for deployment
-- Nicolas Dandrimont <nicolas@dandrimont.eu> Tue, 22 Sep 2015 14:52:26 +0200
diff --git a/docs/README.rst b/docs/README.rst
index 7b3f051..f46ea70 100644
--- a/docs/README.rst
+++ b/docs/README.rst
@@ -1,15 +1,13 @@
-.. _swh-core:
-
Software Heritage - Core foundations
====================================
Low-level utilities and helpers used by almost all other modules in the stack.
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
- database connection
- http-based RPC client/server
diff --git a/docs/cli.rst b/docs/cli.rst
index 3707b16..6541931 100644
--- a/docs/cli.rst
+++ b/docs/cli.rst
@@ -1,22 +1,22 @@
.. _swh-core-cli:
Command-line interface
======================
Shared command-line interface
-----------------------------
.. click:: swh.core.cli:swh
:prog: swh
- :show-nested:
+ :nested: full
Database initialization utilities
---------------------------------
-.. click:: swh.core.cli.db:init
+.. click:: swh.core.cli.db:db_init
:prog: swh db init
- :show-nested:
+ :nested: full
.. click:: swh.core.cli.db:db_init
:prog: swh db-init
- :show-nested:
+ :nested: full
diff --git a/docs/index.rst b/docs/index.rst
index a3e00dc..81d3fba 100644
--- a/docs/index.rst
+++ b/docs/index.rst
@@ -1,10 +1,12 @@
+.. _swh-core:
+
.. include:: README.rst
Reference Documentation
-----------------------
.. toctree::
:maxdepth: 2
cli
/apidoc/swh.core
diff --git a/swh.core.egg-info/PKG-INFO b/swh.core.egg-info/PKG-INFO
index 31ce201..5b43c3a 100644
--- a/swh.core.egg-info/PKG-INFO
+++ b/swh.core.egg-info/PKG-INFO
@@ -1,42 +1,40 @@
Metadata-Version: 2.1
Name: swh.core
-Version: 0.13.0
+Version: 0.13.1
Summary: Software Heritage core utilities
Home-page: https://forge.softwareheritage.org/diffusion/DCORE/
Author: Software Heritage developers
Author-email: swh-devel@inria.fr
License: UNKNOWN
Project-URL: Bug Reports, https://forge.softwareheritage.org/maniphest
Project-URL: Funding, https://www.softwareheritage.org/donate
Project-URL: Source, https://forge.softwareheritage.org/source/swh-core
Project-URL: Documentation, https://docs.softwareheritage.org/devel/swh-core/
-Description: .. _swh-core:
-
- Software Heritage - Core foundations
+Description: Software Heritage - Core foundations
====================================
Low-level utilities and helpers used by almost all other modules in the stack.
core library for swh's modules:
- config parser
- hash computations
- serialization
- logging mechanism
- database connection
- http-based RPC client/server
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Operating System :: OS Independent
Classifier: Development Status :: 5 - Production/Stable
Requires-Python: >=3.7
Description-Content-Type: text/x-rst
Provides-Extra: testing-core
Provides-Extra: logging
Provides-Extra: db
Provides-Extra: testing-db
Provides-Extra: http
Provides-Extra: testing
diff --git a/swh/core/cli/__init__.py b/swh/core/cli/__init__.py
index c2dee46..7a61e5d 100644
--- a/swh/core/cli/__init__.py
+++ b/swh/core/cli/__init__.py
@@ -1,189 +1,189 @@
# Copyright (C) 2019 The Software Heritage developers
# See the AUTHORS file at the top-level directory of this distribution
# License: GNU General Public License version 3, or any later version
# See top-level LICENSE file for more information
import logging
import logging.config
from typing import Optional
import warnings
import click
import pkg_resources
LOG_LEVEL_NAMES = ["NOTSET", "DEBUG", "INFO", "WARNING", "ERROR", "CRITICAL"]
CONTEXT_SETTINGS = dict(help_option_names=["-h", "--help"])
logger = logging.getLogger(__name__)
class AliasedGroup(click.Group):
"""A simple Group that supports command aliases, as well as notes related to
options"""
def __init__(self, name=None, commands=None, **attrs):
self.option_notes = attrs.pop("option_notes", None)
self.aliases = {}
super().__init__(name, commands, **attrs)
def get_command(self, ctx, cmd_name):
return super().get_command(ctx, self.aliases.get(cmd_name, cmd_name))
def add_alias(self, name, alias):
if not isinstance(name, str):
name = name.name
self.aliases[alias] = name
def format_options(self, ctx, formatter):
click.Command.format_options(self, ctx, formatter)
if self.option_notes:
with formatter.section("Notes"):
formatter.write_text(self.option_notes)
self.format_commands(ctx, formatter)
def clean_exit_on_signal(signal, frame):
"""Raise a SystemExit exception to let command-line clients wind themselves
down on exit"""
raise SystemExit(0)
def validate_loglevel_params(ctx, param, value):
"""Validate the --log-level parameters, with multiple values"""
if value is None:
return None
return [validate_loglevel(ctx, param, v) for v in value]
def validate_loglevel(ctx, param, value):
"""Validate a single loglevel specification, of the form LOGLEVEL or
module:LOGLEVEL."""
if ":" in value:
try:
module, log_level = value.split(":")
except ValueError:
raise click.BadParameter(
"Invalid log level specification `%s`, "
"needs to be in format `module:LOGLEVEL`" % value
)
else:
module = None
log_level = value
if log_level not in LOG_LEVEL_NAMES:
raise click.BadParameter(
"Log level %s unknown (in `%s`) needs to be one of %s"
% (log_level, value, ", ".join(LOG_LEVEL_NAMES))
)
return (module, log_level)
@click.group(
context_settings=CONTEXT_SETTINGS,
cls=AliasedGroup,
option_notes="""\
If both options are present, --log-level values will override the configuration
in --log-config.
The --log-config YAML must conform to the logging.config.dictConfig schema
documented at https://docs.python.org/3/library/logging.config.html.
""",
)
@click.option(
"--log-level",
"-l",
"log_levels",
default=None,
callback=validate_loglevel_params,
multiple=True,
help=(
"Log level (defaults to INFO). "
"Can override the log level for a specific module, by using the "
- "`specific.module:LOGLEVEL` syntax (e.g. `--log-level swh.core:DEBUG` "
+ "``specific.module:LOGLEVEL`` syntax (e.g. ``--log-level swh.core:DEBUG`` "
"will enable DEBUG logging for swh.core)."
),
)
@click.option(
"--log-config",
default=None,
type=click.File("r"),
help="Python yaml logging configuration file.",
)
@click.option(
"--sentry-dsn", default=None, help="DSN of the Sentry instance to report to"
)
@click.option(
"--sentry-debug/--no-sentry-debug",
default=False,
hidden=True,
help="Enable debugging of sentry",
)
@click.pass_context
def swh(ctx, log_levels, log_config, sentry_dsn, sentry_debug):
"""Command line interface for Software Heritage.
"""
import signal
import yaml
from ..sentry import init_sentry
signal.signal(signal.SIGTERM, clean_exit_on_signal)
signal.signal(signal.SIGINT, clean_exit_on_signal)
init_sentry(sentry_dsn, debug=sentry_debug)
set_default_loglevel: Optional[str] = None
if log_config:
logging.config.dictConfig(yaml.safe_load(log_config.read()))
set_default_loglevel = logging.root.getEffectiveLevel()
if not log_levels:
log_levels = []
for module, log_level in log_levels:
logger = logging.getLogger(module)
log_level = logging.getLevelName(log_level)
logger.setLevel(log_level)
if module is None:
set_default_loglevel = log_level
if not set_default_loglevel:
logging.root.setLevel("INFO")
set_default_loglevel = "INFO"
ctx.ensure_object(dict)
ctx.obj["log_level"] = set_default_loglevel
def main():
# Even though swh() sets up logging, we need an earlier basic logging setup
# for the next few logging statements
logging.basicConfig()
# load plugins that define cli sub commands
for entry_point in pkg_resources.iter_entry_points("swh.cli.subcommands"):
try:
cmd = entry_point.load()
if isinstance(cmd, click.BaseCommand):
# for BW compat, auto add click commands
warnings.warn(
f"{entry_point.name}: automagic addition of click commands "
f"to the main swh group is deprecated",
DeprecationWarning,
)
swh.add_command(cmd, name=entry_point.name)
# otherwise it's expected to be a module which has been loaded
# it's the responsibility of the click commands/groups in this
# module to transitively have the main swh group as parent.
except Exception as e:
logger.warning("Could not load subcommand %s: %s", entry_point.name, str(e))
return swh(auto_envvar_prefix="SWH")
if __name__ == "__main__":
main()
diff --git a/swh/core/cli/db.py b/swh/core/cli/db.py
index e509b15..c90b13a 100755
--- a/swh/core/cli/db.py
+++ b/swh/core/cli/db.py
@@ -1,331 +1,332 @@
#!/usr/bin/env python3
# Copyright (C) 2018-2020 The Software Heritage developers
# See the AUTHORS file at the top-level directory of this distribution
# License: GNU General Public License version 3, or any later version
# See top-level LICENSE file for more information
import logging
from os import environ, path
from typing import Collection, Dict, Optional, Tuple
import warnings
import click
from swh.core.cli import CONTEXT_SETTINGS
from swh.core.cli import swh as swh_cli_group
warnings.filterwarnings("ignore") # noqa prevent psycopg from telling us sh*t
logger = logging.getLogger(__name__)
@swh_cli_group.group(name="db", context_settings=CONTEXT_SETTINGS)
@click.option(
"--config-file",
"-C",
default=None,
type=click.Path(exists=True, dir_okay=False),
help="Configuration file.",
)
@click.pass_context
def db(ctx, config_file):
"""Software Heritage database generic tools."""
from swh.core.config import read as config_read
ctx.ensure_object(dict)
if config_file is None:
config_file = environ.get("SWH_CONFIG_FILENAME")
cfg = config_read(config_file)
ctx.obj["config"] = cfg
@db.command(name="create", context_settings=CONTEXT_SETTINGS)
@click.argument("module", required=True)
@click.option(
"--db-name",
"-d",
help="Database name.",
default="softwareheritage-dev",
show_default=True,
)
@click.option(
"--template",
"-T",
help="Template database from which to build this database.",
default="template1",
show_default=True,
)
def db_create(module, db_name, template):
"""Create a database for the Software Heritage <module>.
and potentially execute superuser-level initialization steps.
- Example:
+ Example::
- swh db create -d swh-test storage
+ swh db create -d swh-test storage
If you want to specify non-default postgresql connection parameters, please
provide them using standard environment variables or by the mean of a
properly crafted libpq connection URI. See psql(1) man page (section
ENVIRONMENTS) for details.
Note: this command requires a postgresql connection with superuser permissions.
- Example:
+ Example::
- PGPORT=5434 swh db create indexer
- swh db create -d postgresql://superuser:passwd@pghost:5433/swh-storage storage
+ PGPORT=5434 swh db create indexer
+ swh db create -d postgresql://superuser:passwd@pghost:5433/swh-storage storage
"""
logger.debug("db_create %s dn_name=%s", module, db_name)
create_database_for_package(module, db_name, template)
@db.command(name="init-admin", context_settings=CONTEXT_SETTINGS)
@click.argument("module", required=True)
@click.option(
"--db-name",
"-d",
help="Database name.",
default="softwareheritage-dev",
show_default=True,
)
def db_init_admin(module: str, db_name: str) -> None:
"""Execute superuser-level initialization steps (e.g pg extensions, admin functions,
...)
- Example:
+ Example::
- PGPASSWORD=... swh db init-admin -d swh-test scheduler
+ PGPASSWORD=... swh db init-admin -d swh-test scheduler
If you want to specify non-default postgresql connection parameters, please
provide them using standard environment variables or by the mean of a
properly crafted libpq connection URI. See psql(1) man page (section
ENVIRONMENTS) for details.
Note: this command requires a postgresql connection with superuser permissions (e.g
postgres, swh-admin, ...)
- Example:
+ Example::
- PGPORT=5434 swh db init-admin scheduler
- swh db init-admin -d postgresql://superuser:passwd@pghost:5433/swh-scheduler \
- scheduler
+ PGPORT=5434 swh db init-admin scheduler
+ swh db init-admin -d postgresql://superuser:passwd@pghost:5433/swh-scheduler \
+ scheduler
"""
logger.debug("db_init_admin %s db_name=%s", module, db_name)
init_admin_extensions(module, db_name)
@db.command(name="init", context_settings=CONTEXT_SETTINGS)
@click.argument("module", required=True)
@click.option(
"--db-name",
"-d",
help="Database name.",
default="softwareheritage-dev",
show_default=True,
)
@click.option(
"--flavor", help="Database flavor.", default=None,
)
def db_init(module, db_name, flavor):
"""Initialize a database for the Software Heritage <module>.
- Example:
+ Example::
- swh db init -d swh-test storage
+ swh db init -d swh-test storage
If you want to specify non-default postgresql connection parameters,
please provide them using standard environment variables.
See psql(1) man page (section ENVIRONMENTS) for details.
- Examples:
+ Examples::
- PGPORT=5434 swh db init indexer
- swh db init -d postgresql://user:passwd@pghost:5433/swh-storage storage
- swh db init --flavor read_replica -d swh-storage storage
+ PGPORT=5434 swh db init indexer
+ swh db init -d postgresql://user:passwd@pghost:5433/swh-storage storage
+ swh db init --flavor read_replica -d swh-storage storage
"""
logger.debug("db_init %s flavor=%s dn_name=%s", module, flavor, db_name)
initialized, dbversion, dbflavor = populate_database_for_package(
module, db_name, flavor
)
# TODO: Ideally migrate the version from db_version to the latest
# db version
click.secho(
"DONE database for {} {}{} at version {}".format(
module,
"initialized" if initialized else "exists",
f" (flavor {dbflavor})" if dbflavor is not None else "",
dbversion,
),
fg="green",
bold=True,
)
if flavor is not None and dbflavor != flavor:
click.secho(
f"WARNING requested flavor '{flavor}' != recorded flavor '{dbflavor}'",
fg="red",
bold=True,
)
def get_sql_for_package(modname):
import glob
from importlib import import_module
from swh.core.utils import numfile_sortkey as sortkey
if not modname.startswith("swh."):
modname = "swh.{}".format(modname)
try:
m = import_module(modname)
except ImportError:
raise click.BadParameter("Unable to load module {}".format(modname))
sqldir = path.join(path.dirname(m.__file__), "sql")
if not path.isdir(sqldir):
raise click.BadParameter(
"Module {} does not provide a db schema " "(no sql/ dir)".format(modname)
)
return sorted(glob.glob(path.join(sqldir, "*.sql")), key=sortkey)
def populate_database_for_package(
modname: str, conninfo: str, flavor: Optional[str] = None
) -> Tuple[bool, int, Optional[str]]:
- """Populate the database, pointed at with `conninfo`, using the SQL files found in
- the package `modname`.
+ """Populate the database, pointed at with ``conninfo``,
+ using the SQL files found in the package ``modname``.
Args:
modname: Name of the module of which we're loading the files
conninfo: connection info string for the SQL database
flavor: the module-specific flavor which we want to initialize the database under
+
Returns:
Tuple with three elements: whether the database has been initialized; the current
version of the database; if it exists, the flavor of the database.
"""
from swh.core.db.db_utils import swh_db_flavor, swh_db_version
current_version = swh_db_version(conninfo)
if current_version is not None:
dbflavor = swh_db_flavor(conninfo)
return False, current_version, dbflavor
sqlfiles = get_sql_for_package(modname)
sqlfiles = [fname for fname in sqlfiles if "-superuser-" not in fname]
execute_sqlfiles(sqlfiles, conninfo, flavor)
current_version = swh_db_version(conninfo)
assert current_version is not None
dbflavor = swh_db_flavor(conninfo)
return True, current_version, dbflavor
def parse_dsn_or_dbname(dsn_or_dbname: str) -> Dict[str, str]:
"""Parse a psycopg2 dsn, falling back to supporting plain database names as well"""
import psycopg2
from psycopg2.extensions import parse_dsn as _parse_dsn
try:
return _parse_dsn(dsn_or_dbname)
except psycopg2.ProgrammingError:
# psycopg2 failed to parse the DSN; it's probably a database name,
# handle it as such
return _parse_dsn(f"dbname={dsn_or_dbname}")
def init_admin_extensions(modname: str, conninfo: str) -> None:
"""The remaining initialization process -- running -superuser- SQL files -- is done
using the given conninfo, thus connecting to the newly created database
"""
sqlfiles = get_sql_for_package(modname)
sqlfiles = [fname for fname in sqlfiles if "-superuser-" in fname]
execute_sqlfiles(sqlfiles, conninfo)
def create_database_for_package(
modname: str, conninfo: str, template: str = "template1"
):
- """Create the database pointed at with `conninfo`, and initialize it using
- -superuser- SQL files found in the package `modname`.
+ """Create the database pointed at with ``conninfo``, and initialize it using
+ -superuser- SQL files found in the package ``modname``.
Args:
modname: Name of the module of which we're loading the files
conninfo: connection info string or plain database name for the SQL database
template: the name of the database to connect to and use as template to create
- the new database
+ the new database
"""
import subprocess
from psycopg2.extensions import make_dsn
# Use the given conninfo string, but with dbname replaced by the template dbname
# for the database creation step
creation_dsn = parse_dsn_or_dbname(conninfo)
db_name = creation_dsn["dbname"]
creation_dsn["dbname"] = template
logger.debug("db_create db_name=%s (from %s)", db_name, template)
subprocess.check_call(
[
"psql",
"--quiet",
"--no-psqlrc",
"-v",
"ON_ERROR_STOP=1",
"-d",
make_dsn(**creation_dsn),
"-c",
f'CREATE DATABASE "{db_name}"',
]
)
init_admin_extensions(modname, conninfo)
def execute_sqlfiles(
sqlfiles: Collection[str], conninfo: str, flavor: Optional[str] = None
):
- """Execute a list of SQL files on the database pointed at with `conninfo`.
+ """Execute a list of SQL files on the database pointed at with ``conninfo``.
Args:
sqlfiles: List of SQL files to execute
conninfo: connection info string for the SQL database
flavor: the database flavor to initialize
"""
import subprocess
psql_command = [
"psql",
"--quiet",
"--no-psqlrc",
"-v",
"ON_ERROR_STOP=1",
"-d",
conninfo,
]
flavor_set = False
for sqlfile in sqlfiles:
logger.debug(f"execute SQL file {sqlfile} db_name={conninfo}")
subprocess.check_call(psql_command + ["-f", sqlfile])
if flavor is not None and not flavor_set and sqlfile.endswith("-flavor.sql"):
logger.debug("Setting database flavor %s", flavor)
query = f"insert into dbflavor (flavor) values ('{flavor}')"
subprocess.check_call(psql_command + ["-c", query])
flavor_set = True
if flavor is not None and not flavor_set:
logger.warn(
"Asked for flavor %s, but module does not support database flavors", flavor,
)
diff --git a/tox.ini b/tox.ini
index 5d7ab80..6b2c32a 100644
--- a/tox.ini
+++ b/tox.ini
@@ -1,51 +1,97 @@
[tox]
envlist=black,flake8,mypy,py3-{core,db,server}
[testenv]
passenv = PYTHONASYNCIODEBUG
extras =
testing-core
core: logging
db: db, testing-db
server: http
deps =
cover: pytest-cov
commands =
pytest --doctest-modules \
slow: --hypothesis-profile=slow \
cover: --cov={envsitepackagesdir}/swh/core --cov-branch \
core: {envsitepackagesdir}/swh/core/tests \
db: {envsitepackagesdir}/swh/core/db/tests \
server: {envsitepackagesdir}/swh/core/api/tests \
{posargs}
[testenv:py3]
skip_install = true
deps = tox
commands = tox -e py3-core-db-server-slow-cover -- {posargs}
[testenv:black]
skip_install = true
deps =
black==19.10b0
commands =
{envpython} -m black --check swh
[testenv:flake8]
skip_install = true
deps =
flake8
commands =
{envpython} -m flake8
[testenv:mypy]
extras =
testing-core
logging
db
testing-db
http
deps =
mypy
commands =
mypy swh
+
+# build documentation outside swh-environment using the current
+# git HEAD of swh-docs, is executed on CI for each diff to prevent
+# breaking doc build
+[testenv:sphinx]
+whitelist_externals = make
+usedevelop = true
+extras =
+ testing-core
+ logging
+ db
+ testing-db
+ http
+deps =
+ # fetch and install swh-docs in develop mode
+ -e git+https://forge.softwareheritage.org/source/swh-docs#egg=swh.docs
+
+setenv =
+ SWH_PACKAGE_DOC_TOX_BUILD = 1
+ # turn warnings into errors
+ SPHINXOPTS = -W
+commands =
+ make -I ../.tox/sphinx/src/swh-docs/swh/ -C docs
+
+
+# build documentation only inside swh-environment using local state
+# of swh-docs package
+[testenv:sphinx-dev]
+whitelist_externals = make
+usedevelop = true
+extras =
+ testing-core
+ logging
+ db
+ testing-db
+ http
+deps =
+ # install swh-docs in develop mode
+ -e ../swh-docs
+
+setenv =
+ SWH_PACKAGE_DOC_TOX_BUILD = 1
+ # turn warnings into errors
+ SPHINXOPTS = -W
+commands =
+ make -I ../.tox/sphinx-dev/src/swh-docs/swh/ -C docs
File Metadata
Details
Attached
Mime Type
text/x-diff
Expires
Sat, Jun 21, 6:56 PM (2 w, 2 d ago)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
3447383
Attached To
rDCORE Foundations and core functionalities
Event Timeline
Log In to Comment