Diffusion Listers e69b07cabe68

New upstream version 0.0.19
e69b07cabe68
Actions

Tags

None

Subscribers

None

Description

New upstream version 0.0.19

Details

Provenance

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>	Authored on Feb 7 2019, 5:42 PM
swh-public-ci	Pushed on Feb 7 2019, 5:42 PM

Parents

rDLS1756e2efbfdb: Fix tests: config change lister_db_url -> lister had not been applied in tests
rDLSabcfd66ec0a1: New upstream version 0.0.18

Branches

Unknown

Tags

Unknown

References

tag: debian/upstream/0.0.19

Event Timeline

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDLSe69b07cabe68: New upstream version 0.0.19 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).Feb 7 2019, 5:42 PM

Merged Changes

1756e2efbfdb Fix tests: config change lister_db_url -> lister had not been applied in tests
Author
douardda
Browse Repository
Passed
No Audits
c1a3c10c5cc5 Bump dependencies
Author
douardda
Revisions
D1083: Improve the cli a bit and normalize the lister_db_url config
Browse Repository
Failed
No Audits
0720c8e12e78 Kill (useless) --create-tables and --with-data cli command options
Author
douardda
Revisions
D1083: Improve the cli a bit and normalize the lister_db_url config
Browse Repository
Failed
No Audits
662df8aea1b4 Change the lister_db_url config option into a 'lister' one
Author
douardda
Revisions
D1083: Improve the cli a bit and normalize the lister_db_url config
Browse Repository
Failed
No Audits
b8381d8a1b65 Add an entry point for the cli command
Author
douardda
Revisions
D1083: Improve the cli a bit and normalize the lister_db_url config
Browse Repository
Failed
No Audits
4f2580a97c69 Make the --lister option of the cli tool a variadic argument
Author
douardda
Revisions
D1083: Improve the cli a bit and normalize the lister_db_url config
Browse Repository
Failed
No Audits
c2c26d7e46ee Fix the bitbucket lister; handle properly the date-like bounds
Author
douardda
Revisions
D1051: Fix the bitbucket lister;
Browse Repository
Passed
No Audits
94a35f12aa0e Fix the SWHIndexingLister.db_partition_indices
Author
douardda
Revisions
D1051: Fix the bitbucket lister;
Browse Repository
Passed
No Audits
1b2d6895a9ff Use the named logger instead of the root logger in lister_base.py
Author
douardda
Revisions
D1051: Fix the bitbucket lister;
Browse Repository
Passed
No Audits
1d7d9b6128ea Log errors when fetching an url in SWHListerHttpTransport
Author
douardda
Revisions
D1051: Fix the bitbucket lister;
Browse Repository
Passed
No Audits
68eb727d6a22 npm.tasks: Fix NpmVisitModel parameters format
Author
anlambert
Browse Repository
Passed
No Audits
f670de298ff3 Remove debug logging from tasks' code
Author
douardda
Revisions
D970: Remove debug logging from tasks' code
Browse Repository
Passed
No Audits
6957f3c435b7 update dep on swh-scheduler>0.0.39 and pytest<4 (tests)
Author
douardda
Revisions
D963: update dep on swh-scheduler>0.0.39 and pytest<4 (tests)
Browse Repository
Passed
No Audits
e6a4ae76191a flake8: remove unneeded imports
Author
douardda
Browse Repository
Failed
No Audits
e31b61bee119 Do not crash range tasks if celery result backend does not support saving the…
Author
douardda
Revisions
D942: Do not crash range tasks if celery result backend does not support saving the group's state
Browse Repository
Failed
No Audits
a1ec4437e6d3 Add a few debug statements
Author
douardda
Revisions
D941: Add a few debug statements
Browse Repository
Failed
No Audits
065d3a64fc4f Fix SWHIndexingLister.db_partition_indices(); ensure partition size is not zero
Author
douardda
Revisions
D940: Fix SWHIndexingLister.db_partition_indices(); ensure partition size is not zero
Browse Repository
Failed
No Audits
028ceca90d72 Fix bitbucker lister: request_uri expect 'identifier' to be a date
Author
douardda
Revisions
D939: Fix bitbucker lister: min_bound must be a date
Browse Repository
Failed
No Audits
4fc1968f1fd4 Rename the bitbucket and github listers to remove the 'tld' part
Author
douardda
Revisions
D938: Rename the bitbucket and github listers to remove the 'tld' part
Browse Repository
Failed
No Audits
f46f3e2015bb Remove explicit setting of the task base class
Author
douardda
Browse Repository
Failed
No Audits
6030cb63150b Use pytest's conftest from swh-scheduler
Author
douardda
Browse Repository
Failed
No Audits
fb9265bb0315 Generate the gitlab's instance name from the api_baseurl by default
Author
douardda
Revisions
D901: Generate the gitlab's instance name from the api_baseurl by default
Browse Repository
Failed
No Audits
7db281aa3864 Fix gitlab task: pass per_page lister arg paremeter to the lister constructor
Author
douardda
Revisions
D893: Fix gitlab task: pass per_page lister arg paremeter to the lister constructor
Browse Repository
Failed
No Audits
65f3b9edc81d Add tests for pypi tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
f63b8326c5d2 Add tests for npm tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
264e9ea574da Add tests for gitlab tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
33ec762bd413 Add tests for debian tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
f375df58927c Add tests for bitbucket tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
b7139619fdd9 Add tests for github tasks
Author
douardda
Revisions
D892: Add tests for lister tasks
Browse Repository
Failed
No Audits
dd104759ae4f Small refactoring in indexing_lister
Author
douardda
Revisions
D891: Small refactoring in indexing_lister
Browse Repository
Failed
No Audits
0583b0e685c6 Add a 'ping' task for every lister.
Author
douardda
Revisions
D890: Add a 'ping' task for every lister.
Browse Repository
Passed
No Audits
2d1f0643ffb6 Heavy refactor of the task system
Author
douardda
Revisions
D889: Heavy refactor of the task system
Browse Repository
Failed
No Audits
94c1eaf40272 Fix: TaskType has been removed from scheduler 0.0.38
Author
douardda
Browse Repository
Passed
No Audits
72658ff72037 cli: fix debian lister so it also uses config overrides
Author
douardda
Revisions
D866: cli: fix debian lister so it also uses config overrides
Browse Repository
Passed
No Audits
5ff8093c5d5e Simplify listers Model constructor
Author
douardda
Revisions
D806: Small code cleanups
Browse Repository
Passed
No Audits
532fe90df506 Kill the XMLRPC transport
Author
douardda
Revisions
D806: Small code cleanups
Browse Repository
Passed
No Audits
ffe4ac9a3c4d swh.lister.npm: Add an incremental npm lister
Author
anlambert
Revisions
D756: swh.lister.npm: Add an incremental npm lister
Browse Repository
Passed
No Audits
605a67f51d7d swh.lister.npm : Add a lister of all available packages in the npm registry
Author
anlambert
Revisions
D706: Add a lister of all available packages in the npm registry
Browse Repository
Passed
No Audits
da4eb6cd348a doc: update index to match new swh-doc format
Author
douardda
Browse Repository
Passed
No Audits
2fa390828391 docs: prevent sphinx from complaining about tutorial.rst not being included
Author
douardda
Revisions
D639: Fix rst syntax in docstrings
Browse Repository
Passed
No Audits
849b909a52bf Fix rst syntax in docstrings
Author
douardda
Revisions
D639: Fix rst syntax in docstrings
Browse Repository
Passed
No Audits
9da0bd26ebe7 setup: kill remaining nose whims to be around
Author
douardda
Revisions
D602: Add a tox file and fix flake8 errors
Browse Repository
Passed
No Audits
428b3aca571c Add a tox file
Author
douardda
Revisions
D602: Add a tox file and fix flake8 errors
Browse Repository
Passed
No Audits
cd20f4d2239b Prevent deprecation warnings (logging.warn -> logging.warning)
Author
douardda
Revisions
D602: Add a tox file and fix flake8 errors
Browse Repository
Failed
No Audits
53840ac44bed Prevent a flake8 error
Author
douardda
Revisions
D602: Add a tox file and fix flake8 errors
Browse Repository
Failed
No Audits
788efd31aaa0 Fix a typo in setup.py
Author
douardda
Browse Repository
Failed
No Audits
e0bbadfa61d8 Don't run pytest in the docs directory
Author
olasd
Browse Repository
Failed
No Audits
b3e815bef8ff Rename test methods to test_ to allow collection by pytest
Author
olasd
Browse Repository
No Builds
No Audits

Changes (92)

Path

Size

ACKNOWLEDGEMENTS

bin/

new_bitbucket_lister.png

new_github_lister.png

old_github_lister.png

requirements-swh.txt

requirements-test.txt

requirements.txt

swh.lister.egg-info/

entry_points.txt

swh/

lister/

bitbucket/

tests/

test_bb_lister.py

core/

indexing_lister.py

lister_transports.py

tests/

test_abstractattribute.py

debian/

github/

tests/

gitlab/

tests/

test_gitlab_lister.py

api_empty_response.json

api_inc_empty_response.json

api_inc_response.json

api_response.json

pypi/

tests/

	swh/

	lister/

	debian/	tests/
	docs/	_static/

	__init__.py
	.placeholder

	pypi/	tests/
	docs/	_static/

	__init__.py
	.placeholder

	lister/	npm/
	docs/	_templates/

	__init__.py
	.placeholder

rDLSe69b07cabe68

.gitignore

Loading...

ACKNOWLEDGEMENTS

Loading...

LICENSE

Loading...

PKG-INFO

Loading...

bin/batch

Loading...

bin/reset.sh

Loading...

bin/status

Loading...

debian

Loading...

debian/changelog

Loading...

debian/clean

Loading...

debian/compat

Loading...

debian/control

Loading...

debian/copyright

Loading...

debian/rules

Loading...

debian/source

Loading...

debian/source/format

Loading...

docs

Loading...

docs/.gitignore

Loading...

docs/Makefile

Loading...

docs/_static

Loading...

docs/_static/.placeholder

Loading...

docs/_templates

Loading...

docs/_templates/.placeholder

Loading...

docs/conf.py

Loading...

docs/images

Loading...

docs/images/new_base.png

Loading...

docs/images/new_bitbucket_lister.png

Loading...

docs/images/new_github_lister.png

Loading...

docs/images/old_github_lister.png

Loading...

docs/index.rst

Loading...

docs/tutorial.rst

Loading...

requirements-swh.txt

Loading...

requirements-test.txt

Loading...

requirements.txt

Loading...

setup.py

Loading...

sql

Loading...

sql/crawler.sql

Loading...

sql/pimp_db.sql

Loading...

swh.lister.egg-info/PKG-INFO

Loading...

swh.lister.egg-info/SOURCES.txt

Loading...

swh.lister.egg-info/entry_points.txt

Loading...

swh.lister.egg-info/requires.txt

Loading...

swh/lister/_version.py

Loading...

swh/lister/bitbucket/lister.py

Loading...

swh/lister/bitbucket/tasks.py

Loading...

swh/lister/bitbucket/tests/conftest.py

Loading...

swh/lister/bitbucket/tests/test_bb_lister.py

Loading...

swh/lister/bitbucket/tests/test_tasks.py

Loading...

swh/lister/cli.py

Loading...

swh/lister/core/db_utils.py

Loading...

swh/lister/core/indexing_lister.py

Loading...

swh/lister/core/lister_base.py

Loading...

swh/lister/core/lister_transports.py

Loading...

swh/lister/core/models.py

Loading...

swh/lister/core/tasks.py

Loading...

swh/lister/core/tests/conftest.py

Loading...

swh/lister/core/tests/test_abstractattribute.py

Loading...

swh/lister/core/tests/test_lister.py

Loading...

swh/lister/core/tests/test_model.py

Loading...

swh/lister/debian/tasks.py

Loading...

swh/lister/debian/tests/init.py

Loading...

swh/lister/debian/tests/conftest.py

Loading...

swh/lister/debian/tests/test_tasks.py

Loading...

swh/lister/github/lister.py

Loading...

swh/lister/github/models.py

Loading...

swh/lister/github/tasks.py

Loading...

swh/lister/github/tests/conftest.py

Loading...

swh/lister/github/tests/test_tasks.py

Loading...

swh/lister/gitlab/lister.py

Loading...

swh/lister/gitlab/models.py

Loading...

swh/lister/gitlab/tasks.py

Loading...

swh/lister/gitlab/tests/conftest.py

Loading...

swh/lister/gitlab/tests/test_gitlab_lister.py

Loading...

swh/lister/gitlab/tests/test_tasks.py

Loading...

swh/lister/npm/init.py

Loading...

swh/lister/npm/lister.py

Loading...

swh/lister/npm/models.py

Loading...

swh/lister/npm/tasks.py

Loading...

swh/lister/npm/tests/api_empty_response.json

Loading...

swh/lister/npm/tests/api_inc_empty_response.json

Loading...

swh/lister/npm/tests/api_inc_response.json

Loading...

swh/lister/npm/tests/api_response.json

Loading...

swh/lister/pypi/tasks.py

Loading...

swh/lister/pypi/tests/init.py

Loading...

swh/lister/pypi/tests/conftest.py

Loading...

swh/lister/pypi/tests/test_tasks.py

Loading...

swh/lister/tests/test_utils.py

Loading...

version.txt

Loading...