Diffusion Scheduling utilities 08a7da4ffc1a

stretch-swh
08a7da4ffc1a
Actions

Description

Merge branch 'debian/unstable-swh' into debian/stretch-swh

Conflicts:
debian/changelog

Details

Provenance

ardumont	Authored on May 29 2018, 12:27 PM
olasd	Pushed on Dec 4 2018, 12:48 PM

Parents

rDSCH33d6677f500d: Updated debian stretch backport directory for version 0.0.26
rDSCHf4e8330583c3: Updated debian directory for version 0.0.27

Branches

Unknown

Tags

Unknown

Event Timeline

ardumont committed rDSCH08a7da4ffc1a: Merge branch 'debian/unstable-swh' into debian/stretch-swh (authored by ardumont).May 29 2018, 12:27 PM

Merged Changes

This commit merges a very large number of changes. Only the first 50 are shown.

f4e8330583c3 Updated debian directory for version 0.0.27
Author
ardumont
Browse Repository
No Builds
No Audits
3098c40f5994 Update upstream source from tag 'debian/upstream/0.0.27'
Author
ardumont
Browse Repository
No Builds
No Audits
8fd3bd74be0f New upstream version 0.0.27
Author
ardumont
Browse Repository
No Builds
No Audits
cde2defb22d2 packaging: Remove .hypothesis folder
Author
ardumont
Browse Repository
No Builds
No Audits
7b45010e3fb1 packaging: Fix tests in packaging
Author
ardumont
Browse Repository
No Builds
No Audits
a864649e1804 packaging: Fix python3-swh.scheduler.updater tests package
Author
ardumont
Browse Repository
No Builds
No Audits
1bdfaf1731b0 d/control: Add new python3-swh.scheduler.updater package
Author
ardumont
Browse Repository
No Builds
No Audits
5e56731ee2ae d/control: Fix runtime dependency version
Author
ardumont
Browse Repository
No Builds
No Audits
58352e23d84d swh.scheduler.updater.writer: Add tests around writer
Author
ardumont
Browse Repository
No Builds
No Audits
09e028ece212 swh.scheduler.updater.backend: Make the reading timestamp optional
Author
ardumont
Browse Repository
No Builds
No Audits
9def570dd140 swh.scheduler.updater.writer: Do not set the limit at this level
Author
ardumont
Browse Repository
No Builds
No Audits
c288da2ec0b0 swh.scheduler.updater.writer: Write tasks in batch
Author
ardumont
Browse Repository
No Builds
No Audits
ab844befb567 swh-scheduler: Fill in the blanks between priority tasks
Author
ardumont
Browse Repository
No Builds
No Audits
378d23b7e183 data/elastic-template.json: Use 1 shard for the swh-tasks index
Author
ardumont
Browse Repository
No Builds
No Audits
d925b052a9f8 swh.scheduler.backend: Drop duplicate tasks at creation time
Author
ardumont
Browse Repository
No Builds
No Audits
3f02cc39c774 swh.scheduler.api.client: Permit to specify the query timeout option
Author
ardumont
Browse Repository
No Builds
No Audits
2b660ca0a11b swh.scheduler.backend: Add missing type cast
Author
ardumont
Browse Repository
No Builds
No Audits
455f6d4ce89f swh.scheduler.updater.writer: Remove noqa statement
Author
ardumont
Browse Repository
No Builds
No Audits
56ce0f0ab9bd swh.scheduler.celery_backend.runner: Read more oneshot tasks
Author
ardumont
Browse Repository
No Builds
No Audits
801d8e2cd413 swh.scheduler.updater.writer: Sleep in between read/write cycle
Author
ardumont
Browse Repository
No Builds
No Audits
3b0d71b861aa swh.scheduler.updater.writer: Reuse oneshot task dict creation api
Author
ardumont
Browse Repository
No Builds
No Audits
6980dbb275fc swh.scheduler.updater.writer: Add configuration docstring
Author
ardumont
Browse Repository
No Builds
No Audits
142f77dd42f0 swh.scheduler.updater: Rename appropriately rate to cnt
Author
ardumont
Browse Repository
No Builds
No Audits
a06c20b75274 swh.scheduler.updater.sql: Add first_seen column
Author
ardumont
Browse Repository
No Builds
No Audits
070e5160fc72 swh.scheduler.updater.writer: Update variable names appropriately
Author
ardumont
Browse Repository
No Builds
No Audits
eeb5d77670bf swh.scheduler.updater.writer: Bootstrap the scheduler updater writer
Author
ardumont
Browse Repository
No Builds
No Audits
33bc608aadad swh.scheduler.updater: Reference the origin's type
Author
ardumont
Browse Repository
No Builds
No Audits
7b0c3160265f swh.scheduler.updater.ghtorrent: Don't open too many channels
Author
ardumont
Browse Repository
No Builds
No Audits
c7d17a5f15c8 swh.scheduler.updater.events: Fix event's __str__ implementation
Author
ardumont
Browse Repository
No Builds
No Audits
76423399a3a9 swh.scheduler.updater.consumer: Make the logging actually log
Author
ardumont
Browse Repository
No Builds
No Audits
8e0a1694e3fc swh.scheduler.updater.ghtorrent: Explicit interesting event keys
Author
ardumont
Browse Repository
No Builds
No Audits
8e39b42e1c30 swh.scheduler.tests.updater: Reuse code in mixin
Author
ardumont
Browse Repository
No Builds
No Audits
8add41c93572 swh.scheduler.updater.consumer: Improve event management
Author
ardumont
Browse Repository
No Builds
No Audits
2aa60e0fa278 swh.scheduler.updater.consumer: Use logging instead of print
Author
ardumont
Browse Repository
No Builds
No Audits
ff65e774fe1a swh.scheduler.updater.ghtorrent: Remove scratch code
Author
ardumont
Browse Repository
No Builds
No Audits
f2b0500d4370 swh.scheduler.updater.consumer: Test consumer interface
Author
ardumont
Browse Repository
No Builds
No Audits
24a887e21103 swh.scheduler.updater.ghtorrent: Test ghtorrent implementation
Author
ardumont
Browse Repository
No Builds
No Audits
e281091ed491 swh.scheduler.updater.ghtorrent: Simplify connection setup
Author
ardumont
Browse Repository
No Builds
No Audits
86e0dafcbce9 swh.scheduler.updater.ghtorrent: Clarify docstrings
Author
ardumont
Browse Repository
No Builds
No Audits
07397aec88b7 swh.scheduler.updater.ghtorrent: Explicit configuration options
Author
ardumont
Browse Repository
No Builds
No Audits
c454b4179822 swh.scheduler.updater.ghtorrent: Clean up dead code
Author
ardumont
Browse Repository
No Builds
No Audits
52614b911da7 swh.scheduler.updater.ghtorrent: Move implem inside its own module
Author
ardumont
Browse Repository
No Builds
No Audits
e2be88852cd9 swh.scheduler.updater.ghtorrent: Simplify consumer interface
Author
ardumont
Browse Repository
No Builds
No Audits
0c1b67e5e6a2 swh.scheduler.updater.ghtorrent: Improve reading events
Author
ardumont
Browse Repository
No Builds
No Audits
441aa92d7fc8 swh.scheduler.updater.consumer: Flush memory cache
Author
ardumont
Browse Repository
No Builds
No Audits
d4dbf0aa7914 swh.scheduler.updater.consumer: Check for data to send in final step
Author
ardumont
Browse Repository
No Builds
No Audits
333afe98f4cd swh.scheduler.updater: Design the UpdaterConsumer interface
Author
ardumont
Browse Repository
No Builds
No Audits
f16fa5f28c2d swh.scheduler.updater: Don't subscribe to create event
Author
ardumont
Browse Repository
No Builds
No Audits
5bda01137e00 swh.scheduler.updater: Actually use the cache_put method with list
Author
ardumont
Browse Repository
No Builds
No Audits
3a39baa8c72c updater/ghtorrent: Open ghtorrent consumer as cli script
Author
ardumont
Browse Repository
No Builds
No Audits

Changes (45)

Path

Size

.gitignore

PKG-INFO

data/

elastic-template.json

debian/

changelog

requirements-swh.txt

requirements.txt

sql/

swh-scheduler-data.sql

swh-scheduler-schema.sql

	updater/	sql/

Makefile

updates/

09.sql

swh.scheduler.egg-info/

PKG-INFO

SOURCES.txt

requires.txt

swh/

scheduler/

api/

celery_backend/

tests/

	updater/
	api/

__init__.py

utils.py

version.txt

rDSCH08a7da4ffc1a

View Options

.gitignore

View Options

PKG-INFO

View Options

data/elastic-template.json

View Options

debian/changelog

View Options

requirements-swh.txt

View Options

requirements.txt

View Options

sql/swh-scheduler-data.sql

View Options

sql/swh-scheduler-schema.sql

View Options

sql/updater/sql/Makefile

View Options

sql/updater/sql/swh-func.sql

View Options

sql/updater/sql/swh-init.sql

View Options

sql/updater/sql/swh-schema.sql

View Options

sql/updates/09.sql

View Options

swh.scheduler.egg-info/PKG-INFO

View Options

swh.scheduler.egg-info/SOURCES.txt

View Options

swh.scheduler.egg-info/requires.txt

View Options

swh/scheduler/api/client.py

View Options

swh/scheduler/api/server.py

View Options

swh/scheduler/backend.py

View Options

swh/scheduler/celery_backend/listener.py

View Options

swh/scheduler/celery_backend/runner.py

View Options

swh/scheduler/cli.py

View Options

swh/scheduler/tests/test_scheduler.py

View Options

swh/scheduler/tests/test_utils.py

View Options

swh/scheduler/tests/updater/init.py

View Options

swh/scheduler/tests/updater/test_backend.py

View Options

swh/scheduler/tests/updater/test_consumer.py

View Options

swh/scheduler/tests/updater/test_events.py

View Options

swh/scheduler/tests/updater/test_ghtorrent.py

View Options

swh/scheduler/tests/updater/test_writer.py

View Options

swh/scheduler/updater/init.py

View Options

swh/scheduler/updater/backend.py

View Options

swh/scheduler/updater/consumer.py

View Options

swh/scheduler/updater/events.py

View Options

swh/scheduler/updater/ghtorrent/init.py

View Options

swh/scheduler/updater/ghtorrent/cli.py

View Options

swh/scheduler/updater/ghtorrent/fake.py

View Options

swh/scheduler/updater/writer.py

View Options

swh/scheduler/utils.py

View Options

Merge branch 'debian/unstable-swh' into debian/stretch-swh08a7da4ffc1aActions

Description

Details

Event Timeline

Merged Changes

Changes (45)

rDSCH08a7da4ffc1a

.gitignore

PKG-INFO

data/elastic-template.json

debian/changelog

requirements-swh.txt

requirements.txt

sql/swh-scheduler-data.sql

sql/swh-scheduler-schema.sql

sql/updater/sql/Makefile

sql/updater/sql/swh-func.sql

sql/updater/sql/swh-init.sql

sql/updater/sql/swh-schema.sql

sql/updates/09.sql

swh.scheduler.egg-info/PKG-INFO

swh.scheduler.egg-info/SOURCES.txt

swh.scheduler.egg-info/requires.txt

swh/scheduler/api/client.py

swh/scheduler/api/server.py

swh/scheduler/backend.py

swh/scheduler/celery_backend/listener.py

swh/scheduler/celery_backend/runner.py

swh/scheduler/cli.py

swh/scheduler/tests/test_scheduler.py

swh/scheduler/tests/test_utils.py

swh/scheduler/tests/updater/__init__.py

swh/scheduler/tests/updater/test_backend.py

swh/scheduler/tests/updater/test_consumer.py

swh/scheduler/tests/updater/test_events.py

swh/scheduler/tests/updater/test_ghtorrent.py

swh/scheduler/tests/updater/test_writer.py

swh/scheduler/updater/__init__.py

swh/scheduler/updater/backend.py

swh/scheduler/updater/consumer.py

swh/scheduler/updater/events.py

swh/scheduler/updater/ghtorrent/__init__.py

swh/scheduler/updater/ghtorrent/cli.py

swh/scheduler/updater/ghtorrent/fake.py

swh/scheduler/updater/writer.py

swh/scheduler/utils.py

version.txt

Merge branch 'debian/unstable-swh' into debian/stretch-swh
08a7da4ffc1a
Actions

swh/scheduler/tests/updater/init.py

swh/scheduler/updater/init.py

swh/scheduler/updater/ghtorrent/init.py