Page MenuHomeSoftware Heritage
Feed Advanced Search

Mar 20 2019

ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • README: Explain how to run tests
  • setup.py: Use a shell script to ease the kafka development setup
  • Makefile.local: Add a target to clean up cache artifacts
Mar 20 2019, 2:06 PM · Journal
ardumont added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

So, if we keep the setup.py snippet to install kafka, I think it should be a completely separate subcommand of setup.py, rather than overriding the default behavior of the develop subcommand, which has a somewhat standard meaning of "install the current module for a development setup".

Mar 20 2019, 12:53 PM · Journal
olasd requested changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

So, if we keep the setup.py snippet to install kafka, I think it should be a completely separate subcommand of setup.py, rather than overriding the default behavior of the develop subcommand, which has a somewhat standard meaning of "install the current module for a development setup".

Mar 20 2019, 10:21 AM · Journal
ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 20 2019, 8:56 AM · Journal
ardumont retitled D1239: swh-journal: Add tests to the journal publisher using kafka instance from wip: pytest-kafka: ci tryout to swh-journal: Add tests to the journal publisher using kafka instance.
Mar 20 2019, 8:55 AM · Journal

Mar 19 2019

ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 19 2019, 11:48 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/43/ for more details.

Mar 19 2019, 11:42 AM · Journal
ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 19 2019, 11:41 AM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Remove unused import

Mar 19 2019, 11:40 AM · Journal
Harbormaster failed remote builds in B4715: Diff 4000 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 19 2019, 10:56 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 19 2019, 10:56 AM · Journal
ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 19 2019, 10:55 AM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Rebase on latest master

Mar 19 2019, 10:55 AM · Journal

Mar 18 2019

ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

I think i'm done for the main part of the tests.

Mar 18 2019, 7:39 PM · Journal
ardumont added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 18 2019, 7:37 PM · Journal
Harbormaster failed remote builds in B4697: Diff 3981 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 18 2019, 7:34 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 18 2019, 7:34 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Make test work for major object types

Mar 18 2019, 7:33 PM · Journal

Mar 15 2019

Harbormaster failed remote builds in B4663: Diff 3949 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 15 2019, 1:55 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 15 2019, 1:55 PM · Journal
ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 15 2019, 1:54 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Rebase on latest master (and removes the cli adaptation part, D1249)

Mar 15 2019, 1:54 PM · Journal
ardumont closed D1249: publisher: Simplify publisher initialization and add journal cli.
Mar 15 2019, 1:50 PM · Journal
swh-public-ci added a comment to D1249: publisher: Simplify publisher initialization and add journal cli.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/37/ for more details.

Mar 15 2019, 1:44 PM · Journal
ardumont updated the diff for D1249: publisher: Simplify publisher initialization and add journal cli.

Adapt according to review

Mar 15 2019, 1:43 PM · Journal
ardumont added a comment to D1249: publisher: Simplify publisher initialization and add journal cli.

Thanks for the remarks.

Mar 15 2019, 1:12 PM · Journal
vlorentz added inline comments to D1249: publisher: Simplify publisher initialization and add journal cli.
Mar 15 2019, 12:23 PM · Journal
vlorentz added inline comments to D1249: publisher: Simplify publisher initialization and add journal cli.
Mar 15 2019, 12:23 PM · Journal
vlorentz accepted D1249: publisher: Simplify publisher initialization and add journal cli.

Accepted, but let's not forget to add tests for the CLI

Mar 15 2019, 12:22 PM · Journal
ardumont added a project to D1249: publisher: Simplify publisher initialization and add journal cli: Journal.
Mar 15 2019, 12:21 PM · Journal

Mar 14 2019

Harbormaster failed remote builds in B4649: Diff 3934 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 14 2019, 7:36 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 14 2019, 7:36 PM · Journal
ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 14 2019, 7:36 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Will remove the 'develop' step later

Mar 14 2019, 7:35 PM · Journal
ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 14 2019, 2:43 PM · Journal
ardumont added inline comments to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 14 2019, 1:35 PM · Journal
ardumont added inline comments to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 14 2019, 1:30 PM · Journal

Mar 13 2019

ardumont added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
In D1239#26394, @olasd wrote:

Thanks for looking into pytest-kafka!

Before you go too much further with this approach, I'll just say that it makes me very uncomfortable...

Mar 13 2019, 4:54 PM · Journal
ardumont added inline comments to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 13 2019, 4:50 PM · Journal
vlorentz added inline comments to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 13 2019, 4:17 PM · Journal
olasd added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Thanks for looking into pytest-kafka!

Mar 13 2019, 4:08 PM · Journal
ardumont retitled D1239: swh-journal: Add tests to the journal publisher using kafka instance from wip: pytest-kafka: Tryout in the ci to wip: pytest-kafka: ci tryout.
Mar 13 2019, 3:45 PM · Journal
ardumont added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Ensure this now rather than later ;)

Mar 13 2019, 3:37 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/28/ for more details.

Mar 13 2019, 3:33 PM · Journal
ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 13 2019, 3:32 PM · Journal
ardumont planned changes to D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 13 2019, 3:31 PM · Journal
ardumont added a project to D1239: swh-journal: Add tests to the journal publisher using kafka instance: Journal.
Mar 13 2019, 3:31 PM · Journal

Mar 8 2019

anlambert renamed T1575: Kafka clients crash easily in docker-compose environment from Kafka crashes easily in docker-compose environment to Kafka clients crash easily in docker-compose environment.
Mar 8 2019, 7:23 PM · Journal, Docker environment
anlambert triaged T1575: Kafka clients crash easily in docker-compose environment as Normal priority.
Mar 8 2019, 4:44 PM · Journal, Docker environment

Feb 25 2019

douardda triaged T1541: journal publisher may crash on HTTP timeouts as High priority.
Feb 25 2019, 12:06 PM · Journal

Jan 15 2019

ardumont updated the task description for T1471: journal: add a journal origin client to schedule loader tasks?.
Jan 15 2019, 2:20 PM · Journal
ardumont updated the task description for T1471: journal: add a journal origin client to schedule loader tasks?.
Jan 15 2019, 2:19 PM · Journal
ardumont updated the task description for T1471: journal: add a journal origin client to schedule loader tasks?.
Jan 15 2019, 2:18 PM · Journal
ardumont added a project to T1471: journal: add a journal origin client to schedule loader tasks?: Journal.
Jan 15 2019, 2:17 PM · Journal

Jan 14 2019

ardumont closed T1466: Deploy swh-indexer-journal-client as Resolved.
Jan 14 2019, 11:33 AM · Journal, Indexer
ardumont closed T1468: journal: Deploy the publisher, a subtask of T1466: Deploy swh-indexer-journal-client, as Resolved.
Jan 14 2019, 11:33 AM · Journal, Indexer
ardumont closed T1468: journal: Deploy the publisher, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Jan 14 2019, 11:33 AM · Journal
ardumont closed T1468: journal: Deploy the publisher as Resolved.
Jan 14 2019, 11:33 AM · Journal

Jan 13 2019

ardumont added a comment to T1466: Deploy swh-indexer-journal-client.

heads up btw: It's deployed.

Jan 13 2019, 12:37 PM · Journal, Indexer
ardumont added a parent task for T1468: journal: Deploy the publisher: T1466: Deploy swh-indexer-journal-client.
Jan 13 2019, 12:36 PM · Journal
ardumont added a subtask for T1466: Deploy swh-indexer-journal-client: T1468: journal: Deploy the publisher.
Jan 13 2019, 12:36 PM · Journal, Indexer
ardumont triaged T1468: journal: Deploy the publisher as Normal priority.
Jan 13 2019, 12:35 PM · Journal
ardumont closed T494: swh-journal: archiver-client: Keep archiver table in sync with new contents as Invalid.
Jan 13 2019, 12:33 PM · Journal, Restricted Project, Storage manager
ardumont closed T494: swh-journal: archiver-client: Keep archiver table in sync with new contents, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Invalid.
Jan 13 2019, 12:33 PM · Journal
ardumont closed T1277: swh-journal: Create a journal client for listing origin visits, a subtask of T1466: Deploy swh-indexer-journal-client, as Resolved.
Jan 13 2019, 12:31 PM · Journal, Indexer
ardumont closed T1277: swh-journal: Create a journal client for listing origin visits, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Jan 13 2019, 12:31 PM · Journal
ardumont closed T1277: swh-journal: Create a journal client for listing origin visits as Resolved.

D918 closes this.

Jan 13 2019, 12:31 PM · Indexer, Journal
ardumont added a parent task for T1277: swh-journal: Create a journal client for listing origin visits: T1466: Deploy swh-indexer-journal-client.
Jan 13 2019, 12:30 PM · Indexer, Journal
ardumont added a subtask for T1466: Deploy swh-indexer-journal-client: T1277: swh-journal: Create a journal client for listing origin visits.
Jan 13 2019, 12:30 PM · Journal, Indexer
ardumont closed T1275: swh-journal: Complete missing snapshot insertion event from storage to journal, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Jan 13 2019, 12:27 PM · Journal
ardumont closed T1275: swh-journal: Complete missing snapshot insertion event from storage to journal as Resolved.
Jan 13 2019, 12:27 PM · Storage manager, Journal

Jan 10 2019

vlorentz added a subtask for T1466: Deploy swh-indexer-journal-client: T1455: Add a journal client that schedules oneshot tasks for metadata indexers.
Jan 10 2019, 5:13 PM · Journal, Indexer
vlorentz triaged T1466: Deploy swh-indexer-journal-client as High priority.
Jan 10 2019, 5:13 PM · Journal, Indexer
vlorentz closed T1465: Journal notification of full origin visits as Resolved.
Jan 10 2019, 5:12 PM · Journal
vlorentz triaged T1465: Journal notification of full origin visits as Normal priority.
Jan 10 2019, 3:30 PM · Journal

Nov 27 2018

ardumont renamed T1277: swh-journal: Create a journal client for listing origin visits from swh-journal: Create a journal client for listing origins to swh-journal: Create a journal client for listing origin visits.
Nov 27 2018, 11:59 AM · Indexer, Journal

Nov 7 2018

ardumont closed D611: swh.storage.listener: Listener subscription to new storage snapshot insertion events.
Nov 7 2018, 9:57 AM · Journal

Nov 6 2018

olasd accepted D611: swh.storage.listener: Listener subscription to new storage snapshot insertion events.
Nov 6 2018, 11:51 AM · Journal

Oct 27 2018

ardumont retitled D611: swh.storage.listener: Listener subscription to new storage snapshot insertion events from Update listener to subscribe to snapshot insertion event to swh.storage.listener: Listener subscription to new storage snapshot insertion events.
Oct 27 2018, 10:09 AM · Journal

Oct 26 2018

ardumont added a project to D611: swh.storage.listener: Listener subscription to new storage snapshot insertion events: Journal.
Oct 26 2018, 7:23 PM · Journal

Oct 18 2018

olasd removed a project from T1275: swh-journal: Complete missing snapshot insertion event from storage to journal: Developers.
Oct 18 2018, 5:35 PM · Storage manager, Journal
olasd removed a project from T1279: swh-journal: The schema migration problem: Developers.
Oct 18 2018, 4:52 PM · Journal
olasd removed a project from T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage: Developers.
Oct 18 2018, 4:52 PM · Journal
olasd removed a project from T1277: swh-journal: Create a journal client for listing origin visits: Developers.
Oct 18 2018, 4:51 PM · Indexer, Journal
olasd removed a project from T1276: swh-journal: Add tests: Developers.
Oct 18 2018, 4:51 PM · Continuous Integration, Journal
olasd edited projects for T1278: swh-journal: the monitoring tool question!, added: Journal; removed Developers.
Oct 18 2018, 4:50 PM · Journal
ardumont added a project to T1279: swh-journal: The schema migration problem: Journal.
Oct 18 2018, 4:27 PM · Journal
ardumont added a project to T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage: Journal.
Oct 18 2018, 4:15 PM · Journal
ardumont triaged T1277: swh-journal: Create a journal client for listing origin visits as Normal priority.
Oct 18 2018, 4:03 PM · Indexer, Journal
ardumont removed a parent task for T528: swh-journal: Create a journal client listing objects of a given type: T359: Indexers: batch content analyzer infrastructure.
Oct 18 2018, 3:55 PM · Journal
ardumont renamed T528: swh-journal: Create a journal client listing objects of a given type from Create a journal client that can list all the objects of a given type to swh-journal: Create a journal client listing objects of a given type.
Oct 18 2018, 3:55 PM · Journal
ardumont renamed T529: swh-journal: Create a journal checker comparing object lists between journal and database from swh-journal - Create a journal checker comparing object lists between journal and database to swh-journal: Create a journal checker comparing object lists between journal and database.
Oct 18 2018, 3:53 PM · Journal
ardumont renamed T529: swh-journal: Create a journal checker comparing object lists between journal and database from Create a journal checker that compares object lists from the journal and from the database to swh-journal - Create a journal checker comparing object lists between journal and database.
Oct 18 2018, 3:53 PM · Journal
ardumont closed T527: Insert newly created objects in the journal as Resolved.
Oct 18 2018, 3:48 PM · Journal
ardumont added a comment to T527: Insert newly created objects in the journal.

It's been done for the schema at that time so closing it.

Oct 18 2018, 3:48 PM · Journal
ardumont claimed T1276: swh-journal: Add tests.
Oct 18 2018, 3:46 PM · Continuous Integration, Journal
ardumont triaged T1276: swh-journal: Add tests as Normal priority.
Oct 18 2018, 3:45 PM · Continuous Integration, Journal
ardumont triaged T1275: swh-journal: Complete missing snapshot insertion event from storage to journal as Normal priority.
Oct 18 2018, 3:40 PM · Storage manager, Journal
ardumont renamed T494: swh-journal: archiver-client: Keep archiver table in sync with new contents from Keep archiver table in sync with new contents to swh-journal: archiver-client: Keep archiver table in sync with new contents.
Oct 18 2018, 9:40 AM · Journal, Restricted Project, Storage manager

Dec 7 2017

ardumont created T874: Keep indexer table in sync with new contents.
Dec 7 2017, 10:17 PM · Journal, Indexer