Page MenuHomeSoftware Heritage
Feed Advanced Search

Mon, Apr 29

vlorentz closed T1541: journal publisher may crash on HTTP timeouts as Wontfix.

Closing because we removed the journal publisher. (My first WONTFIX <3)

Mon, Apr 29, 2:26 PM · Journal

Apr 12 2019

ardumont retitled D1345: swh.journal: Add backfiller implementation from swh.journal: Bootstrap backfiller to swh.journal: Add backfiller implementation.
Apr 12 2019, 3:50 PM · Storage manager, Journal
ardumont closed T1603: kafka storage backfiller as Resolved.

Closed by D1345

Apr 12 2019, 3:50 PM · Journal, Sprint 2019 03
ardumont closed D1345: swh.journal: Add backfiller implementation.
Apr 12 2019, 2:21 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/145/ for more details.

Apr 12 2019, 2:14 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase to latest master and branch diff to master

Apr 12 2019, 2:10 PM · Storage manager, Journal
olasd accepted D1345: swh.journal: Add backfiller implementation.
Apr 12 2019, 2:08 PM · Storage manager, Journal
vlorentz closed T1628: replayer: non reliability when fetching items from kafka as Resolved.
Apr 12 2019, 10:01 AM · Journal

Apr 11 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/144/ for more details.

Apr 11 2019, 6:33 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation (missing one blank line)

Apr 11 2019, 6:29 PM · Storage manager, Journal
Harbormaster failed remote builds in B5345: Diff 4537 for D1345: swh.journal: Add backfiller implementation!
Apr 11 2019, 6:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 11 2019, 6:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 11 2019, 6:26 PM · Storage manager, Journal
ardumont updated subscribers of D1345: swh.journal: Add backfiller implementation.
Apr 11 2019, 10:00 AM · Storage manager, Journal

Apr 10 2019

vlorentz added a revision to T1628: replayer: non reliability when fetching items from kafka: D1390: Make the replayer commit *after* adding objects to the replica..
Apr 10 2019, 11:41 AM · Journal
vlorentz moved T1603: kafka storage backfiller from Backlog to in progress on the Sprint 2019 03 board.
Apr 10 2019, 10:50 AM · Journal, Sprint 2019 03

Apr 9 2019

Harbormaster failed remote builds in B5285: Diff 4477 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:07 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Use the right logging instruction
  • backfill: Fix logging statement
Apr 9 2019, 6:04 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:02 PM · Storage manager, Journal
Harbormaster failed remote builds in B5283: Diff 4475 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:01 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:00 PM · Storage manager, Journal
Harbormaster failed remote builds in B5282: Diff 4474 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:00 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Improve module docstrings
  • backfill: Flush when data is sent
  • backfill: Define a _compute_shit_bits function to reuse code
Apr 9 2019, 5:59 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 5:46 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 4:48 PM · Storage manager, Journal
Harbormaster failed remote builds in B5238: Diff 4430 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 4:26 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 4:26 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • Remove publisher notion
Apr 9 2019, 4:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5219: Diff 4412 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:30 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:30 PM · Storage manager, Journal
Harbormaster failed remote builds in B5218: Diff 4411 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

oops, the rebase should have been on cleanup-publisher branch

Apr 9 2019, 12:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5215: Diff 4409 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:22 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on master

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on cleanup_publisher branch

Apr 9 2019, 12:19 PM · Storage manager, Journal
ardumont added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:03 PM · Storage manager, Journal
Harbormaster failed remote builds in B5210: Diff 4402 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 11:57 AM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 11:57 AM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 11:54 AM · Storage manager, Journal
zack triaged T1628: replayer: non reliability when fetching items from kafka as Normal priority.
Apr 9 2019, 9:59 AM · Journal

Apr 8 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/124/ for more details.

Apr 8 2019, 3:58 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/123/ for more details.

Apr 8 2019, 3:55 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Make partition key a singleton
Apr 8 2019, 3:54 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Fix origin_visit support to use the right format
  • backfill: Flush the messages to the journal when done with the batch
Apr 8 2019, 3:52 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/122/ for more details.

Apr 8 2019, 3:19 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation

Apr 8 2019, 3:16 PM · Storage manager, Journal
Harbormaster failed remote builds in B5193: Diff 4387 for D1345: swh.journal: Add backfiller implementation!
Apr 8 2019, 3:12 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the summary of D1345: swh.journal: Add backfiller implementation.
Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Add support for snapshot and directory

Apr 8 2019, 3:12 PM · Storage manager, Journal

Apr 6 2019

ardumont added projects to D1345: swh.journal: Add backfiller implementation: Journal, Storage manager.
Apr 6 2019, 12:01 AM · Storage manager, Journal

Apr 4 2019

olasd updated the task description for T1624: Normalize data sent from clients to the storage.
Apr 4 2019, 12:31 PM · Storage manager, Journal
olasd triaged T1624: Normalize data sent from clients to the storage as Normal priority.
Apr 4 2019, 12:31 PM · Storage manager, Journal

Apr 2 2019

zack added a project to T1603: kafka storage backfiller: Journal.
Apr 2 2019, 2:44 PM · Journal, Sprint 2019 03
ardumont closed T1276: swh-journal: Add tests as Resolved.
Apr 2 2019, 12:12 PM · Continuous Integration, Journal
ardumont closed T1276: swh-journal: Add tests, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Apr 2 2019, 12:12 PM · Journal

Mar 25 2019

ardumont closed D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 25 2019, 3:53 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/63/ for more details.

Mar 25 2019, 3:51 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • tests: Inline the kafka_consumer pytest fixture
  • tests: Simplify initialization test to use fixtures consistently
Mar 25 2019, 3:50 PM · Journal
Harbormaster failed remote builds in B4784: Diff 4075 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 25 2019, 11:35 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 25 2019, 11:35 AM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Rework commit messages

Mar 25 2019, 11:33 AM · Journal

Mar 22 2019

swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/61/ for more details.

Mar 22 2019, 4:16 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • test_publisher_kafka: Rename test_publisher to make a nicer/smaller diff
Mar 22 2019, 4:14 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/60/ for more details.

Mar 22 2019, 4:13 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Regroup variables together
Mar 22 2019, 4:11 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/59/ for more details.

Mar 22 2019, 4:05 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 4:02 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/57/ for more details.

Mar 22 2019, 3:58 PM · Journal
Harbormaster failed remote builds in B4770: Diff 4051 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 22 2019, 3:55 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:55 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Fix pep8 violation

Mar 22 2019, 3:53 PM · Journal
Harbormaster failed remote builds in B4769: Diff 4050 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 22 2019, 3:50 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:50 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • tests/conftest: Ensure failure message if inexisting kafka install
  • tox: Pass specific environment variable to tox
  • setup.py: Get back to initial formatting
Mar 22 2019, 3:49 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:26 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:24 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 2:08 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 1:57 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 12:19 PM · Journal

Mar 21 2019

swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 21 2019, 11:29 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 21 2019, 11:00 AM · Journal

Mar 20 2019

Harbormaster failed remote builds in B4758: Diff 4036 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:33 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:33 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation
Mar 20 2019, 2:32 PM · Journal
Harbormaster failed remote builds in B4757: Diff 4035 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:24 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:24 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation for real this time
Mar 20 2019, 2:22 PM · Journal
Harbormaster failed remote builds in B4756: Diff 4034 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:22 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:22 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation
Mar 20 2019, 2:20 PM · Journal
ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 20 2019, 2:11 PM · Journal
Harbormaster failed remote builds in B4755: Diff 4033 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:08 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:08 PM · Journal