Page MenuHomeSoftware Heritage
Feed Advanced Search

Fri, Apr 12

ardumont retitled D1345: swh.journal: Add backfiller implementation from swh.journal: Bootstrap backfiller to swh.journal: Add backfiller implementation.
Fri, Apr 12, 3:50 PM · Storage manager, Journal
ardumont closed T1603: kafka storage backfiller as Resolved.

Closed by D1345

Fri, Apr 12, 3:50 PM · Journal, Sprint 2019 03
ardumont closed D1345: swh.journal: Add backfiller implementation.
Fri, Apr 12, 2:21 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/145/ for more details.

Fri, Apr 12, 2:14 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase to latest master and branch diff to master

Fri, Apr 12, 2:10 PM · Storage manager, Journal
olasd accepted D1345: swh.journal: Add backfiller implementation.
Fri, Apr 12, 2:08 PM · Storage manager, Journal
vlorentz closed T1628: replayer: non reliability when fetching items from kafka as Resolved.
Fri, Apr 12, 10:01 AM · Journal

Thu, Apr 11

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/144/ for more details.

Thu, Apr 11, 6:33 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation (missing one blank line)

Thu, Apr 11, 6:29 PM · Storage manager, Journal
Harbormaster failed remote builds in B5345: Diff 4537 for D1345: swh.journal: Add backfiller implementation!
Thu, Apr 11, 6:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Thu, Apr 11, 6:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Thu, Apr 11, 6:26 PM · Storage manager, Journal
ardumont updated subscribers of D1345: swh.journal: Add backfiller implementation.
Thu, Apr 11, 10:00 AM · Storage manager, Journal

Wed, Apr 10

vlorentz added a revision to T1628: replayer: non reliability when fetching items from kafka: D1390: Make the replayer commit *after* adding objects to the replica..
Wed, Apr 10, 11:41 AM · Journal
vlorentz moved T1603: kafka storage backfiller from Backlog to in progress on the Sprint 2019 03 board.
Wed, Apr 10, 10:50 AM · Journal, Sprint 2019 03

Tue, Apr 9

Harbormaster failed remote builds in B5285: Diff 4477 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 6:07 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 6:07 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Tue, Apr 9, 6:07 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Use the right logging instruction
  • backfill: Fix logging statement
Tue, Apr 9, 6:04 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Tue, Apr 9, 6:02 PM · Storage manager, Journal
Harbormaster failed remote builds in B5283: Diff 4475 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 6:01 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Tue, Apr 9, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 6:00 PM · Storage manager, Journal
Harbormaster failed remote builds in B5282: Diff 4474 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 6:00 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Improve module docstrings
  • backfill: Flush when data is sent
  • backfill: Define a _compute_shit_bits function to reuse code
Tue, Apr 9, 5:59 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Tue, Apr 9, 5:46 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Tue, Apr 9, 4:48 PM · Storage manager, Journal
Harbormaster failed remote builds in B5238: Diff 4430 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 4:26 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 4:26 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • Remove publisher notion
Tue, Apr 9, 4:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5219: Diff 4412 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 12:30 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 12:30 PM · Storage manager, Journal
Harbormaster failed remote builds in B5218: Diff 4411 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 12:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 12:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

oops, the rebase should have been on cleanup-publisher branch

Tue, Apr 9, 12:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5215: Diff 4409 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 12:22 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on master

Tue, Apr 9, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on cleanup_publisher branch

Tue, Apr 9, 12:19 PM · Storage manager, Journal
ardumont added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 12:03 PM · Storage manager, Journal
Harbormaster failed remote builds in B5210: Diff 4402 for D1345: swh.journal: Add backfiller implementation!
Tue, Apr 9, 11:57 AM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Tue, Apr 9, 11:57 AM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Tue, Apr 9, 11:54 AM · Storage manager, Journal
zack triaged T1628: replayer: non reliability when fetching items from kafka as Normal priority.
Tue, Apr 9, 9:59 AM · Journal

Mon, Apr 8

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/124/ for more details.

Mon, Apr 8, 3:58 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/123/ for more details.

Mon, Apr 8, 3:55 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Make partition key a singleton
Mon, Apr 8, 3:54 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Fix origin_visit support to use the right format
  • backfill: Flush the messages to the journal when done with the batch
Mon, Apr 8, 3:52 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/122/ for more details.

Mon, Apr 8, 3:19 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation

Mon, Apr 8, 3:16 PM · Storage manager, Journal
Harbormaster failed remote builds in B5193: Diff 4387 for D1345: swh.journal: Add backfiller implementation!
Mon, Apr 8, 3:12 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Mon, Apr 8, 3:12 PM · Storage manager, Journal
ardumont updated the summary of D1345: swh.journal: Add backfiller implementation.
Mon, Apr 8, 3:12 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Add support for snapshot and directory

Mon, Apr 8, 3:12 PM · Storage manager, Journal

Sat, Apr 6

ardumont added projects to D1345: swh.journal: Add backfiller implementation: Journal, Storage manager.
Sat, Apr 6, 12:01 AM · Storage manager, Journal

Thu, Apr 4

olasd updated the task description for T1624: Normalize data sent from clients to the storage.
Thu, Apr 4, 12:31 PM · Storage manager, Journal
olasd triaged T1624: Normalize data sent from clients to the storage as Normal priority.
Thu, Apr 4, 12:31 PM · Storage manager, Journal

Tue, Apr 2

zack added a project to T1603: kafka storage backfiller: Journal.
Tue, Apr 2, 2:44 PM · Journal, Sprint 2019 03
ardumont closed T1276: swh-journal: Add tests as Resolved.
Tue, Apr 2, 12:12 PM · Continuous Integration, Journal
ardumont closed T1276: swh-journal: Add tests, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Tue, Apr 2, 12:12 PM · Journal

Mar 25 2019

ardumont closed D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 25 2019, 3:53 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/63/ for more details.

Mar 25 2019, 3:51 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • tests: Inline the kafka_consumer pytest fixture
  • tests: Simplify initialization test to use fixtures consistently
Mar 25 2019, 3:50 PM · Journal
Harbormaster failed remote builds in B4784: Diff 4075 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 25 2019, 11:35 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 25 2019, 11:35 AM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Rework commit messages

Mar 25 2019, 11:33 AM · Journal

Mar 22 2019

swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/61/ for more details.

Mar 22 2019, 4:16 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • test_publisher_kafka: Rename test_publisher to make a nicer/smaller diff
Mar 22 2019, 4:14 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/60/ for more details.

Mar 22 2019, 4:13 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Regroup variables together
Mar 22 2019, 4:11 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/59/ for more details.

Mar 22 2019, 4:05 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 4:02 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/57/ for more details.

Mar 22 2019, 3:58 PM · Journal
Harbormaster failed remote builds in B4770: Diff 4051 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 22 2019, 3:55 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:55 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Fix pep8 violation

Mar 22 2019, 3:53 PM · Journal
Harbormaster failed remote builds in B4769: Diff 4050 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 22 2019, 3:50 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:50 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • tests/conftest: Ensure failure message if inexisting kafka install
  • tox: Pass specific environment variable to tox
  • setup.py: Get back to initial formatting
Mar 22 2019, 3:49 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:26 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:24 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 2:08 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 1:57 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 12:19 PM · Journal

Mar 21 2019

swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 21 2019, 11:29 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 21 2019, 11:00 AM · Journal

Mar 20 2019

Harbormaster failed remote builds in B4758: Diff 4036 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:33 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:33 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation
Mar 20 2019, 2:32 PM · Journal
Harbormaster failed remote builds in B4757: Diff 4035 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:24 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:24 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation for real this time
Mar 20 2019, 2:22 PM · Journal
Harbormaster failed remote builds in B4756: Diff 4034 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:22 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:22 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Fix indentation
Mar 20 2019, 2:20 PM · Journal
ardumont updated the summary of D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 20 2019, 2:11 PM · Journal
Harbormaster failed remote builds in B4755: Diff 4033 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 20 2019, 2:08 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 20 2019, 2:08 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • README: Explain how to run tests
  • setup.py: Use a shell script to ease the kafka development setup
  • Makefile.local: Add a target to clean up cache artifacts
Mar 20 2019, 2:06 PM · Journal