Page MenuHomeSoftware Heritage
Feed Advanced Search

Jul 3 2019

ardumont closed D1683: swh-indexer-journal-client: Adapt systemd and configuration according to latest version.
Jul 3 2019, 6:09 PM · Journal, Indexer
ardumont updated the diff for D1683: swh-indexer-journal-client: Adapt systemd and configuration according to latest version.
  • swh-indexer-journal-client: Update cli to latest version
  • swh-indexer-journal-client: Fix configuration change
Jul 3 2019, 6:09 PM · Journal, Indexer
vlorentz accepted D1683: swh-indexer-journal-client: Adapt systemd and configuration according to latest version.
Jul 3 2019, 4:44 PM · Journal, Indexer
ardumont retitled D1683: swh-indexer-journal-client: Adapt systemd and configuration according to latest version from swh-indexer-journal-client: Adapt configuration to swh-indexer-journal-client: Adapt systemd and configuration according to latest version.
Jul 3 2019, 4:38 PM · Journal, Indexer
ardumont added projects to D1683: swh-indexer-journal-client: Adapt systemd and configuration according to latest version: Indexer, Journal.
Jul 3 2019, 4:34 PM · Journal, Indexer
ardumont placed T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage up for grabs.
Jul 3 2019, 3:26 PM · Journal
ardumont placed T1278: swh-journal: the monitoring tool question! up for grabs.
Jul 3 2019, 3:26 PM · Journal
ardumont placed T1279: swh-journal: The schema migration problem up for grabs.
Jul 3 2019, 3:26 PM · Journal
ardumont closed D1678: Stop using the 'hidden' click option.
Jul 3 2019, 10:26 AM · Journal
swh-public-ci added a comment to D1678: Stop using the 'hidden' click option.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/176/ for more details.

Jul 3 2019, 10:23 AM · Journal
ardumont updated the diff for D1678: Stop using the 'hidden' click option.

Update help message to add deprecated notice (as reasonably proposed)

Jul 3 2019, 10:19 AM · Journal
douardda added a comment to D1678: Stop using the 'hidden' click option.

Maybe modify help messages the way vlorentz did in D1674

Jul 3 2019, 10:04 AM · Journal
douardda accepted D1678: Stop using the 'hidden' click option.
Jul 3 2019, 10:04 AM · Journal

Jul 2 2019

swh-public-ci added a comment to D1678: Stop using the 'hidden' click option.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/174/ for more details.

Jul 2 2019, 7:15 PM · Journal
ardumont added a project to D1678: Stop using the 'hidden' click option: Journal.
Jul 2 2019, 7:13 PM · Journal

Jun 28 2019

douardda added a comment to T1828: Improve directory journal backfill performance.

1 month is good enough. Let's stick to this.

Jun 28 2019, 10:13 AM · Mirror, Journal

Jun 25 2019

olasd changed the status of T1828: Improve directory journal backfill performance from Open to Work in Progress.

With 16 processes in parallel still, adding more CPUs gives an ETA of ~1 month, which stays pretty bad.

Jun 25 2019, 6:31 PM · Mirror, Journal
olasd added a comment to T1828: Improve directory journal backfill performance.

Running the directory backfiller (single instance) against belvedere yields an ETA of 250 days, which is around a 3x speedup from somerset.

Jun 25 2019, 2:54 PM · Mirror, Journal
douardda added a comment to T1828: Improve directory journal backfill performance.

have we now any insight on the behavior of the backfiller against belvedere?

Jun 25 2019, 9:27 AM · Mirror, Journal
douardda added a comment to T1827: Tweak content backfill order to help content replayer.

I'm enclined to prefer option 2, since performance is an issue we cannot underestimate...

Jun 25 2019, 9:25 AM · Mirror, Journal

Jun 18 2019

olasd triaged T1828: Improve directory journal backfill performance as High priority.
Jun 18 2019, 3:57 PM · Mirror, Journal
olasd triaged T1827: Tweak content backfill order to help content replayer as High priority.
Jun 18 2019, 3:44 PM · Mirror, Journal

Apr 29 2019

vlorentz closed T1541: journal publisher may crash on HTTP timeouts as Wontfix.

Closing because we removed the journal publisher. (My first WONTFIX <3)

Apr 29 2019, 2:26 PM · Journal

Apr 12 2019

ardumont retitled D1345: swh.journal: Add backfiller implementation from swh.journal: Bootstrap backfiller to swh.journal: Add backfiller implementation.
Apr 12 2019, 3:50 PM · Storage manager, Journal
ardumont closed T1603: kafka storage backfiller as Resolved.

Closed by D1345

Apr 12 2019, 3:50 PM · Journal, Sprint 2019 03
ardumont closed D1345: swh.journal: Add backfiller implementation.
Apr 12 2019, 2:21 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/145/ for more details.

Apr 12 2019, 2:14 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase to latest master and branch diff to master

Apr 12 2019, 2:10 PM · Storage manager, Journal
olasd accepted D1345: swh.journal: Add backfiller implementation.
Apr 12 2019, 2:08 PM · Storage manager, Journal
vlorentz closed T1628: replayer: non reliability when fetching items from kafka as Resolved.
Apr 12 2019, 10:01 AM · Journal

Apr 11 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/144/ for more details.

Apr 11 2019, 6:33 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation (missing one blank line)

Apr 11 2019, 6:29 PM · Storage manager, Journal
Harbormaster failed remote builds in B5345: Diff 4537 for D1345: swh.journal: Add backfiller implementation!
Apr 11 2019, 6:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 11 2019, 6:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 11 2019, 6:26 PM · Storage manager, Journal
ardumont updated subscribers of D1345: swh.journal: Add backfiller implementation.
Apr 11 2019, 10:00 AM · Storage manager, Journal

Apr 10 2019

vlorentz added a revision to T1628: replayer: non reliability when fetching items from kafka: D1390: Make the replayer commit *after* adding objects to the replica..
Apr 10 2019, 11:41 AM · Journal
vlorentz moved T1603: kafka storage backfiller from Backlog to in progress on the Sprint 2019 03 board.
Apr 10 2019, 10:50 AM · Journal, Sprint 2019 03

Apr 9 2019

Harbormaster failed remote builds in B5285: Diff 4477 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:07 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Use the right logging instruction
  • backfill: Fix logging statement
Apr 9 2019, 6:04 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:02 PM · Storage manager, Journal
Harbormaster failed remote builds in B5283: Diff 4475 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:01 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:00 PM · Storage manager, Journal
Harbormaster failed remote builds in B5282: Diff 4474 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:00 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Improve module docstrings
  • backfill: Flush when data is sent
  • backfill: Define a _compute_shit_bits function to reuse code
Apr 9 2019, 5:59 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 5:46 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 4:48 PM · Storage manager, Journal
Harbormaster failed remote builds in B5238: Diff 4430 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 4:26 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 4:26 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • Remove publisher notion
Apr 9 2019, 4:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5219: Diff 4412 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:30 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:30 PM · Storage manager, Journal
Harbormaster failed remote builds in B5218: Diff 4411 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

oops, the rebase should have been on cleanup-publisher branch

Apr 9 2019, 12:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5215: Diff 4409 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:22 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on master

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on cleanup_publisher branch

Apr 9 2019, 12:19 PM · Storage manager, Journal
ardumont added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:03 PM · Storage manager, Journal
Harbormaster failed remote builds in B5210: Diff 4402 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 11:57 AM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 11:57 AM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 11:54 AM · Storage manager, Journal
zack triaged T1628: replayer: non reliability when fetching items from kafka as Normal priority.
Apr 9 2019, 9:59 AM · Journal

Apr 8 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/124/ for more details.

Apr 8 2019, 3:58 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/123/ for more details.

Apr 8 2019, 3:55 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Make partition key a singleton
Apr 8 2019, 3:54 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Fix origin_visit support to use the right format
  • backfill: Flush the messages to the journal when done with the batch
Apr 8 2019, 3:52 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/122/ for more details.

Apr 8 2019, 3:19 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation

Apr 8 2019, 3:16 PM · Storage manager, Journal
Harbormaster failed remote builds in B5193: Diff 4387 for D1345: swh.journal: Add backfiller implementation!
Apr 8 2019, 3:12 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the summary of D1345: swh.journal: Add backfiller implementation.
Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Add support for snapshot and directory

Apr 8 2019, 3:12 PM · Storage manager, Journal

Apr 6 2019

ardumont added projects to D1345: swh.journal: Add backfiller implementation: Journal, Storage manager.
Apr 6 2019, 12:01 AM · Storage manager, Journal

Apr 4 2019

olasd updated the task description for T1624: Normalize data sent from clients to the storage.
Apr 4 2019, 12:31 PM · Storage manager, Journal
olasd triaged T1624: Normalize data sent from clients to the storage as Normal priority.
Apr 4 2019, 12:31 PM · Storage manager, Journal

Apr 2 2019

zack added a project to T1603: kafka storage backfiller: Journal.
Apr 2 2019, 2:44 PM · Journal, Sprint 2019 03
ardumont closed T1276: swh-journal: Add tests as Resolved.
Apr 2 2019, 12:12 PM · Continuous Integration, Journal
ardumont closed T1276: swh-journal: Add tests, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, as Resolved.
Apr 2 2019, 12:12 PM · Journal

Mar 25 2019

ardumont closed D1239: swh-journal: Add tests to the journal publisher using kafka instance.
Mar 25 2019, 3:53 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/63/ for more details.

Mar 25 2019, 3:51 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • tests: Inline the kafka_consumer pytest fixture
  • tests: Simplify initialization test to use fixtures consistently
Mar 25 2019, 3:50 PM · Journal
Harbormaster failed remote builds in B4784: Diff 4075 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 25 2019, 11:35 AM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 25 2019, 11:35 AM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Rework commit messages

Mar 25 2019, 11:33 AM · Journal

Mar 22 2019

swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/61/ for more details.

Mar 22 2019, 4:16 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • test_publisher_kafka: Rename test_publisher to make a nicer/smaller diff
Mar 22 2019, 4:14 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/60/ for more details.

Mar 22 2019, 4:13 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.
  • bin/install-kafka.sh: Regroup variables together
Mar 22 2019, 4:11 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/59/ for more details.

Mar 22 2019, 4:05 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 4:02 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/57/ for more details.

Mar 22 2019, 3:58 PM · Journal
Harbormaster failed remote builds in B4770: Diff 4051 for D1239: swh-journal: Add tests to the journal publisher using kafka instance!
Mar 22 2019, 3:55 PM · Journal
swh-public-ci added a comment to D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Build has FAILED

Mar 22 2019, 3:55 PM · Journal
ardumont updated the diff for D1239: swh-journal: Add tests to the journal publisher using kafka instance.

Fix pep8 violation

Mar 22 2019, 3:53 PM · Journal