Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 11 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/144/ for more details.

Apr 11 2019, 6:33 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation (missing one blank line)

Apr 11 2019, 6:29 PM · Storage manager, Journal
Harbormaster failed remote builds in B5345: Diff 4537 for D1345: swh.journal: Add backfiller implementation!
Apr 11 2019, 6:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 11 2019, 6:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 11 2019, 6:26 PM · Storage manager, Journal
ardumont updated subscribers of D1345: swh.journal: Add backfiller implementation.
Apr 11 2019, 10:00 AM · Storage manager, Journal

Apr 9 2019

Harbormaster failed remote builds in B5285: Diff 4477 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:07 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:07 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Use the right logging instruction
  • backfill: Fix logging statement
Apr 9 2019, 6:04 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 6:02 PM · Storage manager, Journal
Harbormaster failed remote builds in B5283: Diff 4475 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:01 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 6:01 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 6:00 PM · Storage manager, Journal
Harbormaster failed remote builds in B5282: Diff 4474 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 6:00 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Improve module docstrings
  • backfill: Flush when data is sent
  • backfill: Define a _compute_shit_bits function to reuse code
Apr 9 2019, 5:59 PM · Storage manager, Journal
ardumont added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 5:46 PM · Storage manager, Journal
anlambert added inline comments to D1345: swh.journal: Add backfiller implementation.
Apr 9 2019, 4:48 PM · Storage manager, Journal
Harbormaster failed remote builds in B5238: Diff 4430 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 4:26 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 4:26 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • Remove publisher notion
Apr 9 2019, 4:22 PM · Storage manager, Journal
vlorentz triaged T1633: skipped_content_missing is not implemented by the in-memory storage as Low priority.
Apr 9 2019, 3:57 PM · Easy hack, Storage manager
Harbormaster failed remote builds in B5219: Diff 4412 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:30 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:30 PM · Storage manager, Journal
Harbormaster failed remote builds in B5218: Diff 4411 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:27 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:27 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

oops, the rebase should have been on cleanup-publisher branch

Apr 9 2019, 12:22 PM · Storage manager, Journal
Harbormaster failed remote builds in B5215: Diff 4409 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 12:22 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on master

Apr 9 2019, 12:22 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on cleanup_publisher branch

Apr 9 2019, 12:19 PM · Storage manager, Journal
ardumont added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 12:03 PM · Storage manager, Journal
Harbormaster failed remote builds in B5210: Diff 4402 for D1345: swh.journal: Add backfiller implementation!
Apr 9 2019, 11:57 AM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 9 2019, 11:57 AM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Rebase on latest master

Apr 9 2019, 11:54 AM · Storage manager, Journal

Apr 8 2019

swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/124/ for more details.

Apr 8 2019, 3:58 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/123/ for more details.

Apr 8 2019, 3:55 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Make partition key a singleton
Apr 8 2019, 3:54 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.
  • backfill: Fix origin_visit support to use the right format
  • backfill: Flush the messages to the journal when done with the batch
Apr 8 2019, 3:52 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DJNL/job/tox/122/ for more details.

Apr 8 2019, 3:19 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Fix pep8 violation

Apr 8 2019, 3:16 PM · Storage manager, Journal
Harbormaster failed remote builds in B5193: Diff 4387 for D1345: swh.journal: Add backfiller implementation!
Apr 8 2019, 3:12 PM · Storage manager, Journal
swh-public-ci added a comment to D1345: swh.journal: Add backfiller implementation.

Build has FAILED

Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the summary of D1345: swh.journal: Add backfiller implementation.
Apr 8 2019, 3:12 PM · Storage manager, Journal
ardumont updated the diff for D1345: swh.journal: Add backfiller implementation.

Add support for snapshot and directory

Apr 8 2019, 3:12 PM · Storage manager, Journal
vlorentz added a revision to T1377: in-memory storage: compute all counters: D1362: in-memory storage: compute missing counters.
Apr 8 2019, 11:25 AM · Easy hack, Storage manager

Apr 6 2019

ardumont added projects to D1345: swh.journal: Add backfiller implementation: Journal, Storage manager.
Apr 6 2019, 12:01 AM · Storage manager, Journal

Apr 4 2019

olasd updated the task description for T1624: Normalize data sent from clients to the storage.
Apr 4 2019, 12:31 PM · Storage manager, Journal
olasd triaged T1624: Normalize data sent from clients to the storage as Normal priority.
Apr 4 2019, 12:31 PM · Storage manager, Journal

Apr 3 2019

ardumont closed D1321: swh-storage: Install counter metrics.
Apr 3 2019, 11:11 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/287/ for more details.

Apr 3 2019, 11:10 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.

Merge on master

Apr 3 2019, 11:05 PM · Storage manager
olasd accepted D1321: swh-storage: Install counter metrics.
Apr 3 2019, 10:12 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/286/ for more details.

Apr 3 2019, 6:04 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.

Fix indentation

Apr 3 2019, 5:59 PM · Storage manager
Harbormaster failed remote builds in B5054: Diff 4287 for D1321: swh-storage: Install counter metrics!
Apr 3 2019, 5:56 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build has FAILED

Apr 3 2019, 5:55 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.
  • api.server: Add tests around send_metric function
Apr 3 2019, 5:55 PM · Storage manager
Harbormaster failed remote builds in B5052: Diff 4285 for D1321: swh-storage: Install counter metrics!
Apr 3 2019, 4:37 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build has FAILED

Apr 3 2019, 4:37 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.
  • api.server: Make send_metric be in charge of the metric parsing
  • api.server: Start adding test (incomplete)
Apr 3 2019, 4:36 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/283/ for more details.

Apr 3 2019, 3:56 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.
  • api.server: Rename constant
  • api.server: Rename send_metric as we really send only 1 metric
  • api.server: Use constants for all metrics
Apr 3 2019, 3:51 PM · Storage manager
ardumont added a comment to D1321: swh-storage: Install counter metrics.

...
So the calls would end up looking like:
send_metric(metric='origin:add', count=len(origins), method_name='origin_add')

Apr 3 2019, 3:50 PM · Storage manager
ardumont added a comment to D1321: swh-storage: Install counter metrics.

If we're making metric names constants, this should happen for all of them so that they are defined in the same place.
... fill the pattern when using the metric which uses the unit.

Apr 3 2019, 3:48 PM · Storage manager
olasd requested changes to D1321: swh-storage: Install counter metrics.

If we're making metric names constants, this should happen for all of them so that they are defined in the same place.

Apr 3 2019, 3:30 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/282/ for more details.

Apr 3 2019, 3:13 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.

Rebase on latest master

Apr 3 2019, 3:07 PM · Storage manager
ardumont added a comment to D1321: swh-storage: Install counter metrics.

Heads up, will need to be rebased on D1329 when it lands.
This will need adaptation for the snapshot_add endpoints will take a list of snapshots as input (instead of 1).

Apr 3 2019, 12:16 PM · Storage manager
swh-public-ci added a comment to D1321: swh-storage: Install counter metrics.

Build is green
See https://jenkins.softwareheritage.org/job/DSTO/job/tox/279/ for more details.

Apr 3 2019, 12:13 PM · Storage manager
ardumont updated the diff for D1321: swh-storage: Install counter metrics.

Adapt according to olasd's review:

  • api.server: Include the encoding step when timing
  • api.server: Rename to process_metrics function name
  • api.server.process_metrics: Skip processing when value is 0
  • server.api: Fix metric names respecting prometheus conventions [1]
Apr 3 2019, 12:07 PM · Storage manager
ardumont added inline comments to D1321: swh-storage: Install counter metrics.
Apr 3 2019, 12:05 PM · Storage manager

Apr 2 2019

olasd requested changes to D1321: swh-storage: Install counter metrics.

Looks good, thanks! Just a few more changes and this should be all good to merge.

Apr 2 2019, 11:42 PM · Storage manager
ardumont added a project to D1321: swh-storage: Install counter metrics: Storage manager.
Apr 2 2019, 11:24 PM · Storage manager
anlambert triaged T1617: Experiment with generation numbers to improve revisions walk performance as Normal priority.
Apr 2 2019, 11:50 AM · Storage manager

Mar 31 2019

vlorentz removed a project from T1446: Add support for slices in Storage.content_get: Easy hack.
Mar 31 2019, 9:13 AM · Storage manager

Mar 24 2019

faux added a revision to T1349: Storage.content_find should return all matches, not just one.: D1288: Storage.content_find returns list instead of single value.
Mar 24 2019, 6:10 PM · Easy hack, Storage manager

Mar 12 2019

douardda closed T454: object storage backend that can read from/write to S3 as Resolved.

Unless I'm wrong, this task can be closed now. There is a libcloud-based backend.

Mar 12 2019, 9:48 AM · Storage manager

Mar 11 2019

zack added a comment to T1349: Storage.content_find should return all matches, not just one..

Contact information are available on our GSoC wiki page (which is in turn linked from the GSoC portal).

Mar 11 2019, 5:57 PM · Easy hack, Storage manager
Sowmya added a comment to T1349: Storage.content_find should return all matches, not just one..

Ok sir thank you so much. Also can you please provide information regarding how to contact the mentors regarding the mentioned GSOC projects ?

Mar 11 2019, 5:56 PM · Easy hack, Storage manager

Mar 9 2019

zack added a comment to T1349: Storage.content_find should return all matches, not just one..
In T1349#29267, @Sowmya wrote:

can I get this task assigned by the administrator?

Mar 9 2019, 7:47 AM · Easy hack, Storage manager
Sowmya added a comment to T1349: Storage.content_find should return all matches, not just one..

can I get this task assigned by the administrator?

Mar 9 2019, 4:08 AM · Easy hack, Storage manager

Feb 27 2019

vlorentz added a project to T1349: Storage.content_find should return all matches, not just one.: Easy hack.
Feb 27 2019, 9:28 PM · Easy hack, Storage manager

Feb 26 2019

anlambert closed T1307: Remove mock storages used in tests. as Resolved.

Closing this as T1271 is now resolved.

Feb 26 2019, 7:02 PM · Storage manager
anlambert updated the task description for T1307: Remove mock storages used in tests..
Feb 26 2019, 7:01 PM · Storage manager
anlambert closed T1271: Use the in-memory storage instead of mocks to test the webapp, a subtask of T1307: Remove mock storages used in tests., as Resolved.
Feb 26 2019, 7:00 PM · Storage manager

Feb 25 2019

ardumont closed T1533: Make sure api server uses explicit configurations as Resolved.
Feb 25 2019, 12:15 PM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault
ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 25 2019, 12:15 PM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault

Feb 23 2019

ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 23 2019, 1:58 AM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault
ardumont added a project to T1533: Make sure api server uses explicit configurations: Scheduling utilities.
Feb 23 2019, 12:43 AM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault
ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 23 2019, 12:42 AM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault

Feb 22 2019

ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 22 2019, 11:22 AM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault

Feb 21 2019

ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 21 2019, 8:34 PM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault
ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 21 2019, 2:11 PM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault

Feb 20 2019

ardumont updated the task description for T1533: Make sure api server uses explicit configurations.
Feb 20 2019, 7:11 PM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault
vlorentz closed T1495: Move swh.storage.db.BaseDb class in swh.core as Resolved.
Feb 20 2019, 11:45 AM · Storage manager, Core & foundations

Feb 19 2019

vlorentz closed T1507: Investigate CPU usage of swh-storage on storage0.euwest.azure as Resolved.
Feb 19 2019, 2:54 PM · Storage manager
ardumont renamed T1533: Make sure api server uses explicit configurations from Use explicit configuration for all modules to Make sure api server uses explicit configurations.
Feb 19 2019, 11:36 AM · Scheduling utilities, Web app, SWORD deposit, Object storage, Storage manager, Vault

Feb 14 2019

vlorentz triaged T1527: Have comments on all columns of all databases as Normal priority.
Feb 14 2019, 11:08 AM · Easy hack, Documentation, Storage manager, Scheduling utilities, Indexer