Page MenuHomeSoftware Heritage
Feed Advanced Search

Jun 8 2020

ardumont added inline comments to D3238: origin-visit-add: Write origin-visit-status objects to the journal.
Jun 8 2020, 2:39 PM · Storage manager
ardumont updated the test plan for D3238: origin-visit-add: Write origin-visit-status objects to the journal.
Jun 8 2020, 2:38 PM · Storage manager
ardumont updated the test plan for D3238: origin-visit-add: Write origin-visit-status objects to the journal.
Jun 8 2020, 2:38 PM · Storage manager
ardumont added a revision to T2310: Make origin visits immutable: D3241: Allow journal to deal with origin_visit_status.
Jun 8 2020, 2:28 PM · Storage manager, Data Model
ardumont added a revision to T2310: Make origin visits immutable: D3238: origin-visit-add: Write origin-visit-status objects to the journal.
Jun 8 2020, 11:56 AM · Storage manager, Data Model

Jun 5 2020

ardumont closed D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 6:44 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 6:39 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Rebase on latest master

Jun 5 2020, 6:31 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 5:59 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.
  • pgstorage: Fix missing db, cur parameters in origin_get call
  • Rename origin to origin_url in origin existence check (3 implems)
Jun 5 2020, 5:49 PM · Storage manager
douardda accepted D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 5:37 PM · Storage manager
vlorentz accepted D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 4:48 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 4:48 PM · Storage manager
ardumont updated the summary of D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 4:41 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.
  • drop with-sanity-checks flag
  • check only origin existence
  • adapt commit message
  • adapt endpoint docstring accordingly
Jun 5 2020, 4:40 PM · Storage manager
ardumont added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Now (forgot to submit)...

Jun 5 2020, 3:39 PM · Storage manager
olasd added inline comments to D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 3:10 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 2:51 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Rework commit message

Jun 5 2020, 2:43 PM · Storage manager
ardumont updated the summary of D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 2:42 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 2:38 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 2:31 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Fix test name (a add_one name got left behind)

Jun 5 2020, 2:28 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Clarify docstring on new endpoint

Jun 5 2020, 2:24 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 5 2020, 2:18 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Adapt according to latest exchange with new signature:
origin_visit_status_add(Iterable[OriginVisitStatus, bool) -> None

Jun 5 2020, 2:11 PM · Storage manager
ardumont planned changes to D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 11:42 AM · Storage manager
ardumont retitled D3212: storage*: Add origin_visit_status_add endpoint from storage*: Add origin_visit_status_add_one endpoint to storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 11:42 AM · Storage manager
douardda added inline comments to D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 11:16 AM · Storage manager
vlorentz added inline comments to D3212: storage*: Add origin_visit_status_add endpoint.
Jun 5 2020, 10:57 AM · Storage manager

Jun 4 2020

swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 4 2020, 4:04 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Swap journal and backend add instructions order

Jun 4 2020, 3:56 PM · Storage manager
ardumont added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

You didn't address my comment about non-existing visits.

Jun 4 2020, 3:52 PM · Storage manager
vlorentz updated the task description for T2434: Add failure tests in swh-storage.
Jun 4 2020, 2:19 PM · Storage manager
vlorentz triaged T2434: Add failure tests in swh-storage as Normal priority.
Jun 4 2020, 2:17 PM · Storage manager
vlorentz added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

You didn't address my comment about non-existing visits.

Jun 4 2020, 2:13 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 4 2020, 1:21 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Drop unnecessary instruction for in-memory implementation

Jun 4 2020, 1:14 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 4 2020, 12:36 PM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build is green

Jun 4 2020, 12:29 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Fix typo

Jun 4 2020, 12:25 PM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Rebase on latest master

Jun 4 2020, 12:22 PM · Storage manager
Harbormaster failed remote builds in B12614: Diff 11411 for D3212: storage*: Add origin_visit_status_add endpoint!
Jun 4 2020, 9:51 AM · Storage manager
swh-public-ci added a comment to D3212: storage*: Add origin_visit_status_add endpoint.

Build has FAILED

Jun 4 2020, 9:51 AM · Storage manager
ardumont updated the diff for D3212: storage*: Add origin_visit_status_add endpoint.

Update endpoint interface docstring according to latest development

Jun 4 2020, 9:50 AM · Storage manager

Jun 3 2020

ardumont updated the summary of D3212: storage*: Add origin_visit_status_add endpoint.
Jun 3 2020, 5:58 PM · Storage manager
ardumont added inline comments to D3212: storage*: Add origin_visit_status_add endpoint.
Jun 3 2020, 5:54 PM · Storage manager
ardumont updated the summary of D3212: storage*: Add origin_visit_status_add endpoint.
Jun 3 2020, 5:53 PM · Storage manager
ardumont added a revision to T2310: Make origin visits immutable: D3212: storage*: Add origin_visit_status_add endpoint.
Jun 3 2020, 12:33 PM · Storage manager, Data Model

Jun 1 2020

ardumont updated the task description for T2310: Make origin visits immutable.
Jun 1 2020, 2:29 PM · Storage manager, Data Model

May 29 2020

ardumont changed the status of T2310: Make origin visits immutable from Open to Work in Progress.
May 29 2020, 12:40 PM · Storage manager, Data Model

May 28 2020

ardumont updated the task description for T2310: Make origin visits immutable.
May 28 2020, 5:19 PM · Storage manager, Data Model
ardumont added inline comments to D3180: pg: Write origin visit updates & status, read from origin_visit_status.
May 28 2020, 1:34 PM · Storage manager
ardumont closed D3180: pg: Write origin visit updates & status, read from origin_visit_status.
May 28 2020, 1:19 PM · Storage manager
swh-public-ci added a comment to D3180: pg: Write origin visit updates & status, read from origin_visit_status.

Build is green

May 28 2020, 1:14 PM · Storage manager
ardumont updated the diff for D3180: pg: Write origin visit updates & status, read from origin_visit_status.

Rebase on latest master

May 28 2020, 1:07 PM · Storage manager
ardumont updated the summary of D3180: pg: Write origin visit updates & status, read from origin_visit_status.
May 28 2020, 11:35 AM · Storage manager

May 27 2020

ardumont updated the task description for T2310: Make origin visits immutable.
May 27 2020, 4:19 PM · Storage manager, Data Model
ardumont added a revision to T2310: Make origin visits immutable: D3180: pg: Write origin visit updates & status, read from origin_visit_status.
May 27 2020, 2:20 PM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
May 27 2020, 1:35 PM · Storage manager, Data Model
ardumont added a comment to T2310: Make origin visits immutable.

That's been running since 15:30 or so.

May 27 2020, 11:59 AM · Storage manager, Data Model

May 25 2020

ardumont updated the task description for T2310: Make origin visits immutable.
May 25 2020, 8:18 PM · Storage manager, Data Model
ardumont added a comment to T2310: Make origin visits immutable.
  • migrate remaining data (data that did not get migrated during the first migration, while loaders continued their work)
May 25 2020, 7:10 PM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
May 25 2020, 7:09 PM · Storage manager, Data Model
ardumont updated the title for P664 T2310: 147-bis.sql ; 147-ter.sql from T2310: 147-bis.sql to T2310: 147-bis.sql ; 147-ter.sql.
May 25 2020, 4:03 PM · Storage manager
ardumont added a comment to P664 T2310: 147-bis.sql ; 147-ter.sql.
  • 147-ter.sql: Migrate the remaining data which were written during the initial migration
May 25 2020, 3:42 PM · Storage manager

May 20 2020

ardumont added a revision to T2075: Implement metadata authority specification: D3170: storage: Add not null constraints to metadata_authority/origin_metadata tables.
May 20 2020, 9:21 AM · Storage manager, Metadata workflow

May 19 2020

ardumont closed T2415: origin_metadata_add fails to write properly origin_metadata as Resolved.

Deployed.

May 19 2020, 6:51 PM · SWORD deposit, Storage manager
ardumont updated subscribers of T2415: origin_metadata_add fails to write properly origin_metadata.

In the end, that's the loader-deposit which sends the wrong data type when calling the endpoints...
@vlorentz has fixes in progress.

May 19 2020, 6:36 PM · SWORD deposit, Storage manager
ardumont triaged T2415: origin_metadata_add fails to write properly origin_metadata as Unbreak Now! priority.
May 19 2020, 5:41 PM · SWORD deposit, Storage manager

May 18 2020

ardumont edited P675 149-bis.sql.
May 18 2020, 4:15 PM · Storage manager
ardumont created P675 149-bis.sql.
May 18 2020, 4:12 PM · Storage manager
ardumont added a revision to T2075: Implement metadata authority specification: D3159: storage: metadata_provider: Ensure idempotency when creating provider.
May 18 2020, 1:40 PM · Storage manager, Metadata workflow

May 6 2020

ardumont updated the task description for T2310: Make origin visits immutable.
May 6 2020, 8:39 PM · Storage manager, Data Model
ardumont added a comment to T2310: Make origin visits immutable.
  • Deploy storage (and migrate data, this now can occur while loaders are running)
May 6 2020, 8:39 PM · Storage manager, Data Model
ardumont added a comment to P664 T2310: 147-bis.sql ; 147-ter.sql.

Related to T2310

May 6 2020, 4:19 PM · Storage manager
ardumont created P664 T2310: 147-bis.sql ; 147-ter.sql.
May 6 2020, 4:19 PM · Storage manager

May 4 2020

douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3119: Add skipped_content to the list of accepted objects.
May 4 2020, 5:37 PM · Object storage, Storage manager, Journal

May 1 2020

ardumont added a comment to T2310: Make origin visits immutable.

After further discussion, for testing purposes, we agreed on dumping and
restoring origins and origin-visits from production to staging. And try to
check what the behavior is (2).

May 1 2020, 9:41 AM · Storage manager, Data Model

Apr 30 2020

douardda closed T2355: Make swh-journal independent from swh-storage or swh-objstorage as Resolved.

Let's consider this is done now.

Apr 30 2020, 4:09 PM · Object storage, Storage manager, Journal
ardumont updated the task description for T2310: Make origin visits immutable.
Apr 30 2020, 2:48 PM · Storage manager, Data Model
ardumont added a comment to T2310: Make origin visits immutable.

In the mean time, I've started to work on 1. as i'm a bit uneasy about letting
master in a state we cannot really deploy yet. As there is some work nearly
ready to be deployed (new metadata api endpoints) and i don't want to prevent
its deployment.

Apr 30 2020, 1:58 PM · Storage manager, Data Model
ardumont closed D3080: pg-storage: Add new created state for origin-visit-state enum.
Apr 30 2020, 1:51 PM · Storage manager
swh-public-ci added a comment to D3080: pg-storage: Add new created state for origin-visit-state enum.

Build is green

Apr 30 2020, 1:50 PM · Storage manager
ardumont updated the diff for D3080: pg-storage: Add new created state for origin-visit-state enum.

Rebase

Apr 30 2020, 1:43 PM · Storage manager
ardumont added a revision to T2310: Make origin visits immutable: D3101: pg-storage: Adapt implem to write both origin visit updates and status.
Apr 30 2020, 12:03 PM · Storage manager, Data Model
ardumont created P656 t2310 irc discussion.
Apr 30 2020, 12:02 PM · Storage manager
ardumont added a comment to T2310: Make origin visits immutable.

Status on this.

Apr 30 2020, 11:31 AM · Storage manager, Data Model

Apr 29 2020

douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3087: Remove the content replayer code.
Apr 29 2020, 1:47 PM · Object storage, Storage manager, Journal
vlorentz accepted D3080: pg-storage: Add new created state for origin-visit-state enum.
Apr 29 2020, 12:41 PM · Storage manager
ardumont retitled D3080: pg-storage: Add new created state for origin-visit-state enum from pg-storage: Add new created state to pg-storage: Add new created state for origin-visit-state enum.
Apr 29 2020, 12:16 PM · Storage manager
ardumont added a revision to T2310: Make origin visits immutable: D3080: pg-storage: Add new created state for origin-visit-state enum.
Apr 29 2020, 12:10 PM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Apr 29 2020, 11:27 AM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Apr 29 2020, 11:26 AM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Apr 29 2020, 11:24 AM · Storage manager, Data Model
ardumont updated the task description for T2310: Make origin visits immutable.
Apr 29 2020, 10:47 AM · Storage manager, Data Model

Apr 28 2020

ardumont updated the task description for T2310: Make origin visits immutable.
Apr 28 2020, 6:00 PM · Storage manager, Data Model
ardumont closed T2346: Decide on the semantics of origin-visit status(es) as Resolved.

We are going with 1.

Apr 28 2020, 3:22 PM · Storage manager, Data Model
ardumont closed T2346: Decide on the semantics of origin-visit status(es), a subtask of T2310: Make origin visits immutable, as Resolved.
Apr 28 2020, 3:22 PM · Storage manager, Data Model
ardumont renamed T2346: Decide on the semantics of origin-visit status(es) from Decide on the semantics of origin-visit updates to Decide on the semantics of origin-visit status(es).
Apr 28 2020, 3:21 PM · Storage manager, Data Model