Page MenuHomeSoftware Heritage

System administratorsGroup
ActivePublic

Recent Activity

Jun 24 2021

vlorentz removed a project from T3266: Improve save code now failed/uneventful status reporting: meta-task.
Jun 24 2021, 2:36 PM · Save Code Now, Roadmap 2021, System administrators, Web app

Jun 7 2021

douardda added a project to T3252: Better handling of erroneous origins submitted to save code now: Save Code Now.
Jun 7 2021, 10:34 AM · System administration, Save Code Now, Web app

May 12 2021

ardumont added a revision to T3325: Vagrantify puppet master: D5741: Vagrantfile: Adapt pergamon configuration.
May 12 2021, 7:09 PM · System administration
ardumont updated the task description for T3325: Vagrantify puppet master.
May 12 2021, 12:25 PM · System administration
vsellier changed the status of T3325: Vagrantify puppet master from Open to Work in Progress.
May 12 2021, 12:24 PM · System administration

May 10 2021

vsellier closed T3223: Elasticsearch: Monitor the max opened shards on a cluster as Resolved.

Theses errors will be caught by the alert created in T3222

May 10 2021, 3:03 PM · System administrators
vsellier closed T3223: Elasticsearch: Monitor the max opened shards on a cluster, a subtask of T3219: No logs are ingested on elasticsearch since 2021-03-26, as Resolved.
May 10 2021, 3:03 PM · System administrators
vsellier closed T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested, a subtask of T3219: No logs are ingested on elasticsearch since 2021-03-26, as Resolved.
May 10 2021, 3:00 PM · System administrators
anlambert closed T3272: Authenticated users should be able to browse their save code now requests, a subtask of T3082: Improve Save Code Now handling, as Resolved.
May 10 2021, 11:19 AM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app

May 8 2021

rdicosmo moved T3082: Improve Save Code Now handling from Backlog to Work in progress on the Roadmap 2021 board.
May 8 2021, 11:12 AM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app

May 3 2021

anlambert changed the status of T3272: Authenticated users should be able to browse their save code now requests, a subtask of T3082: Improve Save Code Now handling, from Open to Work in Progress.
May 3 2021, 2:09 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app

Apr 27 2021

vlorentz removed a project from T3252: Better handling of erroneous origins submitted to save code now: Roadmap 2021.
Apr 27 2021, 2:14 PM · System administration, Save Code Now, Web app

Apr 23 2021

vlorentz assigned T3082: Improve Save Code Now handling to ardumont.
Apr 23 2021, 4:48 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
vsellier changed the status of T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested, a subtask of T3219: No logs are ingested on elasticsearch since 2021-03-26, from Open to Work in Progress.
Apr 23 2021, 4:10 PM · System administrators

Apr 22 2021

ardumont moved T3266: Improve save code now failed/uneventful status reporting from Pending validation to Done on the Roadmap 2021 board.
Apr 22 2021, 4:21 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont closed T3266: Improve save code now failed/uneventful status reporting, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Apr 22 2021, 4:21 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont closed T3266: Improve save code now failed/uneventful status reporting as Resolved.

Deployed.

Apr 22 2021, 4:20 PM · Save Code Now, Roadmap 2021, System administrators, Web app
anlambert added a revision to T3266: Improve save code now failed/uneventful status reporting: D5575: tests/api/origin_save: Explicitely populate SaveAuthorizedOrigin table.
Apr 22 2021, 3:32 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

Trying to bisect the issue and failed (multiple dimensions got the best of me, master ok, debian build in stable ko... i need to improve my tooling there).

Apr 22 2021, 12:37 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

So, the debian/unstable broke which is fixed now [1] (it wasd missing one new deps to
test the migration part).

Apr 22 2021, 10:19 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont moved T3266: Improve save code now failed/uneventful status reporting from Backlog to Pending validation on the Roadmap 2021 board.
Apr 22 2021, 9:20 AM · Save Code Now, Roadmap 2021, System administrators, Web app

Apr 21 2021

ardumont changed the status of T3266: Improve save code now failed/uneventful status reporting, a subtask of T3082: Improve Save Code Now handling, from Open to Work in Progress.
Apr 21 2021, 7:08 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont changed the status of T3266: Improve save code now failed/uneventful status reporting from Open to Work in Progress.
Apr 21 2021, 7:08 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

Landed. Remains to deploy. I'll attend to that tomorrow.

Apr 21 2021, 7:08 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont closed T2117: Save Code Now: End to End monitoring, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Apr 21 2021, 6:57 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 21 2021, 6:42 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5570: Display visit status information in the save request information.
Apr 21 2021, 3:27 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5569: Populate the visit status value in save code now request.
Apr 21 2021, 2:02 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont claimed T3266: Improve save code now failed/uneventful status reporting.
Apr 21 2021, 10:17 AM · Save Code Now, Roadmap 2021, System administrators, Web app

Apr 20 2021

ardumont added a project to T3082: Improve Save Code Now handling: Save Code Now.
Apr 20 2021, 4:42 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app

Apr 19 2021

ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5555: Add visit_status to SaveOriginRequest model.
Apr 19 2021, 6:27 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a comment to T3266: Improve save code now failed/uneventful status reporting.

It'd be best if we distinguish directly from the listing view such details.

Apr 19 2021, 6:19 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 19 2021, 6:17 PM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont added a revision to T3266: Improve save code now failed/uneventful status reporting: D5554: origin_save: Add docstring and some test scenarios.
Apr 19 2021, 6:00 PM · Save Code Now, Roadmap 2021, System administrators, Web app
anlambert added a comment to T3252: Better handling of erroneous origins submitted to save code now.
In T3252#63315, @zack wrote:

Oh, and now that we have user profile pages, we should have a list of "my" save code now requests with their status visible in the user profile, for those who want to check synchronously the status of their requests (and might have disabled email notifications).

+1, great idea !

Apr 19 2021, 12:02 PM · System administration, Save Code Now, Web app
anlambert added a subtask for T3082: Improve Save Code Now handling: T1226: Save code now email notification for submitter.
Apr 19 2021, 11:43 AM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app
ardumont updated the task description for T3266: Improve save code now failed/uneventful status reporting.
Apr 19 2021, 9:56 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont renamed T3266: Improve save code now failed/uneventful status reporting from Cannot distinguish failed visits from uneventful one to Improve save code now failed/uneventful status reporting.
Apr 19 2021, 9:53 AM · Save Code Now, Roadmap 2021, System administrators, Web app
ardumont triaged T3266: Improve save code now failed/uneventful status reporting as Normal priority.
Apr 19 2021, 9:42 AM · Save Code Now, Roadmap 2021, System administrators, Web app

Apr 16 2021

ardumont added a comment to T3252: Better handling of erroneous origins submitted to save code now.

yes, great ;)

Apr 16 2021, 3:32 PM · System administration, Save Code Now, Web app
zack added a comment to T3252: Better handling of erroneous origins submitted to save code now.

@rdicosmo great summary, I'm certainly on that page :)

Apr 16 2021, 3:30 PM · System administration, Save Code Now, Web app
rdicosmo added a comment to T3252: Better handling of erroneous origins submitted to save code now.

Thanks to all of you for this dicussion and proposals.

Apr 16 2021, 1:39 PM · System administration, Save Code Now, Web app
zack added a comment to T3252: Better handling of erroneous origins submitted to save code now.

thanks !

Apr 16 2021, 1:15 PM · System administration, Save Code Now, Web app
ardumont closed T3221: elk: automatically limit log retention, a subtask of T3219: No logs are ingested on elasticsearch since 2021-03-26, as Resolved.
Apr 16 2021, 12:34 PM · System administrators
anlambert added a comment to T3252: Better handling of erroneous origins submitted to save code now.

+1, can you create a task about it ? This could be handled by a GSOC student who chooses to
work on the webapp.

sure done respectively T3256 then T3257.

Apr 16 2021, 11:54 AM · System administration, Save Code Now, Web app
ardumont added a comment to T3252: Better handling of erroneous origins submitted to save code now.

+1, can you create a task about it ? This could be handled by a GSOC student who chooses to
work on the webapp.

Apr 16 2021, 11:53 AM · System administration, Save Code Now, Web app
anlambert added a comment to T3252: Better handling of erroneous origins submitted to save code now.
In T3252#63374, @zack wrote:

but adding an email field (auto filled for registered users) to send a notification after the origin was loaded seems a good tradeoff. To implement the email notification, we will have to add a journal client in swh-web processing origin visit messages.

Adding an email field is a poor UX solution (it needs to be reentered every time or saved in a cookie) which we used for the vault at the time because we didn't have user registration.
Now that we have user registration we can just tell users that if they want to be notified, they should login. (Which is indeed something independent from requiring user registration for being able to submit.) That will encourage users to register to have added-value functionalitlies, like notifications.
And then we should go back to all places that could use notifications (vault, save code now, deposit, "save again" button) and uniform things.

Apr 16 2021, 11:48 AM · System administration, Save Code Now, Web app
zack added a comment to T3252: Better handling of erroneous origins submitted to save code now.

but adding an email field (auto filled for registered users) to send a notification after the origin was loaded seems a good tradeoff. To implement the email notification, we will have to add a journal client in swh-web processing origin visit messages.

Apr 16 2021, 11:43 AM · System administration, Save Code Now, Web app
anlambert added a comment to T3252: Better handling of erroneous origins submitted to save code now.

As a first step towards giving more feedback for users who submitted wrong origins for
ingestion (e.g. organization links, tarballs with wrong visit type, link to html page
probably for listing, etc...). We could allow the operator which rejects the origins a
free form input field so they could explain the reason of the rejection. It'd be less
brutal a rejection.

This does not require the user registration part discussed above nor does it exclude it.

Bonus point for this, it's an easy hack ;)

As an incremental step after that, we could make that a configurable predefined template
selection box of rejecting reasons as I don't think there are so many different reasons
after all (unsupported for now, not an origin of type <type>, not a repository link,
...). Drawing stats from the first implementation could help in designing the initial
templates of rejection.

Which could be another easy hack once the first part is done (if we want).

As suggested to @anlambert recently (@antoine, given it a bit more thought and added the
second incremental part since then thus the ping ;)

Apr 16 2021, 11:13 AM · System administration, Save Code Now, Web app
anlambert added a comment to T3252: Better handling of erroneous origins submitted to save code now.
In T3252#63315, @zack wrote:

Oh, and now that we have user profile pages, we should have a list of "my" save code now requests with their status visible in the user profile, for those who want to check synchronously the status of their requests (and might have disabled email notifications).

Apr 16 2021, 11:11 AM · System administration, Save Code Now, Web app