Page MenuHomeSoftware Heritage
Feed Advanced Search

Feb 15 2022

moranegg removed a parent task for T3375: Add column 'client' in moderation view: T3173: Provide access to deposit-clients to view dedicated moderation page.
Feb 15 2022, 3:19 PM · Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T2344: Build a connector for software deposit via Zenodo/InvenioRDM.
Feb 15 2022, 3:19 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T3177: Add deposit guides links to the deposit page https://deposit.softwareheritage.org/.
Feb 15 2022, 3:17 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T3176: Add query box on deposit origin on https://deposit.softwareheritage.org/.
Feb 15 2022, 3:17 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg added a parent task for T3375: Add column 'client' in moderation view: T3680: Modify deposit admin view to better reflect metadata-only deposits.
Feb 15 2022, 3:10 PM · Monitoring, SWORD deposit, Web app
moranegg moved T3173: Provide access to deposit-clients to view dedicated moderation page from Backlog to Deployed on the SWORD deposit board.
Feb 15 2022, 10:16 AM · Monitoring, SWORD deposit, Web app

Feb 3 2022

ardumont closed T3174: Filter deposit-admin view by deposit client on admin (moderation) page, a subtask of T3128: Improve deposit integration, management and display, as Resolved.
Feb 3 2022, 9:28 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
ardumont closed T3174: Filter deposit-admin view by deposit client on admin (moderation) page as Resolved.
Feb 3 2022, 9:28 AM · Monitoring, SWORD deposit, Web app
ardumont added a comment to T3174: Filter deposit-admin view by deposit client on admin (moderation) page.

I think so, yes.

Feb 3 2022, 9:27 AM · Monitoring, SWORD deposit, Web app

Feb 2 2022

moranegg added a comment to T3174: Filter deposit-admin view by deposit client on admin (moderation) page.

I think we can resolve this.
What do you think @ardumont ?

Feb 2 2022, 7:38 PM · Monitoring, SWORD deposit, Web app

Jan 12 2022

vsellier added a revision to T3129: Reliable monitoring of services: for users and for admins : D6926: First iteration of prometheus export of the e2e metrics.
Jan 12 2022, 3:07 PM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

Jan 10 2022

ardumont updated the task description for T3129: Reliable monitoring of services: for users and for admins .
Jan 10 2022, 10:09 AM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

Dec 15 2021

moranegg added a comment to T3377: Add icon/button in moderation view to go to deposit in new tab.

Add link to SWHID with context on the deposit-id.

Dec 15 2021, 2:25 PM · Monitoring, SWORD deposit, Web app
moranegg closed T3173: Provide access to deposit-clients to view dedicated moderation page, a subtask of T3128: Improve deposit integration, management and display, as Resolved.
Dec 15 2021, 2:18 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg closed T3173: Provide access to deposit-clients to view dedicated moderation page as Resolved.

Yannick has confirmed it works

Dec 15 2021, 2:18 PM · Monitoring, SWORD deposit, Web app
moranegg added a comment to T3376: Visualize metadata of a deposit in the admin (moderation) view.

Status:
UI and tests

Dec 15 2021, 2:14 PM · Monitoring, SWORD deposit, Web app
moranegg moved T3174: Filter deposit-admin view by deposit client on admin (moderation) page from In progress to Landed/Tests/Validations (staging) on the SWORD deposit board.
Dec 15 2021, 2:09 PM · Monitoring, SWORD deposit, Web app

Dec 13 2021

ardumont changed the status of T3174: Filter deposit-admin view by deposit client on admin (moderation) page, a subtask of T3128: Improve deposit integration, management and display, from Open to Work in Progress.
Dec 13 2021, 11:27 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
ardumont changed the status of T3174: Filter deposit-admin view by deposit client on admin (moderation) page from Open to Work in Progress.
Dec 13 2021, 11:27 AM · Monitoring, SWORD deposit, Web app

Nov 16 2021

vlorentz added a revision to T3376: Visualize metadata of a deposit in the admin (moderation) view: D6640: Add a button to the deposit admin UI to show deposit metadata.
Nov 16 2021, 11:28 AM · Monitoring, SWORD deposit, Web app

Nov 8 2021

moranegg added a comment to T3173: Provide access to deposit-clients to view dedicated moderation page.

Yannick hasn't answered yet. Will try again on the 15th.

Nov 8 2021, 10:39 PM · Monitoring, SWORD deposit, Web app

Nov 4 2021

vsellier added a comment to T3129: Reliable monitoring of services: for users and for admins .

Current status:
Following the last discussions, the current track I'm trying to implement is to create a grafana dashboard displaying the current status of the infrastructure.
To do so, some information managed by grafana should be displayed like the end-to-end checks status.

Nov 4 2021, 5:10 PM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

Nov 3 2021

moranegg added a comment to T3173: Provide access to deposit-clients to view dedicated moderation page.

I think we can resolve this.
Checking with Yannick (HAL) that it works.

Nov 3 2021, 2:28 PM · Monitoring, SWORD deposit, Web app

Oct 21 2021

moranegg added a subtask for T3128: Improve deposit integration, management and display: T3677: Separate origin-source-code and provenance-metadata in the deposit.
Oct 21 2021, 11:55 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app

Oct 20 2021

anlambert added a revision to T3174: Filter deposit-admin view by deposit client on admin (moderation) page: D6518: admin/deposit: Allow users with permission to list their deposits.
Oct 20 2021, 2:02 PM · Monitoring, SWORD deposit, Web app

Oct 19 2021

anlambert added a revision to T3174: Filter deposit-admin view by deposit client on admin (moderation) page: D6503: api/private/deposit_list: Allow to filter deposits by client username.
Oct 19 2021, 1:48 PM · Monitoring, SWORD deposit, Web app

Oct 18 2021

moranegg added a subtask for T3128: Improve deposit integration, management and display: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg added a parent task for T3174: Filter deposit-admin view by deposit client on admin (moderation) page: T3128: Improve deposit integration, management and display.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3173: Provide access to deposit-clients to view dedicated moderation page: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3375: Add column 'client' in moderation view: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg removed parent tasks for T3174: Filter deposit-admin view by deposit client on admin (moderation) page: T3375: Add column 'client' in moderation view, T3173: Provide access to deposit-clients to view dedicated moderation page.
Oct 18 2021, 2:53 PM · Monitoring, SWORD deposit, Web app
moranegg renamed T3173: Provide access to deposit-clients to view dedicated moderation page from Create profiles in keycloak for the deposit-client to view dedicated moderation page to Provide access to deposit-clients to view dedicated moderation page.
Oct 18 2021, 2:52 PM · Monitoring, SWORD deposit, Web app
moranegg added a comment to T3375: Add column 'client' in moderation view.

@anlambert here is another task to improve the deposit moderation/admin view

Oct 18 2021, 12:30 PM · Monitoring, SWORD deposit, Web app
moranegg added a comment to T3376: Visualize metadata of a deposit in the admin (moderation) view.

@anlambert here is the task we have briefly discussed as step 2 this morning

Oct 18 2021, 12:29 PM · Monitoring, SWORD deposit, Web app

Oct 15 2021

ardumont closed T3664: Activate sentry for journal clients as Resolved.
Oct 15 2021, 4:01 PM · System administration, Monitoring
ardumont moved T3664: Activate sentry for journal clients from in-progress to deployed/landed/monitoring on the System administration board.
Oct 15 2021, 3:39 PM · System administration, Monitoring
ardumont added a comment to T3664: Activate sentry for journal clients.

Deployed.

Oct 15 2021, 3:39 PM · System administration, Monitoring
ardumont updated the task description for T3664: Activate sentry for journal clients.
Oct 15 2021, 3:39 PM · System administration, Monitoring
ardumont updated the task description for T3664: Activate sentry for journal clients.
Oct 15 2021, 2:46 PM · System administration, Monitoring
ardumont added a revision to T3664: Activate sentry for journal clients: D6485: Activate sentry for search journal clients.
Oct 15 2021, 12:12 PM · System administration, Monitoring
ardumont updated the task description for T3664: Activate sentry for journal clients.
Oct 15 2021, 11:25 AM · System administration, Monitoring
ardumont added a revision to T3664: Activate sentry for journal clients: D6483: Activate sentry for scheduler journal client.
Oct 15 2021, 11:22 AM · System administration, Monitoring
ardumont updated the task description for T3664: Activate sentry for journal clients.
Oct 15 2021, 11:19 AM · System administration, Monitoring
ardumont changed the status of T3664: Activate sentry for journal clients from Open to Work in Progress.
Oct 15 2021, 11:10 AM · System administration, Monitoring
ardumont added a revision to T3664: Activate sentry for journal clients: D6482: Activate sentry for indexer journal client.
Oct 15 2021, 11:10 AM · System administration, Monitoring
ardumont moved T3664: Activate sentry for journal clients from Backlog to Weekly backlog on the System administration board.
Oct 15 2021, 10:59 AM · System administration, Monitoring
ardumont added projects to T3664: Activate sentry for journal clients: Monitoring, System administration.
Oct 15 2021, 10:58 AM · System administration, Monitoring

Oct 1 2021

ardumont closed T3583: check icinga alert for svn save-code-now as Resolved.

It resolved itself, it's green again.

Oct 1 2021, 6:04 PM · Scheduling utilities, Save Code Now, Monitoring

Sep 17 2021

ardumont added a parent task for T3583: check icinga alert for svn save-code-now: T3458: save code now: Requests are not getting updated from time to time.
Sep 17 2021, 9:34 AM · Scheduling utilities, Save Code Now, Monitoring
ardumont updated the task description for T3583: check icinga alert for svn save-code-now.
Sep 17 2021, 9:33 AM · Scheduling utilities, Save Code Now, Monitoring

Sep 14 2021

ardumont closed T3538: Send scheduler metrics to prometheus as Resolved.
Sep 14 2021, 11:00 AM · System administration, Monitoring, Scheduling utilities
ardumont moved T3538: Send scheduler metrics to prometheus from in-progress to deployed/landed/monitoring on the System administration board.
Sep 14 2021, 11:00 AM · System administration, Monitoring, Scheduling utilities

Sep 8 2021

vlorentz added a revision to T3376: Visualize metadata of a deposit in the admin (moderation) view: D6190: Add link to extrinsic metadata API from the browse view.
Sep 8 2021, 3:36 PM · Monitoring, SWORD deposit, Web app

Sep 3 2021

ardumont added a parent task for T3538: Send scheduler metrics to prometheus: T2345: Improve handling of recurrent loading tasks in scheduler.
Sep 3 2021, 5:17 PM · System administration, Monitoring, Scheduling utilities
ardumont changed the status of T3538: Send scheduler metrics to prometheus from Open to Work in Progress.
Sep 3 2021, 5:16 PM · System administration, Monitoring, Scheduling utilities
anlambert added a comment to T3375: Add column 'client' in moderation view.

Would you have time during September to help on this task? (it is a roadmap task, btw)

Sep 3 2021, 3:16 PM · Monitoring, SWORD deposit, Web app
moranegg updated subscribers of T3375: Add column 'client' in moderation view.

@anlambert we have discussed this task this morning with @ardumont and @vlorentz.
I want to start working on the improvements of the deposit admin view to open it up for deposit clients.
Would you have time during September to help on this task? (it is a roadmap task, btw)

Sep 3 2021, 12:24 PM · Monitoring, SWORD deposit, Web app
vlorentz claimed T3376: Visualize metadata of a deposit in the admin (moderation) view.

Easiest option would be to add a link to the API endpoint.

Sep 3 2021, 12:07 PM · Monitoring, SWORD deposit, Web app
ardumont triaged T3548: Monitor and raise alert when save code now requests seem unusually long as Normal priority.
Sep 3 2021, 11:27 AM · System administration, Save Code Now, Monitoring
ardumont added a revision to T3538: Send scheduler metrics to prometheus: D6177: Send scheduler metrics to prometheus.
Sep 3 2021, 9:34 AM · System administration, Monitoring, Scheduling utilities
ardumont moved T3538: Send scheduler metrics to prometheus from Backlog to Weekly backlog on the System administration board.
Sep 3 2021, 9:02 AM · System administration, Monitoring, Scheduling utilities
ardumont added a project to T3538: Send scheduler metrics to prometheus: System administration.
Sep 3 2021, 9:02 AM · System administration, Monitoring, Scheduling utilities

Aug 30 2021

ardumont triaged T3538: Send scheduler metrics to prometheus as Normal priority.
Aug 30 2021, 10:48 AM · System administration, Monitoring, Scheduling utilities

Aug 6 2021

vsellier closed T2912: Next generation archive counters as Resolved.

The cleanup of the old counters is done so it can be closed

Aug 6 2021, 6:32 PM · Roadmap 2021, System administration, Monitoring, Web app
vsellier closed T3417: Cleanup the old counters environment as Resolved.
Aug 6 2021, 6:31 PM · System administration, Monitoring
vsellier closed T3417: Cleanup the old counters environment, a subtask of T2912: Next generation archive counters, as Resolved.
Aug 6 2021, 6:31 PM · Roadmap 2021, System administration, Monitoring, Web app
vsellier added a comment to T3417: Cleanup the old counters environment.
  • D6064 landed
  • manual cleanup:
    • the apache vhost was removed by puppet
    • /var/www/stats.export.softwareheritage.org directory removed
    • the crontab was removed by puppet
    • /usr/local/bin/export_archive_counters.py file removed
    • /usr/local/share/swh-data directory removed
  • the refresh of the database counter is now scheduled each monday at 6:29 AM
postgres@belvedere:~$ crontab -l | grep counter
29 6  *   *  mon     /usr/bin/chronic /usr/bin/flock -xn /srv/softwareheritage/postgres/swh-update-counter.lock /usr/bin/psql -p 5433 softwareheritage -c "select swh_update_counter(object_type) from object_counts where single_update = true order by last_update limit 1"
Aug 6 2021, 6:31 PM · System administration, Monitoring
ardumont added a comment to T3417: Cleanup the old counters environment.

For the counters frequency, I have still not found which cron/command regularly is responsible of lauching the refresh

Maybe looking around what calls the following functions could help.

Aug 6 2021, 10:02 AM · System administration, Monitoring
ardumont added a comment to T3417: Cleanup the old counters environment.

For the counters frequency, I have still not found which cron/command regularly is responsible of lauching the refresh

Aug 6 2021, 9:33 AM · System administration, Monitoring

Aug 5 2021

vsellier added a comment to T3417: Cleanup the old counters environment.

Pergamon manual cleanup after D6064 is apply:

  • Remove /var/www/stats.export.softwareheritage.org directory
  • Remove apache vhosts:
    • /etc/apache2/sites-enabled/25-stats.export.softwareheritage.org_non-ssl.conf
    • /etc/apache2/sites-enabled/25-stats.export.softwareheritage.org_ssl.conf
    • /etc/apache2/sites-available/25-stats.export.softwareheritage.org_non-ssl.conf
    • /etc/apache2/sites-available/25-stats.export.softwareheritage.org_ssl.conf
  • check crontab removal: export_archive_counters
  • remove '/usr/local/bin/export_archive_counters.py'
  • remove '/usr/local/share/swh-data' directory
Aug 5 2021, 7:43 PM · System administration, Monitoring
vsellier added a revision to T3417: Cleanup the old counters environment: D6064: Clean counter statistic scripts, data and vhosts on pergamon.
Aug 5 2021, 7:33 PM · System administration, Monitoring
vsellier changed the status of T3417: Cleanup the old counters environment, a subtask of T2912: Next generation archive counters, from Open to Work in Progress.
Aug 5 2021, 5:37 PM · Roadmap 2021, System administration, Monitoring, Web app
vsellier changed the status of T3417: Cleanup the old counters environment from Open to Work in Progress.
Aug 5 2021, 5:37 PM · System administration, Monitoring

Aug 4 2021

ardumont updated the task description for T3452: Replication lag between the dbs should raise icinga alerts.
Aug 4 2021, 10:05 AM · Monitoring, System administration
ardumont updated the task description for T3452: Replication lag between the dbs should raise icinga alerts.
Aug 4 2021, 10:04 AM · Monitoring, System administration

Aug 3 2021

vsellier closed T3452: Replication lag between the dbs should raise icinga alerts as Resolved.

The probe is deployed on the monitoring: https://icinga.softwareheritage.org/dashboard#!/monitoring/service/show?host=belvedere.internal.softwareheritage.org&service=Postgresql%20replication%20lag%20%28belvedere%20-%3E%20somerset%29

Aug 3 2021, 11:32 AM · Monitoring, System administration
vsellier added a revision to T3452: Replication lag between the dbs should raise icinga alerts: D6050: monitor postgresql replication lag through prometheus data.
Aug 3 2021, 9:03 AM · Monitoring, System administration

Aug 2 2021

ardumont changed the status of T3452: Replication lag between the dbs should raise icinga alerts from Open to Work in Progress.
Aug 2 2021, 6:27 PM · Monitoring, System administration
ardumont moved T3452: Replication lag between the dbs should raise icinga alerts from Backlog to Weekly backlog on the System administration board.
Aug 2 2021, 6:27 PM · Monitoring, System administration

Jul 30 2021

vlorentz added a project to T3452: Replication lag between the dbs should raise icinga alerts: Monitoring.
Jul 30 2021, 1:32 PM · Monitoring, System administration

Jul 29 2021

ardumont moved T3159: Deploy swh-counters:v0.1.0 in staging from in-progress to done on the System administration board.
Jul 29 2021, 1:23 PM · Staging environment, System administration, Monitoring
ardumont moved T2774: Fix vault end-to-end check from deployed/landed/monitoring to done on the System administration board.
Jul 29 2021, 1:22 PM · Vault, System administration, Monitoring

Jun 29 2021

moranegg added a comment to T3376: Visualize metadata of a deposit in the admin (moderation) view.

An example of a metadata icon for the deposit-admin view:
https://thenounproject.com/term/metadata/77940/

Jun 29 2021, 9:22 PM · Monitoring, SWORD deposit, Web app
ardumont renamed T3173: Provide access to deposit-clients to view dedicated moderation page from Create profiles in keycloack for the deposit-client to view dedicated moderation page to Create profiles in keycloak for the deposit-client to view dedicated moderation page.
Jun 29 2021, 11:48 AM · Monitoring, SWORD deposit, Web app
vsellier updated the task description for T3417: Cleanup the old counters environment.
Jun 29 2021, 11:25 AM · System administration, Monitoring
vsellier triaged T3417: Cleanup the old counters environment as Normal priority.
Jun 29 2021, 11:20 AM · System administration, Monitoring
moranegg added a subtask for T3128: Improve deposit integration, management and display: T2858: Use keycloak authentication for the deposit.
Jun 29 2021, 11:12 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg renamed T3174: Filter deposit-admin view by deposit client on admin (moderation) page from Filter deposit-admin view by deposit client on moderation page to Filter deposit-admin view by deposit client on admin (moderation) page.
Jun 29 2021, 10:57 AM · Monitoring, SWORD deposit, Web app
moranegg moved T3128: Improve deposit integration, management and display from Backlog to Work in progress on the Roadmap 2021 board.
Jun 29 2021, 10:53 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg removed a project from T3174: Filter deposit-admin view by deposit client on admin (moderation) page: Roadmap 2021.
Jun 29 2021, 10:52 AM · Monitoring, SWORD deposit, Web app
vlorentz removed a project from T3377: Add icon/button in moderation view to go to deposit in new tab: Roadmap 2021.
Jun 29 2021, 10:51 AM · Monitoring, SWORD deposit, Web app
moranegg removed projects from T3376: Visualize metadata of a deposit in the admin (moderation) view: meta-task, Roadmap 2021.
Jun 29 2021, 10:50 AM · Monitoring, SWORD deposit, Web app
moranegg renamed T3376: Visualize metadata of a deposit in the admin (moderation) view from Visualize metadata of a deposit in the moderation view to Visualize metadata of a deposit in the admin (moderation) view.
Jun 29 2021, 10:40 AM · Monitoring, SWORD deposit, Web app
moranegg placed T3376: Visualize metadata of a deposit in the admin (moderation) view up for grabs.
Jun 29 2021, 10:39 AM · Monitoring, SWORD deposit, Web app

Jun 28 2021

ardumont added a project to T3174: Filter deposit-admin view by deposit client on admin (moderation) page: Roadmap 2021.
Jun 28 2021, 10:56 AM · Monitoring, SWORD deposit, Web app
ardumont added a subtask for T3174: Filter deposit-admin view by deposit client on admin (moderation) page: T2996: Add possibility to fetch a list of deposits on the deposit cli.
Jun 28 2021, 10:56 AM · Monitoring, SWORD deposit, Web app

Jun 24 2021

moranegg removed a project from T3377: Add icon/button in moderation view to go to deposit in new tab: meta-task.
Jun 24 2021, 11:00 AM · Monitoring, SWORD deposit, Web app
moranegg placed T3377: Add icon/button in moderation view to go to deposit in new tab up for grabs.
Jun 24 2021, 11:00 AM · Monitoring, SWORD deposit, Web app

Jun 11 2021

moranegg triaged T3377: Add icon/button in moderation view to go to deposit in new tab as Normal priority.
Jun 11 2021, 5:18 PM · Monitoring, SWORD deposit, Web app
moranegg triaged T3376: Visualize metadata of a deposit in the admin (moderation) view as Normal priority.
Jun 11 2021, 5:13 PM · Monitoring, SWORD deposit, Web app