Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 5 2022

ardumont closed T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket, a subtask of T4144: Elastic worker infrastructure, as Invalid.
Sep 5 2022, 5:29 PM · meta-task, System administration, Roadmap 2022
ardumont closed T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket as Invalid.
Sep 5 2022, 5:29 PM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket.

In the end, this feels like an invalid task as modifying the date range, i got values in the end [1].
Which is a good news.

Sep 5 2022, 5:28 PM · meta-task, System administration, Roadmap 2022
ardumont triaged T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket as High priority.
Sep 5 2022, 4:59 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 5 2022, 3:33 PM · meta-task, System administration, Roadmap 2022

Sep 2 2022

ardumont added a comment to T4144: Elastic worker infrastructure.

To check the live content of the thanos-sidecar in the cluster (then port-forward, k9s tool helps a lot):

Sep 2 2022, 6:35 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 2 2022, 4:02 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4144: Elastic worker infrastructure: D8385: Expose thanos gateway service to read archive staging metrics.
Sep 2 2022, 4:00 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 2 2022, 3:49 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 2 2022, 3:48 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4144: Elastic worker infrastructure: D8381: cluster-archive-staging: Activate thanos sidecar service.
Sep 2 2022, 9:33 AM · meta-task, System administration, Roadmap 2022

Aug 30 2022

ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Aug 30 2022, 5:17 PM · meta-task, System administration, Roadmap 2022

Aug 25 2022

ardumont added a revision to T4144: Elastic worker infrastructure: D8318: Deploy graphql application to staging cluster.
Aug 25 2022, 6:22 PM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4144: Elastic worker infrastructure.

The (staging) loaders were redeployed using the new workflow which allows to properly configure secrets as well.
Hence the gazillion of commits ^.

Aug 25 2022, 5:34 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4144: Elastic worker infrastructure: D8315: Migrate worker chart inside swh scaffolding as "loaders" deployment.
Aug 25 2022, 3:55 PM · meta-task, System administration, Roadmap 2022
bchauvet added a revision to T3867: Create docs landing page providing access to devel , sys-admin and user docs: D8314: add a documentation landing page.
Aug 25 2022, 2:09 PM · meta-task, Roadmap 2022, Documentation
vlorentz added a comment to T3841: regularly scrub all the data stores of swh.

Metrics: https://grafana.softwareheritage.org/goto/s3g4jcWVk?orgId=1

Aug 25 2022, 11:22 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Aug 24 2022

zack closed T4322: Set up a swh-users mailing list for user-oriented questions, a subtask of T3730: Add a "user support" mechanism to the archive, as Resolved.
Aug 24 2022, 10:32 AM · meta-task, Roadmap 2022

Aug 17 2022

vlorentz closed T4136: Add an "history completeness check", a subtask of T3841: regularly scrub all the data stores of swh, as Resolved.
Aug 17 2022, 4:38 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Aug 9 2022

vlorentz closed Restricted Maniphest Task, a subtask of T3841: regularly scrub all the data stores of swh, as Resolved.
Aug 9 2022, 10:16 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Aug 8 2022

vlorentz reopened Restricted Maniphest Task, a subtask of T3841: regularly scrub all the data stores of swh, as Open.
Aug 8 2022, 2:23 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Aug 5 2022

ardumont added a subtask for T3841: regularly scrub all the data stores of swh: T4371: Deploy swh-scrubber on all storage instances.
Aug 5 2022, 4:31 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
vlorentz closed Restricted Maniphest Task, a subtask of T3841: regularly scrub all the data stores of swh, as Resolved.
Aug 5 2022, 3:07 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Jul 29 2022

ardumont updated the task description for T4144: Elastic worker infrastructure.
Jul 29 2022, 9:14 AM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4144: Elastic worker infrastructure.

Argocd now deploys the elastic workers on staging [1].

Jul 29 2022, 9:11 AM · meta-task, System administration, Roadmap 2022

Jul 27 2022

ardumont moved T4144: Elastic worker infrastructure from in-progress to Weekly backlog on the System administration board.
Jul 27 2022, 12:46 PM · meta-task, System administration, Roadmap 2022
ardumont moved T4385: Federate prometheus instances through thanos from in-progress to Weekly backlog on the System administration board.
Jul 27 2022, 12:45 PM · meta-task, System administration, Roadmap 2022

Jul 20 2022

ardumont merged T1362: Upgrade the Prometheus setup to Thanos into T4385: Federate prometheus instances through thanos.
Jul 20 2022, 10:03 AM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 20 2022, 9:44 AM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 20 2022, 9:25 AM · meta-task, System administration, Roadmap 2022

Jul 19 2022

ardumont added a revision to T4385: Federate prometheus instances through thanos: D8143: Drop mmca prometheus federation.
Jul 19 2022, 6:20 PM · meta-task, System administration, Roadmap 2022
vlorentz added a subtask for T3097: Expose metadata in the WebApp and make it searchable: T2064: Add metadata from deposits to metadata search.
Jul 19 2022, 1:05 PM · Intrinsic metadata, Extrinsic metadata, Roadmap 2021, meta-task
vlorentz added a subtask for T3097: Expose metadata in the WebApp and make it searchable: Restricted Maniphest Task.
Jul 19 2022, 1:02 PM · Intrinsic metadata, Extrinsic metadata, Roadmap 2021, meta-task

Jul 18 2022

vlorentz closed T4377: Create API endpoint to expose raw extrinsic metadata on origins, a subtask of T2202: Collect extrinsic metadata, as Resolved.
Jul 18 2022, 10:31 AM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata

Jul 13 2022

ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 6:42 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 6:32 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 6:30 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 6:19 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 4:56 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 4:52 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 13 2022, 4:51 PM · meta-task, System administration, Roadmap 2022
vlorentz added a subtask for T3841: regularly scrub all the data stores of swh: Restricted Maniphest Task.
Jul 13 2022, 9:40 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Jul 11 2022

ardumont changed the status of T4385: Federate prometheus instances through thanos, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
Jul 11 2022, 2:21 PM · meta-task, System administration, Roadmap 2022
ardumont changed the status of T4385: Federate prometheus instances through thanos from Open to Work in Progress.
Jul 11 2022, 2:21 PM · meta-task, System administration, Roadmap 2022
ardumont moved T4385: Federate prometheus instances through thanos from Backlog to Weekly backlog on the System administration board.
Jul 11 2022, 2:21 PM · meta-task, System administration, Roadmap 2022

Jul 8 2022

ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 8 2022, 5:07 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 8 2022, 5:06 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 8 2022, 4:46 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 8 2022, 11:07 AM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4385: Federate prometheus instances through thanos: D8097: thanos: Configure gateway service to expose historical data.
Jul 8 2022, 11:06 AM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 8 2022, 10:30 AM · meta-task, System administration, Roadmap 2022

Jul 7 2022

ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 7 2022, 3:12 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 7 2022, 12:01 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4385: Federate prometheus instances through thanos: D8092: Configure thanos query service to new dedicated node.
Jul 7 2022, 11:48 AM · meta-task, System administration, Roadmap 2022

Jul 6 2022

ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 6 2022, 6:19 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Jul 6 2022, 5:52 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4385: Federate prometheus instances through thanos: D8089: Provision thanos query node.
Jul 6 2022, 5:48 PM · meta-task, System administration, Roadmap 2022
ardumont triaged T4385: Federate prometheus instances through thanos as High priority.
Jul 6 2022, 5:46 PM · meta-task, System administration, Roadmap 2022

Jul 5 2022

vlorentz closed T833: When listing an origin, add origin level metadata to RMD storage, a subtask of T2202: Collect extrinsic metadata, as Wontfix.
Jul 5 2022, 6:33 PM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata

Jun 22 2022

ardumont closed T4329: Deploy add-forge-now in production, a subtask of T1538: Add "forge" now, as Resolved.
Jun 22 2022, 12:52 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021

Jun 21 2022

olasd added a revision to T3775: Dealing with repositories with contents that produces hash conflicts (example included from GitLab): D8011: Always set object id when adding objects to objstorage.
Jun 21 2022, 4:21 PM · meta-task, Roadmap 2022, Save Code Now, Origin-GitLab
vlorentz added a subtask for T3775: Dealing with repositories with contents that produces hash conflicts (example included from GitLab): T2309: Add support for other hash algo than sha1 in current objstorage implementation.
Jun 21 2022, 2:41 PM · meta-task, Roadmap 2022, Save Code Now, Origin-GitLab

Jun 16 2022

bchauvet added a comment to T2220: swh-graph in production.
  1. Graph status meeting
Jun 16 2022, 5:40 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service
jayeshv triaged T4332: SWH-WEB: Fix relevant issues reported by static analysis as Low priority.
Jun 16 2022, 5:29 PM · meta-task, Web app

Jun 15 2022

ardumont closed T3733: Develop a "Add forge now" mock-up, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Jun 15 2022, 4:11 PM · meta-task, Add Forge Now

Jun 14 2022

ardumont updated the task description for T4144: Elastic worker infrastructure.
Jun 14 2022, 5:57 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Jun 14 2022, 5:57 PM · meta-task, System administration, Roadmap 2022
ardumont changed the status of T4329: Deploy add-forge-now in production, a subtask of T1538: Add "forge" now, from Open to Work in Progress.
Jun 14 2022, 9:34 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
ardumont added a subtask for T1538: Add "forge" now: T4329: Deploy add-forge-now in production.
Jun 14 2022, 9:34 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021

Jun 10 2022

bchauvet claimed T3730: Add a "user support" mechanism to the archive.
Jun 10 2022, 9:53 AM · meta-task, Roadmap 2022

Jun 9 2022

ardumont updated the task description for T4144: Elastic worker infrastructure.
Jun 9 2022, 11:14 AM · meta-task, System administration, Roadmap 2022

Jun 3 2022

bchauvet closed T3998: [Add forge now] Change request status, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Jun 3 2022, 9:26 AM · meta-task, Add Forge Now
bchauvet closed T3993: [Add forge now] Send submission mail to forge, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Jun 3 2022, 9:26 AM · meta-task, Add Forge Now

Jun 2 2022

vlorentz moved T3841: regularly scrub all the data stores of swh from Backlog to Work in progress on the Roadmap 2022 board.
Jun 2 2022, 9:58 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
vlorentz moved T2214: Scale-out graph and database storage in production from Backlog to Work in progress on the Roadmap 2022 board.
Jun 2 2022, 9:57 AM · meta-task, Roadmap 2022, Roadmap 2021, Storage manager
vlorentz moved T2202: Collect extrinsic metadata from Backlog to Work in progress on the Roadmap 2022 board.
Jun 2 2022, 9:57 AM · Roadmap 2022, meta-task, Roadmap 2021, Extrinsic metadata
vlorentz removed a project from T4263: Add a search entrypoint to the GraphQL schema: Roadmap 2022.
Jun 2 2022, 9:54 AM · GraphQL API
vlorentz removed a project from T4291: Add item cursor for connection edges.: Roadmap 2022.
Jun 2 2022, 9:54 AM · GraphQL API
vlorentz removed a project from T4292: Add missing functional tests for GraphQL APIs: Roadmap 2022.
Jun 2 2022, 9:54 AM · GraphQL API

May 31 2022

jayeshv triaged T4292: Add missing functional tests for GraphQL APIs as Normal priority.
May 31 2022, 5:51 PM · GraphQL API
jayeshv closed T3556: Implement a generic pagination support for the GraphQL response., a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
May 31 2022, 5:48 PM · GraphQL API, Roadmap 2022
jayeshv closed T3932: Define a GraphQL schema, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
May 31 2022, 5:48 PM · GraphQL API, Roadmap 2022
jayeshv closed T3984: Structure and design for swh-graphql, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
May 31 2022, 5:47 PM · GraphQL API, Roadmap 2022
jayeshv triaged T4291: Add item cursor for connection edges. as Normal priority.
May 31 2022, 5:40 PM · GraphQL API
vsellier closed T4278: Elastic worker cluster failures to unstuck, a subtask of T4144: Elastic worker infrastructure, as Resolved.
May 31 2022, 3:05 PM · meta-task, System administration, Roadmap 2022

May 25 2022

ardumont changed the status of T4278: Elastic worker cluster failures to unstuck, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
May 25 2022, 5:20 PM · meta-task, System administration, Roadmap 2022

May 23 2022

jayeshv claimed T4263: Add a search entrypoint to the GraphQL schema.
May 23 2022, 10:12 AM · GraphQL API
jayeshv triaged T4263: Add a search entrypoint to the GraphQL schema as Normal priority.
May 23 2022, 10:11 AM · GraphQL API

May 19 2022

ardumont changed the status of T4064: Test GitLab migration scripts, a subtask of T2225: Migrate to GitLab, from Open to Work in Progress.
May 19 2022, 4:55 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020

May 18 2022

ardumont added a revision to T2225: Migrate to GitLab: D7858: Allow main script executions within container.
May 18 2022, 5:59 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020
ardumont added a revision to T2225: Migrate to GitLab: D7857: Install Dockerfile to allow containerized script execution.
May 18 2022, 5:57 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020
ardumont added a revision to T2225: Migrate to GitLab: D7850: Add script to mirror an upstream repository to our forge.
May 18 2022, 2:42 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020
ardumont added a revision to T2225: Migrate to GitLab: D7847: scripts: Extract reusable functions to a common module.
May 18 2022, 11:58 AM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020

May 17 2022

vsellier added a revision to T3129: Reliable monitoring of services: for users and for admins : D7844: Allow icinga checks to write prometheus metrics files.
May 17 2022, 8:24 PM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

May 16 2022

douardda added a comment to T3957: Clean sentry reports.

seems we still have a lot of NotFound error from the swh-loader-git:

May 16 2022, 3:03 PM · meta-task, Roadmap 2022
jayeshv claimed T3952: Make the search query language a first class citizen .
May 16 2022, 10:46 AM · meta-task, Roadmap 2022, Archive search
jayeshv added subtasks for T4083: New public API (GraphQL + thin layer): T4103: Setup a staging environment for GraphQL APIs, T3984: Structure and design for swh-graphql, T3556: Implement a generic pagination support for the GraphQL response., T3405: GraphQL apis for SWH.
May 16 2022, 10:28 AM · GraphQL API, Roadmap 2022
jayeshv added a subtask for T4083: New public API (GraphQL + thin layer): T3932: Define a GraphQL schema.
May 16 2022, 10:23 AM · GraphQL API, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
May 16 2022, 9:44 AM · meta-task, System administration, Roadmap 2022

May 13 2022

moranegg added a subtask for T3972: bootstrap a d.s.o/user end user documentation page: T4037: [Add forge now] Create moderation guide.
May 13 2022, 11:32 PM · Roadmap 2022, Documentation