Page MenuHomeSoftware Heritage

Roadmap 2021Goal
ActivePublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Project roadmap for the year 2021.

For details: see the 2021 roadmap document.

Recent Activity

Yesterday

anlambert added a comment to T3134: SWHID v2.

SWHID v2 should also prevent the hash collision issues we are currently facing (some related to the SHAttered attack on SHA1), see T3775 and SWH-LOADER-GIT-JT.

Tue, Dec 7, 4:55 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Fri, Nov 26

vlorentz updated the task description for T3609: SWHIDv2: List issues with SWHIDv1 that should be fixed.
Fri, Nov 26, 3:16 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Thu, Nov 25

ardumont added a comment to T3733: Develop a "Add forge now" mock-up.

I changed to mdi-anvil so that might help relate to a forge ;)

Thu, Nov 25, 11:39 AM · Roadmap 2021, Web app
ardumont added a comment to T3733: Develop a "Add forge now" mock-up.

Choosing the right icon for the new menu entry is hard.
The currently chosen and demonstrated in the previous comment is 'mdi-content-save-all'.

Thu, Nov 25, 11:14 AM · Roadmap 2021, Web app

Tue, Nov 23

zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed, a subtask of T2220: swh-graph in production, from Open to Work in Progress.
Tue, Nov 23, 1:38 PM · meta-task, Roadmap 2021, Graph service

Fri, Nov 19

ardumont added a comment to T3733: Develop a "Add forge now" mock-up.

Listing and submission view with a standard user (or anonymous):

Fri, Nov 19, 2:57 PM · Roadmap 2021, Web app

Wed, Nov 17

ardumont removed a project from T3733: Develop a "Add forge now" mock-up: meta-task.
Wed, Nov 17, 11:36 AM · Roadmap 2021, Web app
ardumont triaged T3733: Develop a "Add forge now" mock-up as Normal priority.
Wed, Nov 17, 11:23 AM · Roadmap 2021, Web app

Mon, Nov 15

vlorentz added a parent task for T2220: swh-graph in production: T3550: Compute and show ETA for vault tasks.
Mon, Nov 15, 9:55 AM · meta-task, Roadmap 2021, Graph service

Tue, Nov 9

ardumont added a comment to T1538: Add "forge" now.

Is the request for regular pulling?

Tue, Nov 9, 10:00 AM · meta-task, Roadmap 2021, Web app
zack added a comment to T1538: Add "forge" now.

Is the request for regular pulling?
If yes, it should be added for visibility on the home page of the archive.
If no, it should be clear this is a one shot thing.

Tue, Nov 9, 9:48 AM · meta-task, Roadmap 2021, Web app

Mon, Nov 8

moranegg added a comment to T1538: Add "forge" now.

This is an example of a use-case in Open Science:
An institution has a forge and wishes to add the forge as a whole to SWH.

Mon, Nov 8, 10:34 PM · meta-task, Roadmap 2021, Web app
ardumont renamed T1538: Add "forge" now from Save "forge" now to Add "forge" now.
Mon, Nov 8, 11:23 AM · meta-task, Roadmap 2021, Web app

Nov 4 2021

vsellier added a comment to T3129: Reliable monitoring of services: for users and for admins .

Current status:
Following the last discussions, the current track I'm trying to implement is to create a grafana dashboard displaying the current status of the infrastructure.
To do so, some information managed by grafana should be displayed like the end-to-end checks status.

Nov 4 2021, 5:10 PM · Roadmap 2021, Monitoring, meta-task

Nov 2 2021

olasd moved T3054: Scale out object storage design from Backlog to RedHat collaboration on the Object storage board.
Nov 2 2021, 4:22 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task

Oct 21 2021

moranegg moved T3388: Create FAQ in docs for users from Backlog to Done on the Roadmap 2021 board.
Oct 21 2021, 12:56 PM · Documentation, Roadmap 2021
moranegg moved T3389: Create FAQ in docs for developers from Backlog to Done on the Roadmap 2021 board.
Oct 21 2021, 12:56 PM · Documentation, Roadmap 2021
moranegg added a subtask for T3128: Improve deposit integration, management and display: T3677: Separate origin-source-code and origin-metadata in the deposit.
Oct 21 2021, 11:55 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
vlorentz added a revision to T3135: Improve integrity of ingested content: D6504: converters: Fix detection of tree entries with non-standard commit/tree mode..
Oct 21 2021, 10:57 AM · Storage manager, Roadmap 2021, meta-task

Oct 19 2021

ardumont updated the task description for T1538: Add "forge" now.
Oct 19 2021, 2:01 PM · meta-task, Roadmap 2021, Web app

Oct 18 2021

dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3054: Scale out object storage design, from Open to Work in Progress.
Oct 18 2021, 9:02 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task
moranegg added a subtask for T3128: Improve deposit integration, management and display: T3174: Filter deposit-admin view by deposit client on admin (moderation) page.
Oct 18 2021, 2:53 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg added a comment to T2624: Create strategy for documentation with a map or a full table of content.

https://docs.softwareheritage.org/devel/contributing/tutorial-docs-contribution.html#doc-contribution

Oct 18 2021, 12:16 PM · Roadmap 2021, meta-task, Documentation
moranegg moved T2624: Create strategy for documentation with a map or a full table of content from Pending validation to Done on the Roadmap 2021 board.
Oct 18 2021, 12:16 PM · Roadmap 2021, meta-task, Documentation

Oct 15 2021

ardumont closed T1524: save code now: also add new origins for unknown repos, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Oct 15 2021, 12:29 PM · System administration, Save Code Now, meta-task, Roadmap 2021, Web app

Oct 14 2021

vlorentz updated the task description for T3609: SWHIDv2: List issues with SWHIDv1 that should be fixed.
Oct 14 2021, 12:15 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021
vlorentz removed a subtask for T3134: SWHID v2: T1957: Handling missing DAG nodes.
Oct 14 2021, 12:14 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021
vlorentz added a subtask for T3134: SWHID v2: T1957: Handling missing DAG nodes.
Oct 14 2021, 12:13 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Oct 8 2021

ardumont closed T3629: doc: Add a "how to save a forge" as in how it's currently done, a subtask of T1538: Add "forge" now, as Resolved.
Oct 8 2021, 5:55 PM · meta-task, Roadmap 2021, Web app

Oct 6 2021

ardumont added a subtask for T1538: Add "forge" now: T3629: doc: Add a "how to save a forge" as in how it's currently done.
Oct 6 2021, 6:24 PM · meta-task, Roadmap 2021, Web app

Sep 23 2021

vlorentz updated the task description for T3609: SWHIDv2: List issues with SWHIDv1 that should be fixed.
Sep 23 2021, 5:01 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021
vlorentz triaged T3609: SWHIDv2: List issues with SWHIDv1 that should be fixed as Normal priority.
Sep 23 2021, 5:00 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Sep 20 2021

douardda closed T2196: Batch APIs, a subtask of T2194: Archive Integration (Web API), as Wontfix.
Sep 20 2021, 11:54 AM · Roadmap 2021, meta-task
vlorentz added a revision to T3135: Improve integrity of ingested content: D6281: converters: Recompute hashes and check they match the originals.
Sep 20 2021, 11:05 AM · Storage manager, Roadmap 2021, meta-task

Sep 10 2021

vlorentz changed the status of T3504: Make the git-bare cooker publicly available, a subtask of T3096: Efficient and reliable download via the Vault, from Open to Work in Progress.
Sep 10 2021, 11:33 AM · meta-task, Roadmap 2021, Vault
vlorentz moved T3096: Efficient and reliable download via the Vault from Backlog to In progress on the Vault board.
Sep 10 2021, 11:33 AM · meta-task, Roadmap 2021, Vault

Aug 30 2021

dachary updated the task description for T3054: Scale out object storage design.
Aug 30 2021, 12:53 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task

Aug 29 2021

dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary changed the status of T3249: Deleting and erasing an object, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:05 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task

Aug 26 2021

vlorentz closed T843: Vault: Add a "git bare" tarball cooker, a subtask of T3096: Efficient and reliable download via the Vault, as Resolved.
Aug 26 2021, 3:06 PM · meta-task, Roadmap 2021, Vault

Aug 23 2021

dachary closed T3422: Running the benchmarks: August 6th, 2021, 9 days, a subtask of T3054: Scale out object storage design, as Resolved.
Aug 23 2021, 12:26 PM · Object storage (RedHat collaboration), Roadmap 2021, meta-task

Aug 19 2021

vlorentz removed a subtask for T2202: Collect extrinsic metadata: T2513: Copy metadata on revisions to the extrinsic metadata storage.
Aug 19 2021, 9:20 AM · meta-task, Roadmap 2021, Extrinsic metadata

Aug 10 2021

douardda updated the task description for T3085: Complete and updated copy of the archive on S3 (objects+graph).
Aug 10 2021, 4:00 PM · meta-task, Roadmap 2021, System administration, Object storage
douardda added a subtask for T3477: Add alerting when the copy to S3 starts lagging: T1954: Up-to-date objstorage mirror on S3.
Aug 10 2021, 3:59 PM · Roadmap 2021, System administration
douardda triaged T3477: Add alerting when the copy to S3 starts lagging as High priority.
Aug 10 2021, 3:58 PM · Roadmap 2021, System administration
douardda updated the task description for T3085: Complete and updated copy of the archive on S3 (objects+graph).
Aug 10 2021, 3:56 PM · meta-task, Roadmap 2021, System administration, Object storage

Aug 6 2021

vsellier closed T2912: Next generation archive counters as Resolved.

The cleanup of the old counters is done so it can be closed

Aug 6 2021, 6:32 PM · Roadmap 2021, System administration, Monitoring, Web app
vsellier closed T3417: Cleanup the old counters environment, a subtask of T2912: Next generation archive counters, as Resolved.
Aug 6 2021, 6:31 PM · Roadmap 2021, System administration, Monitoring, Web app

Aug 5 2021

vsellier changed the status of T3417: Cleanup the old counters environment, a subtask of T2912: Next generation archive counters, from Open to Work in Progress.
Aug 5 2021, 5:37 PM · Roadmap 2021, System administration, Monitoring, Web app

Aug 3 2021

ardumont added a comment to T3127: Compute and display distribution of origins by forge.

The computation of those metrics will be executed in production on a regular basis, probably each day, to keep them up to date.

Aug 3 2021, 5:00 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task