Page MenuHomeSoftware Heritage
Feed Advanced Search

Mar 21 2022

bchauvet edited parent tasks for T4067: [add forge now] - change login link on submit form , added: T4012: [Add forge now] Create a message panel for non logged user; removed: T4047: User interface to submit and follow Add forge now requests.
Mar 21 2022, 2:16 PM · Easy hack, Add Forge Now
bchauvet triaged T4067: [add forge now] - change login link on submit form as Normal priority.
Mar 21 2022, 2:15 PM · Easy hack, Add Forge Now

Mar 18 2022

ardumont closed T3992: [Add forge now] Create request dashboard w/ basic info, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 5:06 PM · meta-task, Add Forge Now
ardumont closed T4052: [Add forge now] Handle errors from the server when submitting the form, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 5:06 PM · meta-task, Add Forge Now
ardumont closed T4001: [Add forge now] Display detailled log/history, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 5:06 PM · meta-task, Add Forge Now
ardumont closed T4003: [Add forge now] Add request comment, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 5:06 PM · meta-task, Add Forge Now
ardumont closed T3991: [Add forge now] Create moderation dashboard, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 12:48 PM · meta-task, Add Forge Now
ardumont closed T4040: [Add forge now] Create a feature flag, a subtask of T4047: User interface to submit and follow Add forge now requests, as Resolved.
Mar 18 2022, 12:47 PM · meta-task, Add Forge Now
bchauvet changed the status of T4052: [Add forge now] Handle errors from the server when submitting the form, a subtask of T4047: User interface to submit and follow Add forge now requests, from Open to Work in Progress.
Mar 18 2022, 10:48 AM · meta-task, Add Forge Now
bchauvet changed the status of T4001: [Add forge now] Display detailled log/history, a subtask of T4047: User interface to submit and follow Add forge now requests, from Open to Work in Progress.
Mar 18 2022, 10:43 AM · meta-task, Add Forge Now

Mar 17 2022

bchauvet added a subtask for T4047: User interface to submit and follow Add forge now requests: T4040: [Add forge now] Create a feature flag.
Mar 17 2022, 5:48 PM · meta-task, Add Forge Now
vlorentz added projects to T4047: User interface to submit and follow Add forge now requests: Add Forge Now , meta-task.
Mar 17 2022, 4:54 PM · meta-task, Add Forge Now
bchauvet removed a subtask for T1538: Add "forge" now: T3733: Develop a "Add forge now" mock-up.
Mar 17 2022, 4:47 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
bchauvet removed a subtask for T1538: Add "forge" now: T3629: doc: Add a "how to save a forge" as in how it's currently done.
Mar 17 2022, 4:47 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
bchauvet added a subtask for T1538: Add "forge" now: T4059: Add forge now documentation.
Mar 17 2022, 4:44 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
bchauvet removed a subtask for T1538: Add "forge" now: T1537: semi-automated addition of new "forges".
Mar 17 2022, 4:41 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
bchauvet added a subtask for T1538: Add "forge" now: T4058: Add forge now request processing admin tools.
Mar 17 2022, 4:38 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021

Mar 16 2022

bchauvet added a subtask for T1538: Add "forge" now: T4047: User interface to submit and follow Add forge now requests.
Mar 16 2022, 11:33 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
vlorentz closed T3752: Store/represent time offsets as strings, a subtask of T3594: Faithfully store weird git objects, as Resolved.
Mar 16 2022, 10:36 AM · meta-task, Data Model, Storage manager

Mar 15 2022

vlorentz closed T3878: Fix existing corrupt objects, a subtask of T3135: Improve integrity of ingested content, as Resolved.
Mar 15 2022, 1:46 PM · Storage manager, Roadmap 2021, meta-task
vlorentz claimed T3841: regularly scrub all the data stores of swh.
Mar 15 2022, 11:25 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Mar 14 2022

olasd added a comment to T3841: regularly scrub all the data stores of swh.
In T3841#80779, @olasd wrote:

I think it's fine to remove the entries when we don't need them anymore (i.e. the object has been restored). Worst case, it'll be re-added at the next iteration of the script :-)

Mar 14 2022, 3:23 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
vlorentz added a comment to T3841: regularly scrub all the data stores of swh.
In T3841#80779, @olasd wrote:

You'll need a column for which datastore has the corrupted object.

Mar 14 2022, 3:21 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
olasd added a comment to T3841: regularly scrub all the data stores of swh.

You'll need a column for which datastore has the corrupted object.

Mar 14 2022, 3:19 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
vlorentz added a comment to T3841: regularly scrub all the data stores of swh.

I wrote a script to scrub postgres and kafka: https://forge.softwareheritage.org/source/snippets/browse/master/vlorentz/recheck_consistency.py

Mar 14 2022, 2:45 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Feb 16 2022

vlorentz removed a subtask for T3937: Send email to HAL to add in the atom metadata the <swh:metadata-provenance>: T3935: Change metadata-only deposits protocol to add a metadata-provenance url.
Feb 16 2022, 9:15 AM · SWORD deposit

Feb 15 2022

moranegg added a subtask for T3677: Separate origin-source-code and provenance-metadata in the deposit: T3376: Visualize metadata of a deposit in the admin (moderation) view.
Feb 15 2022, 4:16 PM · SWORD deposit
moranegg added a subtask for T3937: Send email to HAL to add in the atom metadata the <swh:metadata-provenance>: T3935: Change metadata-only deposits protocol to add a metadata-provenance url.
Feb 15 2022, 4:02 PM · SWORD deposit
moranegg triaged T3937: Send email to HAL to add in the atom metadata the <swh:metadata-provenance> as Normal priority.
Feb 15 2022, 4:02 PM · SWORD deposit
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T2344: Build a connector for software deposit via Zenodo/InvenioRDM.
Feb 15 2022, 3:19 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T3177: Add deposit guides links to the deposit page https://deposit.softwareheritage.org/.
Feb 15 2022, 3:17 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg removed a subtask for T3128: Improve deposit integration, management and display: T3176: Add query box on deposit origin on https://deposit.softwareheritage.org/.
Feb 15 2022, 3:17 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
moranegg renamed T3677: Separate origin-source-code and provenance-metadata in the deposit from Separate origin-source-code and origin-metadata in the deposit to Separate origin-source-code and provenance-metadata in the deposit.
Feb 15 2022, 3:05 PM · SWORD deposit

Feb 8 2022

vlorentz added a parent task for T2220: swh-graph in production: T887: Vault: "snapshot" cooker.
Feb 8 2022, 2:05 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service
vlorentz closed T3594: Faithfully store weird git objects, a subtask of T3135: Improve integrity of ingested content, as Resolved.
Feb 8 2022, 11:53 AM · Storage manager, Roadmap 2021, meta-task
vlorentz closed T3594: Faithfully store weird git objects as Resolved.
Feb 8 2022, 11:53 AM · meta-task, Data Model, Storage manager
vlorentz closed T3753: Store original git manifests, a subtask of T3594: Faithfully store weird git objects, as Resolved.
Feb 8 2022, 11:53 AM · meta-task, Data Model, Storage manager

Feb 3 2022

ardumont closed T3174: Filter deposit-admin view by deposit client on admin (moderation) page, a subtask of T3128: Improve deposit integration, management and display, as Resolved.
Feb 3 2022, 9:28 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app

Jan 28 2022

ardumont removed a project from T3082: Improve Save Code Now handling: System administration.
Jan 28 2022, 3:39 PM · Save Code Now, meta-task, Roadmap 2021, Web app

Jan 27 2022

douardda closed T1481: add metric to monitor "save code now" efficiency, a subtask of T3082: Improve Save Code Now handling, as Resolved.
Jan 27 2022, 1:45 PM · Save Code Now, meta-task, Roadmap 2021, Web app

Jan 20 2022

anlambert closed T3403: Use forge URL network location as default lister instance name, a subtask of T3127: Compute and display distribution of origins by forge, as Resolved.
Jan 20 2022, 6:44 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task
anlambert closed T3127: Compute and display distribution of origins by forge as Resolved.

Is there a reason not to close this task?

Jan 20 2022, 6:43 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task
douardda added a comment to T3127: Compute and display distribution of origins by forge.

Is there a reason not to close this task?

Jan 20 2022, 6:35 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task

Jan 12 2022

seirl closed T3161: graph service: add anti-DoS limit on the number of edges traversed, a subtask of T2220: swh-graph in production, as Resolved.
Jan 12 2022, 5:01 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service
vsellier added a revision to T3129: Reliable monitoring of services: for users and for admins : D6926: First iteration of prometheus export of the e2e metrics.
Jan 12 2022, 3:07 PM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

Jan 11 2022

douardda renamed T3841: regularly scrub all the data stores of swh from regularly scrub all the data sources of swh to regularly scrub all the data stores of swh.
Jan 11 2022, 12:32 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
douardda removed a project from T3841: regularly scrub all the data stores of swh: Roadmap 2021.
Jan 11 2022, 12:31 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager
douardda triaged T3841: regularly scrub all the data stores of swh as Normal priority.
Jan 11 2022, 12:31 PM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Jan 10 2022

ardumont updated the task description for T3129: Reliable monitoring of services: for users and for admins .
Jan 10 2022, 10:09 AM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task
ardumont placed T3082: Improve Save Code Now handling up for grabs.
Jan 10 2022, 10:06 AM · Save Code Now, meta-task, Roadmap 2021, Web app

Jan 4 2022

moranegg closed T3342: Collect material for software stories prototype, a subtask of T3481: Coordinate SWH Stories project, as Resolved.
Jan 4 2022, 5:34 PM · Acquisition Process (SWHAP), meta-task, Software Stories
moranegg closed T3482: Accompany design of the SWH stories data model, a subtask of T3481: Coordinate SWH Stories project, as Resolved.
Jan 4 2022, 5:32 PM · Acquisition Process (SWHAP), meta-task, Software Stories
moranegg closed T3481: Coordinate SWH Stories project as Resolved.
Jan 4 2022, 5:32 PM · Acquisition Process (SWHAP), meta-task, Software Stories
moranegg closed T2327: Review UX proposition for specific use-cases, a subtask of T2190: Archive Navigation (Web UI), as Invalid.
Jan 4 2022, 4:35 PM · Web app, meta-task, Roadmap 2020
moranegg moved T3604: Document the architecture of all major packages/components from Backlog to developers (docs/devel/) on the Documentation board.
Jan 4 2022, 12:34 PM · meta-task, Documentation
moranegg added a comment to T2624: Create strategy for documentation with a map or a full table of content.

The strategy is defined in this task.
The creation of the strategy is now resolved.

Jan 4 2022, 12:26 PM · Roadmap 2021, meta-task, Documentation
moranegg closed T2624: Create strategy for documentation with a map or a full table of content as Resolved.
Jan 4 2022, 12:26 PM · Roadmap 2021, meta-task, Documentation
moranegg closed T2624: Create strategy for documentation with a map or a full table of content, a subtask of T2233: Update documentation to current project status, as Resolved.
Jan 4 2022, 12:26 PM · Documentation, meta-task, Roadmap 2020
moranegg closed T3297: Prepare documentation sprints 2021, a subtask of T2624: Create strategy for documentation with a map or a full table of content, as Resolved.
Jan 4 2022, 12:09 PM · Roadmap 2021, meta-task, Documentation

Jan 3 2022

douardda added a comment to T3134: SWHID v2.

wishlist: it would be nice ot be able to check the whole hash of a revision/release even when the author name/email are replaced by a hash. (eg. by making SWHIDv2 a tree hash)

Jan 3 2022, 12:02 PM · Roadmap 2022, Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Dec 22 2021

vlorentz closed T3585: Fix inconsistencies of the Cassandra backend with postgres as Wontfix.
Dec 22 2021, 2:34 PM · meta-task, Storage manager
vlorentz closed T3585: Fix inconsistencies of the Cassandra backend with postgres, a subtask of T1892: Cassandra as a storage backend, as Wontfix.
Dec 22 2021, 2:34 PM · meta-task, Storage manager

Dec 17 2021

vlorentz added a comment to T3134: SWHID v2.

wishlist: it would be nice ot be able to check the whole hash of a revision/release even when the author name/email are replaced by a hash. (eg. by making SWHIDv2 a tree hash)

Dec 17 2021, 10:53 AM · Roadmap 2022, Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Dec 16 2021

olasd closed T1954: Up-to-date objstorage mirror on S3, a subtask of T3085: Complete and updated copy of the archive on S3 (objects+graph), as Resolved.
Dec 16 2021, 3:12 PM · Roadmap 2022, meta-task, Roadmap 2021, System administration, Object storage

Dec 15 2021

moranegg closed T3036: Create features/services page on the website connecting to archive/docs, a subtask of T2624: Create strategy for documentation with a map or a full table of content, as Resolved.
Dec 15 2021, 3:50 PM · Roadmap 2021, meta-task, Documentation
moranegg closed T3173: Provide access to deposit-clients to view dedicated moderation page, a subtask of T3128: Improve deposit integration, management and display, as Resolved.
Dec 15 2021, 2:18 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app

Dec 13 2021

ardumont changed the status of T3174: Filter deposit-admin view by deposit client on admin (moderation) page, a subtask of T3128: Improve deposit integration, management and display, from Open to Work in Progress.
Dec 13 2021, 11:27 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app

Dec 8 2021

dachary closed T3104: Persistent readonly perfect hash table, a subtask of T3054: Scale out object storage design, as Resolved.
Dec 8 2021, 5:07 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
rdicosmo added a comment to T3134: SWHID v2.

SWHID v2 should also prevent the hash collision issues we are currently facing (some related to the SHAttered attack on SHA1), see T3775 and SWH-LOADER-GIT-JT.

Dec 8 2021, 3:19 PM · Roadmap 2022, Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Dec 7 2021

anlambert added a comment to T3134: SWHID v2.

SWHID v2 should also prevent the hash collision issues we are currently facing (some related to the SHAttered attack on SHA1), see T3775 and SWH-LOADER-GIT-JT.

Dec 7 2021, 4:55 PM · Roadmap 2022, Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021

Dec 2 2021

vlorentz closed T3586: Figure out what to do with 'misordered' directories in Cassandra, a subtask of T3585: Fix inconsistencies of the Cassandra backend with postgres, as Resolved.
Dec 2 2021, 3:14 PM · meta-task, Storage manager
vlorentz closed T3605: Document the vault architecture, a subtask of T3604: Document the architecture of all major packages/components, as Resolved.
Dec 2 2021, 2:05 PM · meta-task, Documentation
vsellier closed T3357: Perform some tests of the cassandra storage on Grid5000, a subtask of T1892: Cassandra as a storage backend, as Resolved.
Dec 2 2021, 10:10 AM · meta-task, Storage manager

Nov 26 2021

vlorentz claimed T3594: Faithfully store weird git objects.
Nov 26 2021, 4:43 PM · meta-task, Data Model, Storage manager
vlorentz claimed T3753: Store original git manifests.
Nov 26 2021, 4:43 PM · Data Model, Storage manager
vlorentz triaged T3753: Store original git manifests as Normal priority.
Nov 26 2021, 4:43 PM · Data Model, Storage manager
vlorentz triaged T3752: Store/represent time offsets as strings as Normal priority.
Nov 26 2021, 4:42 PM · Data Model, Storage manager
vlorentz closed T3598: Support revisions with "extra headers" not at the end, a subtask of T3594: Faithfully store weird git objects, as Wontfix.
Nov 26 2021, 4:41 PM · meta-task, Data Model, Storage manager
vlorentz closed T3596: Support "weird" permissions in directories as Wontfix.

We decided to store manifests instead. T3594#74385

Nov 26 2021, 4:41 PM · meta-task, Data Model, Storage manager
vlorentz closed T3596: Support "weird" permissions in directories, a subtask of T3594: Faithfully store weird git objects, as Wontfix.
Nov 26 2021, 4:41 PM · meta-task, Data Model, Storage manager
vlorentz closed T3595: Support disordered directory entries in git, a subtask of T3594: Faithfully store weird git objects, as Wontfix.
Nov 26 2021, 4:41 PM · meta-task, Data Model, Storage manager
vlorentz closed T3595: Support disordered directory entries in git as Wontfix.

We decided to store manifests instead. T3594#74385

Nov 26 2021, 4:41 PM · meta-task, Data Model, Storage manager
vlorentz added a comment to T3594: Faithfully store weird git objects.

Copy of an email I sent today:

Nov 26 2021, 4:40 PM · meta-task, Data Model, Storage manager
vlorentz updated the task description for T3609: SWHIDv2: List issues with SWHIDv1 that should be fixed.
Nov 26 2021, 3:16 PM · Roadmap 2020, Data Model, Web app, Roadmap 2021

Nov 23 2021

zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed, a subtask of T2220: swh-graph in production, from Open to Work in Progress.
Nov 23 2021, 1:38 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

Nov 17 2021

ardumont triaged T3733: Develop a "Add forge now" mock-up as Normal priority.
Nov 17 2021, 11:23 AM · Roadmap 2021, Web app

Nov 15 2021

vlorentz added a parent task for T2220: swh-graph in production: T3550: Compute and show ETA for vault tasks.
Nov 15 2021, 9:55 AM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

Nov 9 2021

ardumont added a comment to T1538: Add "forge" now.

Is the request for regular pulling?

Nov 9 2021, 10:00 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
zack added a comment to T1538: Add "forge" now.

Is the request for regular pulling?
If yes, it should be added for visibility on the home page of the archive.
If no, it should be clear this is a one shot thing.

Nov 9 2021, 9:48 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021

Nov 8 2021

moranegg added a comment to T1538: Add "forge" now.

This is an example of a use-case in Open Science:
An institution has a forge and wishes to add the forge as a whole to SWH.

Nov 8 2021, 10:34 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
ardumont renamed T1538: Add "forge" now from Save "forge" now to Add "forge" now.
Nov 8 2021, 11:23 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021

Nov 4 2021

vsellier added a comment to T3129: Reliable monitoring of services: for users and for admins .

Current status:
Following the last discussions, the current track I'm trying to implement is to create a grafana dashboard displaying the current status of the infrastructure.
To do so, some information managed by grafana should be displayed like the end-to-end checks status.

Nov 4 2021, 5:10 PM · Roadmap 2022, Roadmap 2021, Monitoring, meta-task

Nov 2 2021

olasd moved T3054: Scale out object storage design from Backlog to RedHat collaboration on the Object storage board.
Nov 2 2021, 4:22 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task

Oct 27 2021

vlorentz updated the task description for T3594: Faithfully store weird git objects.
Oct 27 2021, 2:08 PM · meta-task, Data Model, Storage manager
vlorentz updated the task description for T3594: Faithfully store weird git objects.
Oct 27 2021, 2:03 PM · meta-task, Data Model, Storage manager
vlorentz updated the task description for T3594: Faithfully store weird git objects.
Oct 27 2021, 2:03 PM · meta-task, Data Model, Storage manager

Oct 22 2021

ardumont added a comment to T3595: Support disordered directory entries in git.

I came across a rather small repository [1] which i believe raise the same issue.
So it may help to keep its reference to ease the testing of the improvment discussed here.
Feel free to dismiss if not that useful.

Oct 22 2021, 1:54 PM · meta-task, Data Model, Storage manager

Oct 21 2021

moranegg added a subtask for T3128: Improve deposit integration, management and display: T3677: Separate origin-source-code and provenance-metadata in the deposit.
Oct 21 2021, 11:55 AM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
vlorentz added a revision to T3135: Improve integrity of ingested content: D6504: converters: Fix detection of tree entries with non-standard commit/tree mode..
Oct 21 2021, 10:57 AM · Storage manager, Roadmap 2021, meta-task

Oct 19 2021

ardumont updated the task description for T1538: Add "forge" now.
Oct 19 2021, 2:01 PM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021