Page MenuHomeSoftware Heritage

rdicosmo (Roberto Di Cosmo)
UserAdministrator

User Details

User Since
Sep 9 2015, 9:17 PM (292 w, 3 d)
Roles
Administrator

Recent Activity

Fri, Apr 16

rdicosmo added a comment to T3252: Better handling of erroneous origins submitted to save code now.

Thanks to all of you for this dicussion and proposals.

Fri, Apr 16, 1:39 PM · Roadmap 2021, System administrators, Web app
rdicosmo added a comment to T3256: Propose reason for rejecting a save code now.

Great. In addition to the content of the free form field, the standard answer should contain proper boilerplate reminding what is expected in a Save Code Now request, along the lines of what is written in the "Help" tab of https://archive.softwareheritage.org/save/

Fri, Apr 16, 1:24 PM · Easy hack, Roadmap 2021, Web app
rdicosmo added a comment to T2117: Save Code Now: End to End monitoring.

On a related note, it may be useful to regularly report requests that did not complete (either as success or failure) in a reasonable amount of time after being scheduled.

Fri, Apr 16, 9:06 AM · System administration, Monitoring, Roadmap 2021

Thu, Apr 15

rdicosmo triaged T3252: Better handling of erroneous origins submitted to save code now as Normal priority.
Thu, Apr 15, 10:47 PM · Roadmap 2021, System administrators, Web app
rdicosmo added a comment to T2912: Next generation archive counters.

This kind of journal client will be necessary in any case if we want to extend the usage of the counters for other perimeters (metadata count, origin per forge, ...)

Thu, Apr 15, 3:35 PM · Roadmap 2021, System administration, Monitoring, Web app
rdicosmo added a comment to T3084: Fast track save code now requests.

Pushed, packaged, deployed.

scheduler runner continues happily to schedule existing tasks and some new task with priority

Apr 15 13:12:51 saatchi swh[234257]: INFO:swh.scheduler.celery_backend.runner:Grabbed 2084 tasks load-git
Apr 15 13:12:54 saatchi swh[234257]: INFO:swh.scheduler.cli.admin.runner:Scheduled 4128 tasks
Apr 15 13:14:06 saatchi swh[234257]: INFO:swh.scheduler.celery_backend.runner:Grabbed 1 tasks load-pypi
Apr 15 13:14:06 saatchi swh[234257]: INFO:swh.scheduler.celery_backend.runner:Grabbed 1 tasks load-git (priority)
...

That task got done almost immediately...
So there you go ;)

Thu, Apr 15, 3:30 PM · System administration, Web app
rdicosmo added a comment to T2912: Next generation archive counters.

Staging webapp[1] and webapp1 on production [2] are now configured to use swh-counters to display the historical values and the live object counts.

Thu, Apr 15, 12:09 PM · Roadmap 2021, System administration, Monitoring, Web app

Wed, Apr 14

rdicosmo added a comment to T3084: Fast track save code now requests.

Great news :-)

Wed, Apr 14, 7:01 PM · System administration, Web app

Tue, Apr 13

rdicosmo committed rMSLD5beda4268f79: Slides for RDA SSC IG (authored by rdicosmo).
Slides for RDA SSC IG
Tue, Apr 13, 7:32 PM
rdicosmo committed R238:9cf42fd2074c: variant for renater gforge (authored by rdicosmo).
variant for renater gforge
Tue, Apr 13, 6:54 PM
rdicosmo added a comment to D267: [WIP] add first implementation of FusionForge lister.

What would left to do to make this lister work? It seems already in good state, and it would be useful to index gforge.inria.fr since it will be closed soon (https://gforge.inria.fr/forum/forum.php?forum_id=11543). For the gforge.inria.fr case specifically, it is worth noticing that project creation is closed already, so a one-shot listing could be an option if it is lighter to set up: I wrote a small script to do that, but after a few requests to https://archive.softwareheritage.org/save/, requests are throttled. I would be happy to send you a listing of the public projects hosted on gforge.inria.fr if it could help.

Tue, Apr 13, 5:00 PM
rdicosmo committed R238:4e2907a3f4fa: Prepare to generalize (authored by rdicosmo).
Prepare to generalize
Tue, Apr 13, 4:06 PM
rdicosmo raised the priority of T3087: Implement support for takedown notices (infra, admin tools, workflow) from Normal to High.
Tue, Apr 13, 2:53 PM · meta-task, Roadmap 2021, Web app
rdicosmo added a comment to T3247: Implement SWHID validation in frontend.

Ok, this is converging with the discussion in T3234: we fully agree that having proper errors reported to the user is the way to go, so let's forget about the "sanitization" approach.

Tue, Apr 13, 12:38 PM · Web app
rdicosmo added a comment to T3234: Handle gracefully trailing slashes when resolving SWHID in search box.
Tue, Apr 13, 12:23 PM · Web app
rdicosmo added a comment to D5485: docs/persistent-identifiers: Add guidelines for fixing invalid SWHIDs..

Ok, so no need to change the specification document for SWHIDs.

Tue, Apr 13, 12:06 PM
rdicosmo added a comment to T3234: Handle gracefully trailing slashes when resolving SWHID in search box.

@vlorentz , @anlambert : thanks for progressing the discussion on this issue.
After mulling over your inputs, here is my current understanding:

Tue, Apr 13, 12:00 PM · Web app
rdicosmo added a comment to T3247: Implement SWHID validation in frontend.

I wonder if this is not overkill: SWHID may evolve in the future, and maintaining two implementations (one of them in JS!) may be source of headaches down the line.
A simple "sanitization" phase in the frontend catching the most common issues (trailing slashes, leading or trailing tabs or spaces, etc.) would probably be enough for our purpose.

Tue, Apr 13, 11:34 AM · Web app

Sat, Apr 10

rdicosmo added a comment to T3234: Handle gracefully trailing slashes when resolving SWHID in search box.

As a compromise, we could accept this trailing slash, but show a warning on the interface and/or codify in the SWHID specification an exhaustive list of "fixes" that user interfaces can/should do.

Sat, Apr 10, 1:12 PM · Web app
rdicosmo added a comment to T3234: Handle gracefully trailing slashes when resolving SWHID in search box.

There are already many URLs in the open, so even if we remove the trailing slash now, that does not solve the problem.

Sat, Apr 10, 11:44 AM · Web app
rdicosmo triaged T3234: Handle gracefully trailing slashes when resolving SWHID in search box as Normal priority.
Sat, Apr 10, 11:16 AM · Web app
rdicosmo triaged T3233: Missing Apollo 11 virtual AGC repository from Google Code as Normal priority.
Sat, Apr 10, 9:32 AM · SVN Loader

Fri, Apr 9

rdicosmo raised the priority of T3230: Add various markdown variants to list of intrinsic metadata files to be indexed from Low to Normal.
Fri, Apr 9, 4:45 PM · Intrinsic metadata, Easy hack, Indexer
rdicosmo committed rMSLD7b622587a441: Added general Open Science presentation (authored by rdicosmo).
Added general Open Science presentation
Fri, Apr 9, 2:14 PM
rdicosmo updated the task description for T3230: Add various markdown variants to list of intrinsic metadata files to be indexed .
Fri, Apr 9, 1:33 PM · Intrinsic metadata, Easy hack, Indexer
rdicosmo created T3230: Add various markdown variants to list of intrinsic metadata files to be indexed .
Fri, Apr 9, 1:32 PM · Intrinsic metadata, Easy hack, Indexer

Tue, Apr 6

rdicosmo triaged T3213: Enable save code now of software bundles for specific users as Normal priority.
Tue, Apr 6, 9:33 PM · Roadmap 2021, Web app
rdicosmo assigned T3213: Enable save code now of software bundles for specific users to anlambert.
Tue, Apr 6, 9:32 PM · Roadmap 2021, Web app
rdicosmo added a subtask for T3082: Improve Save Code Now handling: T3213: Enable save code now of software bundles for specific users.
Tue, Apr 6, 9:32 PM · meta-task, Roadmap 2021, System administrators, Web app
rdicosmo added a parent task for T3213: Enable save code now of software bundles for specific users: T3082: Improve Save Code Now handling.
Tue, Apr 6, 9:32 PM · Roadmap 2021, Web app
rdicosmo created T3213: Enable save code now of software bundles for specific users.
Tue, Apr 6, 9:31 PM · Roadmap 2021, Web app
rdicosmo moved T3077: Ease integration of fundraising campaigns from Work in progress to Pending validation on the Roadmap 2021 board.
Tue, Apr 6, 11:45 AM · Community Building, Roadmap 2021, Website
rdicosmo committed rMSLD4570184c6adf: Update growth (authored by rdicosmo).
Update growth
Tue, Apr 6, 11:29 AM
rdicosmo committed rMSLD280818490775: Update to LLW talk (authored by rdicosmo).
Update to LLW talk
Tue, Apr 6, 11:16 AM
rdicosmo committed rMSLD994029b254db: Module deck (authored by rdicosmo).
Module deck
Tue, Apr 6, 11:05 AM
rdicosmo committed rMSLD9affd6c0f92f: DIG (authored by rdicosmo).
DIG
Tue, Apr 6, 11:05 AM

Mon, Apr 5

rdicosmo assigned T3128: Improve deposit integration, management and display to moranegg.
Mon, Apr 5, 12:13 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
rdicosmo updated subscribers of T3128: Improve deposit integration, management and display.
Mon, Apr 5, 12:13 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
rdicosmo added a parent task for T2540: support the loading of metadata-only deposits in the metadata storage: T3128: Improve deposit integration, management and display.
Mon, Apr 5, 12:13 PM · Roadmap 2020, SWORD deposit, Scientific Community Building
rdicosmo added a parent task for T2344: Build a connector for software deposit via Zenodo/InvenioRDM: T3128: Improve deposit integration, management and display.
Mon, Apr 5, 12:13 PM · Roadmap 2020, SWORD deposit, Scientific Community Building
rdicosmo added subtasks for T3128: Improve deposit integration, management and display: T2344: Build a connector for software deposit via Zenodo/InvenioRDM, T2540: support the loading of metadata-only deposits in the metadata storage.
Mon, Apr 5, 12:13 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
rdicosmo renamed T3128: Improve deposit integration, management and display from Improve deposit management and display to Improve deposit integration, management and display.
Mon, Apr 5, 12:12 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
rdicosmo closed T3204: Extract List of all IPOL deposits in csv, a subtask of T3192: Add possibility to fetch last SWHID for a deposit using an origin on deposit cli, as Resolved.
Mon, Apr 5, 11:52 AM · Easy hack, SWORD deposit
rdicosmo closed T3204: Extract List of all IPOL deposits in csv as Resolved.
Mon, Apr 5, 11:52 AM · Easy hack, SWORD deposit
rdicosmo added a comment to T3202: Help new users discover the features available in the archive browsing view.

Ok, this is the way we'll go, merging in T3196 that is now obsolete.

Mon, Apr 5, 10:52 AM · Web app
rdicosmo merged task T3196: Improve discoverability of the permalinks tab into T3202: Help new users discover the features available in the archive browsing view.
Mon, Apr 5, 10:49 AM · Web app
rdicosmo merged T3196: Improve discoverability of the permalinks tab into T3202: Help new users discover the features available in the archive browsing view.
Mon, Apr 5, 10:49 AM · Web app

Fri, Apr 2

rdicosmo added a subtask for T3202: Help new users discover the features available in the archive browsing view: T3196: Improve discoverability of the permalinks tab.
Fri, Apr 2, 10:10 AM · Web app
rdicosmo added a parent task for T3196: Improve discoverability of the permalinks tab: T3202: Help new users discover the features available in the archive browsing view.
Fri, Apr 2, 10:10 AM · Web app
rdicosmo triaged T3202: Help new users discover the features available in the archive browsing view as Normal priority.
Fri, Apr 2, 10:10 AM · Web app
rdicosmo updated the task description for T3196: Improve discoverability of the permalinks tab.
Fri, Apr 2, 9:55 AM · Web app
rdicosmo added a comment to T3196: Improve discoverability of the permalinks tab.

Let me make explicit a key requirement that apparently is not as obvious as I thought: the improvement we look for must not change the current UI in any way. Remember that we have tutorials, papers, instructions all over the place with the current UI, and many active users of the current UI, including journals that have trained their vendors about it, and are quite happy: it is too late (and counterproductive) to make changes now. Please do not debate this point: it is a firm decision.

Fri, Apr 2, 9:48 AM · Web app

Thu, Apr 1

rdicosmo triaged T3196: Improve discoverability of the permalinks tab as Normal priority.
Thu, Apr 1, 7:48 PM · Web app
rdicosmo committed R238:53ca45741ecc: Simple script to save the Inria gForge one repo at a time (authored by rdicosmo).
Simple script to save the Inria gForge one repo at a time
Thu, Apr 1, 6:50 PM
rdicosmo triaged T3195: Some SWHIDs provided by the WebApp produce 404 when resolved as High priority.
Thu, Apr 1, 3:56 PM · Web app

Wed, Mar 31

rdicosmo updated the task description for T1538: Save "forge" now.
Wed, Mar 31, 12:35 PM · meta-task, Roadmap 2021, Web app

Mon, Mar 29

rdicosmo committed rMSLDa7712c4d342a: Add simple script to generate expanded imports for a list of modules (authored by rdicosmo).
Add simple script to generate expanded imports for a list of modules
Mon, Mar 29, 11:32 AM
rdicosmo committed rMSLD83984b37df5d: update (authored by rdicosmo).
update
Mon, Mar 29, 11:32 AM

Fri, Mar 19

rdicosmo moved T2220: swh-graph in production from Backlog to Work in progress on the Roadmap 2021 board.
Fri, Mar 19, 12:45 PM · meta-task, Roadmap 2021, Graph service

Mar 17 2021

rdicosmo added a comment to T1724: Maven Central repository Lister.

After recent exchanges with @hboutemy and Charles Sabourdin, here is a clarification of the scope of this task.
We need a Maven repository lister that addresses the following issues:

Mar 17 2021, 10:40 AM · GSoC 2019, Archive coverage

Mar 15 2021

rdicosmo moved T3112: Provenance index for the full archive from Backlog to Work in progress on the Roadmap 2021 board.
Mar 15 2021, 9:10 PM · Roadmap 2021, meta-task
rdicosmo moved T3119: FAQ from Backlog to Work in progress on the Roadmap 2021 board.
Mar 15 2021, 9:10 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo moved T3077: Ease integration of fundraising campaigns from Backlog to Work in progress on the Roadmap 2021 board.
Mar 15 2021, 9:10 PM · Community Building, Roadmap 2021, Website
rdicosmo moved T2912: Next generation archive counters from Backlog to Work in progress on the Roadmap 2021 board.
Mar 15 2021, 9:09 PM · Roadmap 2021, System administration, Monitoring, Web app
rdicosmo updated the task description for T2202: Extrinsic metadata.
Mar 15 2021, 9:08 PM · meta-task, Roadmap 2021, Extrinsic metadata
rdicosmo added a parent task for T3112: Provenance index for the full archive: T3136: Prior art detection service.
Mar 15 2021, 8:59 PM · Roadmap 2021, meta-task
rdicosmo added a subtask for T3136: Prior art detection service: T3112: Provenance index for the full archive.
Mar 15 2021, 8:59 PM · Code scanner, Scientific Community Building, Roadmap 2021, meta-task
rdicosmo added a project to T3136: Prior art detection service: Code scanner.
Mar 15 2021, 8:58 PM · Code scanner, Scientific Community Building, Roadmap 2021, meta-task
rdicosmo created T3136: Prior art detection service.
Mar 15 2021, 8:57 PM · Code scanner, Scientific Community Building, Roadmap 2021, meta-task
rdicosmo added a subtask for T3135: Improve integrity of ingested content: T399: (Re-)Compute data checksums before insertion.
Mar 15 2021, 8:48 PM · Storage manager, Roadmap 2021, meta-task
rdicosmo added a parent task for T399: (Re-)Compute data checksums before insertion: T3135: Improve integrity of ingested content.
Mar 15 2021, 8:48 PM · Storage manager
rdicosmo created T3135: Improve integrity of ingested content.
Mar 15 2021, 8:47 PM · Storage manager, Roadmap 2021, meta-task
rdicosmo updated the task description for T3134: SWHID v2.
Mar 15 2021, 8:11 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021
rdicosmo created T3134: SWHID v2.
Mar 15 2021, 8:09 PM · Roadmap 2020, Data Model, Web app, meta-task, Roadmap 2021
rdicosmo added a subtask for T2234: Write use case-specific documentation: T3035: Triage documentation in wiki.
Mar 15 2021, 8:01 PM · Roadmap 2021, meta-task, Documentation
rdicosmo added a parent task for T3035: Triage documentation in wiki: T2234: Write use case-specific documentation.
Mar 15 2021, 8:01 PM · Documentation
rdicosmo updated the task description for T2234: Write use case-specific documentation.
Mar 15 2021, 7:59 PM · Roadmap 2021, meta-task, Documentation
rdicosmo added a parent task for T3118: Documentation for users and ambassadors: T2234: Write use case-specific documentation.
Mar 15 2021, 7:57 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo added a subtask for T2234: Write use case-specific documentation: T3118: Documentation for users and ambassadors.
Mar 15 2021, 7:57 PM · Roadmap 2021, meta-task, Documentation
rdicosmo added a subtask for T3118: Documentation for users and ambassadors: T3119: FAQ.
Mar 15 2021, 7:56 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo added a parent task for T3119: FAQ: T3118: Documentation for users and ambassadors.
Mar 15 2021, 7:56 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo removed a parent task for T3119: FAQ: T3118: Documentation for users and ambassadors.
Mar 15 2021, 7:56 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo removed a parent task for T2234: Write use case-specific documentation: T3118: Documentation for users and ambassadors.
Mar 15 2021, 7:56 PM · Roadmap 2021, meta-task, Documentation
rdicosmo removed subtasks for T3118: Documentation for users and ambassadors: T3119: FAQ, T2234: Write use case-specific documentation.
Mar 15 2021, 7:56 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo edited projects for T2234: Write use case-specific documentation, added: Documentation; removed Roadmap 2021, meta-task.
Mar 15 2021, 7:52 PM · Roadmap 2021, meta-task, Documentation
rdicosmo edited projects for T2234: Write use case-specific documentation, added: meta-task, Roadmap 2021; removed Roadmap 2020.
Mar 15 2021, 7:50 PM · Roadmap 2021, meta-task, Documentation
rdicosmo added a comment to T3092: Define the requirements for an on-premise Cassandra cluster.

Let's organise a call next week to explore the options, including the new opportunities of testing that emerged recently.

Mar 15 2021, 1:57 PM · System administration, Storage manager
rdicosmo added a comment to T3092: Define the requirements for an on-premise Cassandra cluster.

Did you consider PMem (and other configurations for Intel Optane memory) in your discussion? It offers a very interesting price/performance ratio.
There are machines on Grid5000 available to test this technology if needed.

Mar 15 2021, 1:21 PM · System administration, Storage manager
rdicosmo closed T3006: Upload Roberto's podcast on RFI as Resolved.
Mar 15 2021, 9:21 AM · Unknown Object (Project)

Mar 14 2021

rdicosmo moved T3006: Upload Roberto's podcast on RFI from Restricted Project Column to Restricted Project Column on the Unknown Object (Project) board.
Mar 14 2021, 8:20 PM · Unknown Object (Project)
rdicosmo closed T3103: Blog post on Easter-eggs collaboration as Resolved.
Mar 14 2021, 8:19 PM · Unknown Object (Project)
rdicosmo created T3129: Reliable monitoring of services: for users and for admins .
Mar 14 2021, 8:17 PM · Roadmap 2021, Monitoring, meta-task
rdicosmo created T3128: Improve deposit integration, management and display.
Mar 14 2021, 8:08 PM · meta-task, Roadmap 2021, Monitoring, SWORD deposit, Web app
rdicosmo updated subscribers of T3127: Compute and display distribution of origins by forge.
Mar 14 2021, 8:00 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task
rdicosmo edited projects for T1363: Have metrics in prometheus for each tracked forge, added: Roadmap 2021; removed Restricted Project.
Mar 14 2021, 7:58 PM · Roadmap 2021, Metrics/monitoring, System administration
rdicosmo created T3127: Compute and display distribution of origins by forge.
Mar 14 2021, 7:56 PM · Metrics/monitoring, Web app, Roadmap 2021, meta-task

Mar 11 2021

rdicosmo added a comment to T1724: Maven Central repository Lister.

@hboutemy : I wonder if you are aware that we have now in place a grant program that allows to fund development of listers like this one.
All the information is available at https://www.softwareheritage.org/grants and you can mail me for more info if needed.

Mar 11 2021, 8:32 PM · GSoC 2019, Archive coverage
rdicosmo added a project to T2912: Next generation archive counters: Roadmap 2021.
Mar 11 2021, 8:25 PM · Roadmap 2021, System administration, Monitoring, Web app
rdicosmo changed the status of T3119: FAQ, a subtask of T3118: Documentation for users and ambassadors, from Open to Work in Progress.
Mar 11 2021, 8:24 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task
rdicosmo changed the status of T3119: FAQ from Open to Work in Progress.

Work is in progress with the first academic ambassador.

Mar 11 2021, 8:24 PM · Scientific Community Building, Community Building, Roadmap 2021, meta-task