@anlambert Can you take this diff from here?
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed All Stories
All Stories
All Stories
Nov 16 2021
Nov 16 2021
anlambert requested review of D6641: browse/snapshot_context: Handle snapshot containing only releases.
vlorentz triaged T3731: Try parallelizing directory_get_entries with an async swh-storage client as Normal priority.
vlorentz updated the test plan for D6640: Add a button to the deposit admin UI to show deposit metadata.
- Does the icinga check for the journalbeat position still work? I assume so, as the config for it is still there.
I think so too but I will double check to be sure
good point, it seems it's not working anymore, the new version of logstash is silently ignoring the property
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO0b1b158dc102: Updated debian changelog for version 0.40.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.40.0
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOd092197c0d4f: pristine-tar data for swh-storage_0.40.0.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-storage_0.40.0.orig.tar.gz
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO1b6c7fcf5a29: Update upstream source from tag 'debian/upstream/0.40.0' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.40.0'
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOd8994d5e5dbf: New upstream version 0.40.0 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.40.0
Nov 15 2021
Nov 15 2021
- create banner with the SWHAP tree
- change title to: The Pisa collection
- Add subtitle: Stories of landmark legacy code
- Beta version note
- Add link from "Archive" menu with "Browse Software Stories (Beta)" to stories.softwareheritage.org
Alternative hardware bill of material:
Build is green
ra: Remove global variables.
I think just showing how many are already cooked would be a huge improvement. Then users would at least be able to observe progress happening. The current system just indicates 'processing' so it is not obvious if it is actually doing something or perhaps the task died.
- Do we really care about running as a separate user? Maybe avoiding a gratuitous divergence from upstream would be worth it.
Nope, I keep it to remains as close as what we have today, I can let it per default and add the cleanup of the user previously created
- Could you fully update the config template to the new default config?
Yep, I will try to automize that
- Does the icinga check for the journalbeat position still work? I assume so, as the config for it is still there.
I think so too but I will double check to be sure
- Should we consider moving to cursor_seek_fallback: tail to work around the issues with the old indexes needing to be reopened, when rebooting a machine? This should not apply as the cursor state should be saved on service shutdown, but maybe it isn't being read back properly...
I will also try this because the upgrade changed nothing, the current behavior is reproduced locally with the new version when I restart the vms
anlambert changed the status of T3724: Browsing snapshot with only releases does not show anything in the webapp from Open to Work in Progress.
Build is green
add docstring, remove debug print
Thanks for working on this!
Looks good to me, better indeed.
Add missing URL escape
douardda renamed T3730: Add a "user support" mechanism to the archive from Add a to Add a "user support" mechanism in the archive.
they were just surprisingly long tasks; T3727 should help with this
the cooking has completed now
anlambert added a comment to T3695: Investigate revision reconstruction discrepancy with subversion export.
anlambert added a comment to T3728: Display snapshots with only releases (or a release as HEAD branch).
Duplicate of T3724 I think
anlambert committed rDWAPPSfe8c3b38bb64: assets/xss-filtering: Ensure to use correct directory (authored by anlambert).
assets/xss-filtering: Ensure to use correct directory
anlambert committed rDWAPPSe0f33695c7b3: assets/xss-filtering: Strip any query parameters from img src attribute (authored by anlambert).
assets/xss-filtering: Strip any query parameters from img src attribute
vsellier retitled D6634: elk: upgrade elasticsearch and kibana nodes from elk: upgrade elasticsearcha and kibana nodes to elk: upgrade elasticsearch and kibana nodes.
vlorentz raised the priority of T3728: Display snapshots with only releases (or a release as HEAD branch) from Normal to High.
vlorentz triaged T3728: Display snapshots with only releases (or a release as HEAD branch) as Normal priority.
(marking T2220 as dependency, because we need an up-to-date graph to show an ETA on objects loaded in the last ~year)
vlorentz added a parent task for T2220: swh-graph in production: T3550: Compute and show ETA for vault tasks.
vlorentz added a subtask for T3550: Compute and show ETA for vault tasks: T2220: swh-graph in production.
vsellier updated the task description for T3357: Perform some tests of the cassandra storage on Grid5000.
Nov 13 2021
Nov 13 2021
rdicosmo renamed T3723: Organize FORCE2021 Software Citation Hackathon from Organize FORCE2021 Sofwtare Citation Hackathon to Organize FORCE2021 Software Citation Hackathon.
A task to add to this hackaton:
- add to https://github.com/citation-file-format/ruby-cff/tree/main/test/files/formatted a few examples of Bib(La)TeX entries for software and their corresponding .cff
- this will ensure that the cff-latex exporter produces proper biblatex-software entries, and uses all the available fields in biblatex-software
- since .cff is not able to handle BibTeX's crossref fields, use the expanded entries attached to this task
biblatex-software_expanded.bib4 KBDownload
Nov 12 2021
Nov 12 2021
Another problem with keyword expansion found during testing:
stsp added a revision to T3691: Implement CVS loader: D6638: preserve empty lines in CVS log messages over pserver.
Nov 11 2021
Nov 11 2021
check in slides for SFScon 2021 talk
status module: update total size figure
Nov 10 2021
Nov 10 2021
@ardumont For production, drop the / at the end of the url, in staging, it's duplicated...
ardumont changed the status of T3717: Ingest opam instance https://coq.inria.fr/opam/released/ from Open to Work in Progress.
ardumont added a project to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: System administration.
This got added to the staging infrastructure which lead to some surprises.
This mostly got fixed in the commits ^.
For the record, the upgrade of esnode[1-3] to bullseye is ok (in vagrant).
The upgrade is done without errors, puppet is green. A reinstall from scratch is also working well without warning.
The diff to prepare the migration of filebeat and journalbeat are ready. If everything is good after the review, the upgrade will be perform at the beginning of the W46.
ardumont committed rSPSITEc95aa871a3ed: Unstuck opam loader loading for the default opam.ocaml.org instance (authored by ardumont).
Unstuck opam loader loading for the default opam.ocaml.org instance
Rename properly the instances 2/2
Rename properly the instance
ardumont retitled D6637: opam: Stop leaking temporary folders on machine during tests from opam: Stop leaking temporary folders on machine to opam: Stop leaking temporary folders on machine during tests.
ardumont committed rSPSITEcf710f7fbcfd: opam: No private /tmp since it's shared amongst process (authored by ardumont).
opam: No private /tmp since it's shared amongst process
My tasks before the event:
- prepare Google doc
https://docs.google.com/document/d/1r5nIc5JdoiZmsTMqQhYYSGqW0fcfuO9WrbVi1amfJYY/edit?usp=sharing
- invite Alain and a SWH team memeber (if validated)
- send information to the RDA SSC IG, FAIR4RS, RDA France and Force11 mailing lists (maybe also the SWH open science community?)
ardumont closed T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3, a subtask of T3636: Make the opam loader write extrinsic metadata, as Resolved.
ardumont placed T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3 up for grabs.
ardumont triaged T3725: deposit: hal-preprod can be removed from the production deposit as Normal priority.
ardumont triaged T3724: Browsing snapshot with only releases does not show anything in the webapp as Normal priority.
ardumont added a comment to T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3.
At least loader deposit and npm [1] are fine.
ardumont updated the task description for T3722: staging: Deploy package loader v1.0, deposit server v0.16, lister v2.3.
In P1216#8173, @ardumont wrote:then browse them simply with their origins:
moranegg changed the status of T3723: Organize FORCE2021 Software Citation Hackathon from Open to Work in Progress.
16:04:47 swh@db1:5432=> select * from origin_visit_status ovs inner join origin o on ovs.origin=o.id where date > '2021-11-10 15:00' and type='npm' and status='full' limit 10; +---------+-------+-------------------------------+--------+----------+--------------------------------------------+------+---------+-----------------------------------------------------------+ | origin | visit | date | status | metadata | snapshot | type | id | url | +---------+-------+-------------------------------+--------+----------+--------------------------------------------+------+---------+-----------------------------------------------------------+ | 1796368 | 1 | 2021-11-10 15:00:50.801616+00 | full | (null) | \x1291f77517a284ff82d0298459b0763db02bf45f | npm | 1796368 | https://www.npmjs.com/package/time_format | | 1796371 | 1 | 2021-11-10 15:00:58.16354+00 | full | (null) | \x38138aced5fbc78af7b747aa2328f1b186ab6c75 | npm | 1796371 | https://www.npmjs.com/package/rnpack | | 1796376 | 1 | 2021-11-10 15:01:14.872231+00 | full | (null) | \xbe2f39fc54cc6a377f1de23ac7d9ca15f8713b63 | npm | 1796376 | https://www.npmjs.com/package/voltrazord-layout | | 1796362 | 1 | 2021-11-10 15:00:22.221484+00 | full | (null) | \x034b93485d1fc0a0efc9dd3447b1f7a92e278041 | npm | 1796362 | https://www.npmjs.com/package/angular-phonecat-nexen | | 1796383 | 1 | 2021-11-10 15:01:37.730797+00 | full | (null) | \xc6d7fd8acf765169a1cc292595952396907568f7 | npm | 1796383 | https://www.npmjs.com/package/redsee-server | | 1796363 | 1 | 2021-11-10 15:00:30.255544+00 | full | (null) | \x75afd71f0ead0456acbc8777e2ff90a5a7726e46 | npm | 1796363 | https://www.npmjs.com/package/replace-task-webpack-plugin | | 1796373 | 1 | 2021-11-10 15:01:02.074164+00 | full | (null) | \xcf089d05b811cb5ca1db6d362efb490b78c8def2 | npm | 1796373 | https://www.npmjs.com/package/chloe | | 1796356 | 1 | 2021-11-10 15:00:17.16698+00 | full | (null) | \x6f9084961682cf79cdcdc681bcd5d36220bf635a | npm | 1796356 | https://www.npmjs.com/package/stf-device-db | | 1796359 | 1 | 2021-11-10 15:00:34.214132+00 | full | (null) | \xa4cfed37ca7c938cf829067cd9e2c4b7dfa40310 | npm | 1796359 | https://www.npmjs.com/package/pp-harness | | 1796364 | 1 | 2021-11-10 15:00:38.731256+00 | full | (null) | \xdbe09bd7abbd9b841dc4d2bea32e04b6d48c185e | npm | 1796364 | https://www.npmjs.com/package/react-native-badge | +---------+-------+-------------------------------+--------+----------+--------------------------------------------+------+---------+-----------------------------------------------------------+ (10 rows)
then browse them simply with their origins: