Page MenuHomeSoftware Heritage
Feed All Stories

Nov 8 2021

swh-public-ci added a comment to D6616: Make package loaders write releases instead of revisions.

Build is green

Nov 8 2021, 2:26 PM
vlorentz added a comment to D6601: ra: Fix export of non link file with svn:special property set.

I'm getting this when running the test on my machine, any idea why?

Nov 8 2021, 2:18 PM
anlambert closed D6611: loader: Perform a complete reloading when detecting altered history.
Nov 8 2021, 2:14 PM
anlambert committed rDLDSVN057e00bf93dc: loader: Perform a complete reloading when detecting altered history (authored by anlambert).
loader: Perform a complete reloading when detecting altered history
Nov 8 2021, 2:14 PM
vlorentz committed rDCORE8edcb95cd09f: Require pytest-postgresql < 4.0 (authored by vlorentz).
Require pytest-postgresql < 4.0
Nov 8 2021, 2:09 PM
vlorentz closed D6619: Require pytest-postgresql < 4.0.
Nov 8 2021, 2:09 PM
vlorentz accepted D6601: ra: Fix export of non link file with svn:special property set.
Nov 8 2021, 2:02 PM
ardumont accepted D6619: Require pytest-postgresql < 4.0.
Nov 8 2021, 2:02 PM
olasd accepted D6619: Require pytest-postgresql < 4.0.
Nov 8 2021, 2:02 PM
vlorentz requested review of D6619: Require pytest-postgresql < 4.0.
Nov 8 2021, 2:00 PM
Harbormaster failed remote builds in B24903: Diff 24029 for D6616: Make package loaders write releases instead of revisions!
Nov 8 2021, 1:54 PM
swh-public-ci added a comment to D6616: Make package loaders write releases instead of revisions.

Build has FAILED

Nov 8 2021, 1:54 PM
ardumont added inline comments to D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 1:54 PM
ardumont added inline comments to D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 1:54 PM
vlorentz added inline comments to D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 1:53 PM
vlorentz updated the diff for D6616: Make package loaders write releases instead of revisions.

fix bad copy-paste in test example

Nov 8 2021, 1:52 PM
ardumont accepted D6602: loader: Fix error when first revision number is not one.
Nov 8 2021, 12:29 PM
ardumont accepted D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 12:28 PM
ardumont added 1 blocking reviewer(s) for D6616: Make package loaders write releases instead of revisions: Reviewers.
Nov 8 2021, 12:28 PM
ardumont added a comment to D6616: Make package loaders write releases instead of revisions.

lgtm

Nov 8 2021, 12:28 PM
ardumont added inline comments to D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 12:24 PM
vlorentz updated the summary of D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 12:24 PM
vlorentz updated the summary of D6616: Make package loaders write releases instead of revisions.
Nov 8 2021, 12:24 PM
ardumont added a comment to D6602: loader: Fix error when first revision number is not one.

Any idea why this happens?

Nov 8 2021, 12:23 PM
ardumont accepted D6617: Use release instead of revision as anchor in SWHID context instead..
Nov 8 2021, 12:16 PM
ardumont accepted D6611: loader: Perform a complete reloading when detecting altered history.

I'd make the debug message into an info one but that's fine as it is.

Nov 8 2021, 12:10 PM
vlorentz added a revision to T3636: Make the opam loader write extrinsic metadata: D6606: opam: Write package definitions to the extrinsic metadata storage.
Nov 8 2021, 11:58 AM · Extrinsic metadata, Opam
vlorentz added a task to D6606: opam: Write package definitions to the extrinsic metadata storage: T3636: Make the opam loader write extrinsic metadata.
Nov 8 2021, 11:58 AM
vlorentz added a task to D6617: Use release instead of revision as anchor in SWHID context instead.: T3638: Make package loaders create releases objects instead of revisions.
Nov 8 2021, 11:58 AM
vlorentz added a task to D6616: Make package loaders write releases instead of revisions: T3638: Make package loaders create releases objects instead of revisions.
Nov 8 2021, 11:58 AM
vlorentz added revisions to T3638: Make package loaders create releases objects instead of revisions: D6616: Make package loaders write releases instead of revisions, D6617: Use release instead of revision as anchor in SWHID context instead..
Nov 8 2021, 11:58 AM · Package Loader, Data Model, Archive content
vlorentz added a comment to T3638: Make package loaders create releases objects instead of revisions.

Here is an overview of the fields (+ internal version name + branch name) used by each package loader, after D6616:

Nov 8 2021, 11:50 AM · Package Loader, Data Model, Archive content
ardumont accepted D6610: Give model and swhid objects a nicer repr().
Nov 8 2021, 11:50 AM
vsellier closed T3702: [objstorage] Support a basic authentication configuration as Resolved.

The basic auth is working with the default remote implementation if the credentials are specified in the url like https://user:password@objstorage_url

Nov 8 2021, 11:48 AM · System administration, Object storage
vsellier added a comment to T3683: cassandra - benchmark the vault.

not on the cassandra side

Nov 8 2021, 11:40 AM · System administration
ardumont abandoned D6550: wip: Log full pack size and check pack file limit after log instruction.

Closing to avoid diff clutter.

Nov 8 2021, 11:37 AM
ardumont accepted D6608: loader: Implement post_load to check for revision divergence.

good idea.

Nov 8 2021, 11:36 AM
ardumont triaged T3716: Migrate giverny from stretch to buster as Normal priority.
Nov 8 2021, 11:29 AM · System administration (Component upgrades)
moranegg edited projects for T3342: Collect material for software stories prototype, added: Software Stories; removed Unknown Object (Project).
Nov 8 2021, 11:24 AM · Software Stories
marla.dasilva created T3715: [Duplicate] Blog post Recommendation Open Science (Unesco) and French infrastructure roadmap.
Nov 8 2021, 11:24 AM · Unknown Object (Project)
ardumont renamed T1538: Add "forge" now from Save "forge" now to Add "forge" now.
Nov 8 2021, 11:23 AM · Add Forge Now , Roadmap 2022, meta-task, Roadmap 2021
vlorentz added inline comments to D6593: handle Attic-only RCS files over CVS pserver.
Nov 8 2021, 10:51 AM
vlorentz accepted D6611: loader: Perform a complete reloading when detecting altered history.
Nov 8 2021, 10:49 AM
vlorentz accepted D6608: loader: Implement post_load to check for revision divergence.
Nov 8 2021, 10:48 AM
vlorentz accepted D6614: assets/xss-filtering: Strip any query parameters from img src attribute.
Nov 8 2021, 10:45 AM
marla.dasilva triaged T3714: Blog post Giving Tuesday as High priority.
Nov 8 2021, 10:27 AM · Unknown Object (Project)
vlorentz added a comment to T3683: cassandra - benchmark the vault.

@vsellier Did you have swh-graph enabled in the vault configuration for these benchmarks?

Nov 8 2021, 10:27 AM · System administration
marla.dasilva created T3713: Blog post all ambassadors.
Nov 8 2021, 10:08 AM · Unknown Object (Project)
marla.dasilva created T3712: Blog post UNESCO event.
Nov 8 2021, 10:05 AM · Unknown Object (Project)
marla.dasilva created T3711: Newsletter.
Nov 8 2021, 10:04 AM · Unknown Object (Project)
marla.dasilva created T3710: Blog post SWH stories.
Nov 8 2021, 10:03 AM · Unknown Object (Project)
vsellier closed T3683: cassandra - benchmark the vault, a subtask of T3357: Perform some tests of the cassandra storage on Grid5000, as Resolved.
Nov 8 2021, 9:55 AM · System administration, Storage manager
vsellier closed T3683: cassandra - benchmark the vault as Resolved.
Nov 8 2021, 9:55 AM · System administration

Nov 7 2021

borisbaldassari added a comment to D6395: lister: Add new maven lister.

I will let you know when the full chain is executed.

Nov 7 2021, 10:17 PM

Nov 5 2021

olasd added a comment to T3707: Use local disks for worker scratch space.

On the three hypervisors currently running workers (hypervisor3, branly, pompidou), I've created a thin LVM pool for scratch data, using the following commands:

Nov 5 2021, 3:13 PM · System administration
olasd updated the task description for T3707: Use local disks for worker scratch space.
Nov 5 2021, 3:11 PM · System administration
olasd updated the task description for T3707: Use local disks for worker scratch space.
Nov 5 2021, 3:07 PM · System administration
olasd added a comment to T3707: Use local disks for worker scratch space.

I've kicked a SSD out of branly and hypervisor3's ceph allocation; ceph is currently rebalancing.

Nov 5 2021, 3:06 PM · System administration
stsp added a comment to T3691: Implement CVS loader.

Status update:

Nov 5 2021, 2:31 PM · CVS loader, Archive coverage
vsellier triaged T3708: Upgrade swh-search elasticsearch version as Normal priority.
Nov 5 2021, 2:31 PM · Archive search, System administration (Component upgrades)
olasd triaged T3707: Use local disks for worker scratch space as Normal priority.
Nov 5 2021, 2:20 PM · System administration
olasd added a comment to T3705: Upgrade the ELK stack.

FWIW the main blocker for upgrading journalbeat is a change in the target mapping, which will need some adaptations in our log routing (between systemlogs and swh_workers), as well as, well, an updated mapping on the target indexes!

Nov 5 2021, 2:14 PM · System administration (Component upgrades)
swh-public-ci added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Build is green

Nov 5 2021, 2:09 PM
swh-public-ci added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Build is green

Nov 5 2021, 2:06 PM
vsellier edited projects for T3579: Meta-task: upgrade infrastructure to Debian Bullseye, added: System administration (Component upgrades); removed System administration.
Nov 5 2021, 2:00 PM · System administration (Component upgrades)
vsellier triaged T3706: (Minor) upgrade Opnsense to 21.1.9 as High priority.
Nov 5 2021, 1:58 PM · System administration (Component upgrades)
swh-public-ci added a comment to D6593: handle Attic-only RCS files over CVS pserver.

Build is green

Nov 5 2021, 1:56 PM
stsp updated the diff for D6593: handle Attic-only RCS files over CVS pserver.
  • apply style change in fetch_rlog() suggested by vlorentz
Nov 5 2021, 1:54 PM
anlambert updated the diff for D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Update license header

Nov 5 2021, 1:53 PM
vsellier renamed T3705: Upgrade the ELK stack from Upgrade the LK stack to Upgrade the ELK stack.
Nov 5 2021, 1:53 PM · System administration (Component upgrades)
vsellier triaged T3705: Upgrade the ELK stack as Normal priority.
Nov 5 2021, 1:53 PM · System administration (Component upgrades)
swh-public-ci added a comment to D6593: handle Attic-only RCS files over CVS pserver.

Build is green

Nov 5 2021, 1:52 PM
anlambert updated the diff for D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Update: Ensure to pass a valid url to URL constructor and encode path query parameter value

Nov 5 2021, 1:51 PM
vlorentz requested review of D6617: Use release instead of revision as anchor in SWHID context instead..
Nov 5 2021, 1:51 PM
stsp updated the diff for D6593: handle Attic-only RCS files over CVS pserver.

fix mypy errors with much help from vlorentz

Nov 5 2021, 1:50 PM
vsellier edited Description on System administration (Component upgrades).
Nov 5 2021, 1:50 PM
swh-public-ci added a comment to D6590: add support for RCS keyword expansion over pserver protocol.

Build is green

Nov 5 2021, 1:49 PM
stsp updated the diff for D6590: add support for RCS keyword expansion over pserver protocol.

add docstring to cvsclient's checkout() function

Nov 5 2021, 1:48 PM
anlambert added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Then when doing this:

directoryUrl += `?path=${path}`;

directoryUrl will end with ?path=/path&/foo and that's not good

Nov 5 2021, 1:45 PM
vlorentz committed rDLDCVS7e2d8d8996ff: Remove debug code (authored by vlorentz).
Remove debug code
Nov 5 2021, 1:38 PM
vlorentz added inline comments to D6598: Add type annotations.
Nov 5 2021, 1:36 PM
vlorentz closed D6598: Add type annotations.
Nov 5 2021, 1:36 PM
vlorentz committed rDLDCVSbab0a5c61fc2: Add type annotations (authored by vlorentz).
Add type annotations
Nov 5 2021, 1:36 PM
swh-public-ci added a comment to D6590: add support for RCS keyword expansion over pserver protocol.

Build is green

Nov 5 2021, 1:35 PM
vlorentz added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

Then when doing this:

Nov 5 2021, 1:35 PM
stsp updated the diff for D6590: add support for RCS keyword expansion over pserver protocol.

removed cvsclient.py test code

Nov 5 2021, 1:34 PM
vlorentz requested review of D6616: Make package loaders write releases instead of revisions.
Nov 5 2021, 1:29 PM
stsp added inline comments to D6598: Add type annotations.
Nov 5 2021, 1:29 PM
vsellier created System administration (Component upgrades).
Nov 5 2021, 1:27 PM
stsp accepted D6598: Add type annotations.
Nov 5 2021, 1:26 PM
stsp added inline comments to D6593: handle Attic-only RCS files over CVS pserver.
Nov 5 2021, 1:25 PM
jayeshv added a revision to T3608: Deprecate most of the /browse/origin/.* URLs: D6615: Deprecate /origin/content route.
Nov 5 2021, 1:25 PM · Web app
jayeshv added a revision to T3697: Deprecate origin content routes: D6615: Deprecate /origin/content route.
Nov 5 2021, 1:25 PM · Web app
olasd committed rSPSITE99fa4be1e982: Fix more buggy icinga syntax... (authored by olasd).
Fix more buggy icinga syntax...
Nov 5 2021, 1:20 PM
anlambert added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

What if there is a & character in the path?

Not an issue, URL object will correctly parse it as part of the path.

>>> s = "http://example.org/path&/foo?service=swh&query=bar"
"http://example.org/path&/foo?service=swh&query=bar"
>>> new URL(s)
URL { href: "http://example.org/path&/foo?service=swh&query=bar", origin: "http://example.org", protocol: "http:", username: "", password: "", host: "example.org", hostname: "example.org", port: "", pathname: "/path&/foo", search: "?service=swh&query=bar" }
Nov 5 2021, 1:11 PM
vlorentz added a comment to D6614: assets/xss-filtering: Strip any query parameters from img src attribute.

What if there is a & character in the path?

Nov 5 2021, 1:03 PM
olasd committed rSPSITE2de871aeaddf: Disable parsing of check_systemd description (authored by olasd).
Disable parsing of check_systemd description
Nov 5 2021, 12:32 PM
olasd committed rSPSITE275673f6a82a: Improve check_systemd configuration (authored by olasd).
Improve check_systemd configuration
Nov 5 2021, 12:29 PM
anlambert requested review of D6614: assets/xss-filtering: Strip any query parameters from img src attribute.
Nov 5 2021, 12:26 PM
olasd closed D6587: Improve docs rendering for recurrent visits scheduler.
Nov 5 2021, 12:01 PM