Page MenuHomeSoftware Heritage
Feed All Stories

Aug 30 2021

marla.dasilva created T3535: Blog post Octobus NLNet.
Aug 30 2021, 9:26 AM · Unknown Object (Project)
Harbormaster failed remote builds in B23251: Diff 22295 for D6158: maven jar-loader: Initalise files.!
Aug 30 2021, 9:26 AM
swh-public-ci added a comment to D6158: maven jar-loader: Initalise files..

Build has FAILED

Aug 30 2021, 9:26 AM
marla.dasilva created T3534: Update team page with John Hsieh.
Aug 30 2021, 9:26 AM · Unknown Object (Project)
borisbaldassari updated the diff for D6158: maven jar-loader: Initalise files..
  • maven jar-loader: add test and restart build.
Aug 30 2021, 9:24 AM
Harbormaster failed remote builds in B23250: Diff 22294 for D6158: maven jar-loader: Initalise files.!
Aug 30 2021, 9:22 AM
swh-public-ci added a comment to D6158: maven jar-loader: Initalise files..

Build has FAILED

Aug 30 2021, 9:22 AM
borisbaldassari updated the diff for D6158: maven jar-loader: Initalise files..

Restart loader build after successful core build.

Aug 30 2021, 9:20 AM
borisbaldassari requested review of D6158: maven jar-loader: Initalise files..
Aug 30 2021, 9:17 AM

Aug 29 2021

swh-public-ci added a comment to D6133: maven-lister: initialise lister..

Build is green

Aug 29 2021, 10:25 PM
borisbaldassari updated the diff for D6133: maven-lister: initialise lister..
  • maven-lister: set last modif time to epoch int.
Aug 29 2021, 10:22 PM
borisbaldassari added a revision to T1724: Maven Central repository support: D6158: maven jar-loader: Initalise files..
Aug 29 2021, 10:21 PM · Maven loader, Maven lister, GSoC 2019, Archive coverage
swh-public-ci added a comment to D6133: maven-lister: initialise lister..

Build is green

Aug 29 2021, 8:12 PM
borisbaldassari updated the diff for D6133: maven-lister: initialise lister..
  • maven-lister: add last modif time to extra args for jar files.
Aug 29 2021, 8:07 PM
dachary added a subtask for T3432: Add winery backend: T3533: Winery backend: basic implementation.
Aug 29 2021, 2:43 PM · Object storage
dachary added a parent task for T3533: Winery backend: basic implementation: T3432: Add winery backend.
Aug 29 2021, 2:43 PM · Object storage (RedHat collaboration)
dachary triaged T3533: Winery backend: basic implementation as Normal priority.
Aug 29 2021, 2:41 PM · Object storage (RedHat collaboration)
dachary removed a subtask for T3432: Add winery backend: T3530: IO throttling: implementation.
Aug 29 2021, 2:37 PM · Object storage
dachary edited parent tasks for T3530: IO throttling: implementation, added: T3532: IO throttling; removed: T3432: Add winery backend.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3532: IO throttling: T3530: IO throttling: implementation.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3531: IO throttling: benchmark: T3532: IO throttling.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3532: IO throttling: T3531: IO throttling: benchmark.
Aug 29 2021, 2:37 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3532: IO throttling: T3432: Add winery backend.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3532: IO throttling.
Aug 29 2021, 2:36 PM · Object storage
dachary triaged T3532: IO throttling as Normal priority.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3530: IO throttling: implementation.
Aug 29 2021, 2:36 PM · Object storage (RedHat collaboration)
dachary triaged T3531: IO throttling: benchmark as Normal priority.
Aug 29 2021, 2:34 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3530: IO throttling: implementation.
Aug 29 2021, 2:31 PM · Object storage
dachary added a parent task for T3530: IO throttling: implementation: T3432: Add winery backend.
Aug 29 2021, 2:31 PM · Object storage (RedHat collaboration)
dachary triaged T3530: IO throttling: implementation as Normal priority.
Aug 29 2021, 2:30 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3529: Publish object storage benchmark results.
Aug 29 2021, 2:25 PM · Object storage
dachary added a parent task for T3529: Publish object storage benchmark results: T3432: Add winery backend.
Aug 29 2021, 2:25 PM · Object storage
dachary triaged T3529: Publish object storage benchmark results as Normal priority.
Aug 29 2021, 2:24 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3528: Add winery backend: grid5000 benchmark.
Aug 29 2021, 2:21 PM · Object storage
dachary added a parent task for T3528: Add winery backend: grid5000 benchmark: T3432: Add winery backend.
Aug 29 2021, 2:21 PM · Object storage
dachary triaged T3528: Add winery backend: grid5000 benchmark as Normal priority.
Aug 29 2021, 2:20 PM · Object storage
dachary added a parent task for T3527: Self-host Software Heritage on grid5000: T3432: Add winery backend.
Aug 29 2021, 2:15 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3527: Self-host Software Heritage on grid5000.
Aug 29 2021, 2:15 PM · Object storage
dachary triaged T3527: Self-host Software Heritage on grid5000 as Normal priority.
Aug 29 2021, 2:15 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3526: Add winery backend: learning the CI.
Aug 29 2021, 2:12 PM · Object storage
dachary added a parent task for T3526: Add winery backend: learning the CI: T3432: Add winery backend.
Aug 29 2021, 2:12 PM · Object storage
dachary triaged T3526: Add winery backend: learning the CI as Normal priority.
Aug 29 2021, 2:11 PM · Object storage
dachary renamed T3525: grid5000 tools and documentation from grid5000 tools to grid5000 tools and documentation.
Aug 29 2021, 2:05 PM · Object storage
dachary added a parent task for T3525: grid5000 tools and documentation: T3432: Add winery backend.
Aug 29 2021, 2:05 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3525: grid5000 tools and documentation.
Aug 29 2021, 2:05 PM · Object storage
dachary triaged T3525: grid5000 tools and documentation as Normal priority.
Aug 29 2021, 2:04 PM · Object storage
dachary updated the task description for T3524: Add winery backend: create the Ceph cluster.
Aug 29 2021, 1:59 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3524: Add winery backend: create the Ceph cluster.
Aug 29 2021, 1:58 PM · Object storage
dachary added a parent task for T3524: Add winery backend: create the Ceph cluster: T3432: Add winery backend.
Aug 29 2021, 1:58 PM · Object storage (RedHat collaboration)
dachary added a project to T3523: Add winery backend: create the PostgreSQL cluster: Object storage.
Aug 29 2021, 1:57 PM · Object storage
dachary triaged T3524: Add winery backend: create the Ceph cluster as Normal priority.
Aug 29 2021, 1:57 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3432: Add winery backend: T3523: Add winery backend: create the PostgreSQL cluster.
Aug 29 2021, 1:56 PM · Object storage
dachary added a parent task for T3523: Add winery backend: create the PostgreSQL cluster: T3432: Add winery backend.
Aug 29 2021, 1:56 PM · Object storage
dachary triaged T3523: Add winery backend: create the PostgreSQL cluster as Normal priority.
Aug 29 2021, 1:56 PM · Object storage
dachary updated the task description for T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:44 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:42 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3519: Persistent readonly perfect hash table: CI and package.
Aug 29 2021, 1:41 PM · Object storage
dachary updated the task description for T3522: Add winery backend: learning the codebase.
Aug 29 2021, 1:39 PM · Object storage
dachary added a subtask for T3432: Add winery backend: T3522: Add winery backend: learning the codebase.
Aug 29 2021, 1:36 PM · Object storage
dachary added a parent task for T3522: Add winery backend: learning the codebase: T3432: Add winery backend.
Aug 29 2021, 1:36 PM · Object storage
dachary triaged T3522: Add winery backend: learning the codebase as Normal priority.
Aug 29 2021, 1:35 PM · Object storage
dachary added a parent task for T3521: Persistent readonly perfect hash table: benchmarks: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3521: Persistent readonly perfect hash table: benchmarks.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary triaged T3521: Persistent readonly perfect hash table: benchmarks as Normal priority.
Aug 29 2021, 1:26 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3520: Persistent readonly perfect hash table: implementation: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:22 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:22 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:21 PM · Object storage (RedHat collaboration)
dachary updated the task description for T3520: Persistent readonly perfect hash table: implementation.
Aug 29 2021, 1:20 PM · Object storage (RedHat collaboration)
dachary triaged T3520: Persistent readonly perfect hash table: implementation as Normal priority.
Aug 29 2021, 1:20 PM · Object storage (RedHat collaboration)
dachary added a subtask for T3104: Persistent readonly perfect hash table: T3519: Persistent readonly perfect hash table: CI and package.
Aug 29 2021, 1:14 PM · Object storage (RedHat collaboration)
dachary added a parent task for T3519: Persistent readonly perfect hash table: CI and package: T3104: Persistent readonly perfect hash table.
Aug 29 2021, 1:14 PM · Object storage
dachary triaged T3519: Persistent readonly perfect hash table: CI and package as Normal priority.
Aug 29 2021, 1:14 PM · Object storage
dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3432: Add winery backend, from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage
dachary changed the status of T3104: Persistent readonly perfect hash table from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage (RedHat collaboration)
dachary changed the status of T3104: Persistent readonly perfect hash table, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary changed the status of T3432: Add winery backend from Work in Progress to Open.
Aug 29 2021, 1:08 PM · Object storage
dachary changed the status of T3249: Deleting and erasing an object, a subtask of T3054: Scale out object storage design, from Work in Progress to Open.
Aug 29 2021, 1:05 PM · Roadmap 2022, Object storage (RedHat collaboration), Roadmap 2021, meta-task
dachary changed the status of T3249: Deleting and erasing an object from Work in Progress to Open.
Aug 29 2021, 1:05 PM · Object storage (RedHat collaboration)
swh-public-ci added a comment to D6133: maven-lister: initialise lister..

Build is green

Aug 29 2021, 11:09 AM
borisbaldassari updated the diff for D6133: maven-lister: initialise lister..
  • maven-lister: add extra loader arguments for jar loader output.
  • maven-lister: fix tests for extra loader asserts.
Aug 29 2021, 11:06 AM

Aug 28 2021

borisbaldassari requested review of D6133: maven-lister: initialise lister..
Aug 28 2021, 11:02 AM
rdicosmo added a comment to T3489: Implement iframe view for content and directory elements.

Thanks for all this great work...
A few questions/remarks:

  • where is the Permalinks tab? I do not see it in the images
  • for the url, what about "/embed/" instead of "/iframe/"? "embed" seems to be the canonical term used to designate this kind of things (see YouTube, etc.)
  • instead of "go to the archive", why not "View in the Software Heritage Archive"?
  • it's great that the iframe can use the width and height attibutes! How do you plan to handle strange values (e.g.: width=10px height=200%)?
Aug 28 2021, 10:02 AM · Software Stories, Web app

Aug 27 2021

vsellier added a comment to T3465: Test multidatacenter replication.

New cluster state after all the reservation are up:

vsellier@gros-50:~$  nodetool status
Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address       Load        Tokens  Owns (effective)  Host ID                               Rack
UN  172.16.97.3   1.4 TiB     256     60.1%             a3ae5fa2-c063-4890-87f1-bddfcf293bde  rack1
UN  172.16.97.6   1.4 TiB     256     60.0%             bfe360f1-8fd2-4f4b-a070-8f267eda1e12  rack1
UN  172.16.97.5   1.39 TiB    256     59.9%             478c36f8-5220-4db7-b5c2-f3876c0c264a  rack1
UN  172.16.97.4   1.4 TiB     256     59.9%             b3105348-66b0-4f82-a5bf-31ef28097a41  rack1
UN  172.16.97.2   1.4 TiB     256     60.1%             de866efd-064c-4e27-965c-f5112393dc8f  rack1
Aug 27 2021, 7:35 PM · System administration, Storage manager
vsellier added a comment to T3465: Test multidatacenter replication.
  • cassandra stopped
vsellier@fnancy:~/cassandra$ seq 50 64 | parallel -t ssh root@gros-{} systemctl stop cassandra
  • data cleaned
vsellier@fnancy:~/cassandra$ seq 50 64 | parallel -t ssh root@gros-{} "rm -rf /srv/cassandra/*"
  • Cassandra restarted
vsellier@fnancy:~/cassandra$ seq 50 64 | parallel -t ssh root@gros-{} systemctl start cassandra
Aug 27 2021, 6:43 PM · System administration, Storage manager
vsellier added a comment to T3465: Test multidatacenter replication.

well after reflection, it will be probably faster to recreate the second DC from scractch now the configuration is ready.

Aug 27 2021, 6:35 PM · System administration, Storage manager
vsellier added a comment to T3465: Test multidatacenter replication.

5 nodes were added on the cluster:

  • configuration pushed on g5k, disk reserved for 14 days on the new servers, a new reservation was launched with the new nodes
  • each node was started one by one after their status was UN on the nodetool status output
Datacenter: DC1
===============
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address       Load        Tokens  Owns (effective)  Host ID                               Rack
DN  172.16.97.3   ?           256     0.0%              a3ae5fa2-c063-4890-87f1-bddfcf293bde  r1
DN  172.16.97.6   ?           256     0.0%              bfe360f1-8fd2-4f4b-a070-8f267eda1e12  r1
DN  172.16.97.5   ?           256     0.0%              478c36f8-5220-4db7-b5c2-f3876c0c264a  r1
DN  172.16.97.4   ?           256     0.0%              b3105348-66b0-4f82-a5bf-31ef28097a41  r1
DN  172.16.97.2   ?           256     0.0%              de866efd-064c-4e27-965c-f5112393dc8f  r1
Aug 27 2021, 6:30 PM · System administration, Storage manager
vsellier committed rDSNIP7a754f65a4f5: grid5000/cassandra: Add more nodes on the second datacenter (authored by vsellier).
grid5000/cassandra: Add more nodes on the second datacenter
Aug 27 2021, 6:16 PM
ardumont added a comment to T3518: Enable vault cookers to access swh-graph.

might be related to T3168 for the packaging part.

Aug 27 2021, 6:02 PM · System administration, Vault
ardumont added a comment to T3502: Date overflow error in scheduler journal client.

Gist of it is deployed.
I'll close it when it's monitored by at least that diff ^.

Aug 27 2021, 5:56 PM · System administration, Scheduling utilities
anlambert accepted D6157: Add support for git-bare bundles in API.

Looks good to me. Such an awesome feature, can't wait to test it in production !

Aug 27 2021, 5:44 PM
vlorentz triaged T3518: Enable vault cookers to access swh-graph as Normal priority.
Aug 27 2021, 5:35 PM · System administration, Vault
anlambert added a comment to T3489: Implement iframe view for content and directory elements.

I would go for option 1 but the path breadcrumbs should remain as it enables to ease
the navigation inside the source code tree (especially when an iframe points to a directory).
I propose to put it below the iframe header, it will also be fixed.

Aug 27 2021, 5:33 PM · Software Stories, Web app
vlorentz added a task to D6157: Add support for git-bare bundles in API: T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp.
Aug 27 2021, 5:33 PM
vlorentz added a revision to T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp: D6157: Add support for git-bare bundles in API.
Aug 27 2021, 5:33 PM · Vault, Web app
vlorentz requested review of D6157: Add support for git-bare bundles in API.
Aug 27 2021, 5:29 PM
ardumont added a revision to T3502: Date overflow error in scheduler journal client: D6156: Ensure icinga alerts are raised if the scheduler journal client is down.
Aug 27 2021, 5:28 PM · System administration, Scheduling utilities
ardumont updated the summary of D6156: Ensure icinga alerts are raised if the scheduler journal client is down.
Aug 27 2021, 5:28 PM
vsellier added a comment to T3465: Test multidatacenter replication.

10 nodes are not enough, I add 5 additional nodes to reduce the volume per node a little.

Aug 27 2021, 5:24 PM · System administration, Storage manager
ardumont added a comment to T3338: Load the archived bitbucket mercurial repositories.

It's currently running (data point ongoing...).

Aug 27 2021, 5:22 PM · System administration, Mercurial loader