Page MenuHomeSoftware Heritage
Feed All Stories

Jun 30 2022

vsellier updated the diff for D8057: Add a docker environment to test the job-builder inside jenkins.

rebase

Jun 30 2022, 4:09 PM
seirl closed T4115: Some unknown SWHID errors crash the graph server as Resolved.

Fixed by the migration to GRPC.

Jun 30 2022, 4:08 PM · Compressed graph service
vsellier updated the diff for D8057: Add a docker environment to test the job-builder inside jenkins.

fix the readme name

Jun 30 2022, 4:08 PM
vsellier added inline comments to D8057: Add a docker environment to test the job-builder inside jenkins.
Jun 30 2022, 4:07 PM
seirl updated the diff for D8059: Generate .labelobl files to speed-up labelled graph loading.

rebase

Jun 30 2022, 4:02 PM
seirl updated the diff for D8059: Generate .labelobl files to speed-up labelled graph loading.
  • Generate .labelobl files to speed-up labelled graph loading
Jun 30 2022, 4:02 PM
seirl committed rDGRPH795fa182f212: docs: remove relative include of swhgraph.proto (authored by seirl).
docs: remove relative include of swhgraph.proto
Jun 30 2022, 3:59 PM
jayeshv updated the task description for T4299: GraphQL: Static query validation and max cost limiting.
Jun 30 2022, 3:57 PM · GraphQL API
jayeshv lowered the priority of T4321: GraphQL: Add metadata to the schema from Normal to Low.
Jun 30 2022, 3:55 PM · GraphQL API
rdicosmo committed rMSLD094823f0b2e0: Add logos for HE projects (authored by rdicosmo).
Add logos for HE projects
Jun 30 2022, 3:54 PM
rdicosmo committed rMSLD467783dbfde4: Add link (authored by rdicosmo).
Add link
Jun 30 2022, 3:54 PM
seirl created P1397 (An Untitled Masterwork).
Jun 30 2022, 3:48 PM
jayeshv updated the task description for T4309: GraphQL: Add missing target types in snapshot branch.
Jun 30 2022, 3:47 PM · GraphQL API
ardumont accepted D8059: Generate .labelobl files to speed-up labelled graph loading.
Jun 30 2022, 3:46 PM
jayeshv closed T4308: GraphQL: Fix missing fields in Content object as Resolved.
Jun 30 2022, 3:44 PM · GraphQL API
jayeshv closed T4308: GraphQL: Fix missing fields in Content object, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
Jun 30 2022, 3:44 PM · GraphQL API, Roadmap 2022
vlorentz updated the summary of D8058: Add support for origin_extrinsic_metadata to the storage.
Jun 30 2022, 3:39 PM
vlorentz requested review of D8060: Add extrinsic metadata indexer.
Jun 30 2022, 3:37 PM
seirl requested review of D8059: Generate .labelobl files to speed-up labelled graph loading.
Jun 30 2022, 3:37 PM
ardumont added a comment to P1396 possible files in guix sources manifest.

manifests:

Jun 30 2022, 3:35 PM
vlorentz requested review of D8058: Add support for origin_extrinsic_metadata to the storage.
Jun 30 2022, 3:35 PM
vlorentz added a task to D8046: Remove SingleFileMapping from JsonMapping's base classes: T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.
Jun 30 2022, 3:31 PM
vlorentz added a task to D8053: Add minimal GitHub metadata mapping: T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.
Jun 30 2022, 3:31 PM
vlorentz added a task to D8054: github mapping: Add support for terms outside the codemeta context: T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.
Jun 30 2022, 3:31 PM
vlorentz added a task to D8055: github mapping: Add support for more terms from the Codemeta crosswalk: T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch.
Jun 30 2022, 3:31 PM
vlorentz added revisions to T2073: Index extrinsic metadata from the journal in swh-search/Elasticsearch: D8060: Add extrinsic metadata indexer, D8058: Add support for origin_extrinsic_metadata to the storage, D8055: github mapping: Add support for more terms from the Codemeta crosswalk, D8054: github mapping: Add support for terms outside the codemeta context, D8053: Add minimal GitHub metadata mapping, D8046: Remove SingleFileMapping from JsonMapping's base classes.
Jun 30 2022, 3:31 PM · Archive search, Metadata workflow
ardumont added a comment to P1396 possible files in guix sources manifest.

Related to T3781

Jun 30 2022, 3:30 PM
seirl committed rDGRPH5c3f59ecfe52: Rename Node.Type enum to SwhType (authored by seirl).
Rename Node.Type enum to SwhType
Jun 30 2022, 3:28 PM
ardumont updated the task description for T3781: Replace the Nixguix loader with a lister.
Jun 30 2022, 3:25 PM · Data Model, Nixguix loader
ardumont created P1396 possible files in guix sources manifest.
Jun 30 2022, 3:19 PM
anlambert closed D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS45b46e62adfc: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS75b37286fe99: api/origin: Do not attempt to lookup similar origin URLs (authored by anlambert).
api/origin: Do not attempt to lookup similar origin URLs
Jun 30 2022, 3:02 PM
anlambert closed D8056: requirements-test: Ensure pinned mypy version is used with tox.
Jun 30 2022, 3:02 PM
anlambert committed rDWAPPS70c242f2d98c: requirements-test: Ensure pinned mypy version is used with tox (authored by anlambert).
requirements-test: Ensure pinned mypy version is used with tox
Jun 30 2022, 3:02 PM
olasd committed rSPSITE1fac03d9e685: varnish: use std.lower for compatibility with buster (authored by olasd).
varnish: use std.lower for compatibility with buster
Jun 30 2022, 2:44 PM
ardumont accepted D8057: Add a docker environment to test the job-builder inside jenkins.

couple of questions inline.

Jun 30 2022, 2:39 PM
ardumont closed T4324: production: Deploy swh-scrubber database and checkers as Resolved.
Jun 30 2022, 2:36 PM · System administration, Datastore Scrubber
seirl closed T3793: Add copyright notices to all swh-graph Java files as Resolved.

Fixed in D8050

Jun 30 2022, 2:28 PM · Compressed graph service
ardumont closed T4361: Unstuck provenance diff build hanging and then aborted as Resolved.
Jun 30 2022, 2:24 PM · Continuous Integration
ardumont added a comment to T4361: Unstuck provenance diff build hanging and then aborted.

Fixes included in the diff landed [1].

Jun 30 2022, 2:23 PM · Continuous Integration
olasd committed rDPROVa721125c2a0a: Explicitly manage the provenance storage connection in journal client (authored by olasd).
Explicitly manage the provenance storage connection in journal client
Jun 30 2022, 2:10 PM
olasd committed rDPROVaf616497e108: Isolate journal tests (authored by olasd).
Isolate journal tests
Jun 30 2022, 2:10 PM
ardumont closed D8023: Install `swh provenance origin from-journal` cli and tests.
Jun 30 2022, 2:10 PM
ardumont committed rDPROVa23c22827dfa: Install `swh provenance origin from-journal` cli and tests (authored by douardda).
Install `swh provenance origin from-journal` cli and tests
Jun 30 2022, 2:10 PM
ardumont added a comment to T4361: Unstuck provenance diff build hanging and then aborted.

Thanks!

Jun 30 2022, 2:09 PM · Continuous Integration
ardumont added a comment to P1395 (An Untitled Masterwork).
14:07:39 swh-scrubber@belvedere:5432=> select * from corrupt_object where id='swh:1:rel:a03d79c816c7ffebe3e8d90d7d395482075b086f';
+-[ RECORD 1 ]-----+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| id               | swh:1:rel:a03d79c816c7ffebe3e8d90d7d395482075b086f                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
| datastore        | 1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
| object           | \x88a46e616d65c41864656269616e2f302e32362e312d307562756e7475322e32a76d657373616765c44574616767696e67207061636b61676520707974686f6e2d676c616e63652d73746f72652076657273696f6e2064656269616e2f302e32362e312d307562756e7475322e320aa6746172676574c414e4c28d0c01ea1274e8e9b28f113572c36211d538ab7461726765745f74797065a87265766973696f6ea973796e746865746963c2a6617574686f7283a866756c6c6e616d65c429436f72657920427279616e74203c636f7265792e627279616e744063616e6f6e6963616c2e636f6d3ea46e616d65c40c436f72657920427279616e74a5656d61696cc41a636f7265792e627279616e744063616e6f6e6963616c2e636f6da46461746582a974696d657374616d7082a77365636f6e6473ce5cfe6f7bac6d6963726f7365636f6e647300ac6f66667365745f6279746573c4052d30343030a26964c414a03d79c816c7ffebe3e8d90d7d395482075b086f |
| first_occurrence | 2022-06-27 15:43:47.263775+00                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
+------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Jun 30 2022, 2:07 PM
ardumont accepted D8057: Add a docker environment to test the job-builder inside jenkins.

Looks good enough to start having a local jenkins, that will ease tampering with whatever we need to develop on it.
This without having to tamper directly with the main swh ci instance.
So thanks.

Jun 30 2022, 2:02 PM
ardumont added inline comments to D8057: Add a docker environment to test the job-builder inside jenkins.
Jun 30 2022, 1:58 PM
douardda created P1395 (An Untitled Masterwork).
Jun 30 2022, 1:57 PM
ardumont accepted D8056: requirements-test: Ensure pinned mypy version is used with tox.

thx (and i guess that fixes the master build as well).

Jun 30 2022, 1:54 PM
swh-public-ci added a comment to D7988: api/origin: Do not attempt to lookup similar origin URLs.

Build is green

Jun 30 2022, 1:19 PM
Harbormaster failed remote builds in B30157: Diff 29071 for D7988: api/origin: Do not attempt to lookup similar origin URLs!
Jun 30 2022, 12:56 PM
swh-public-ci added a comment to D7988: api/origin: Do not attempt to lookup similar origin URLs.

Build has FAILED

Jun 30 2022, 12:56 PM
anlambert requested review of D8056: requirements-test: Ensure pinned mypy version is used with tox.
Jun 30 2022, 12:55 PM
vsellier requested review of D8057: Add a docker environment to test the job-builder inside jenkins.
Jun 30 2022, 12:48 PM
anlambert updated the diff for D7988: api/origin: Do not attempt to lookup similar origin URLs.

Rebase

Jun 30 2022, 12:34 PM
anlambert updated the summary of D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 30 2022, 12:34 PM
swh-public-ci added a comment to D8023: Install `swh provenance origin from-journal` cli and tests.

Build is green

Jun 30 2022, 11:51 AM
olasd added a comment to T4361: Unstuck provenance diff build hanging and then aborted.

It looks like the rabbitmq provenance storage server, which is run within the pytest context through multiprocessing (so forks a bunch of python processes in the pytest run context), interacts poorly with the confluent-kafka library (which is used in the swh.journal fixtures, and brings up a bunch of internal threads).

Jun 30 2022, 11:46 AM · Continuous Integration
olasd updated the diff for D8023: Install `swh provenance origin from-journal` cli and tests.

Drop useless rabbitmq server change

Jun 30 2022, 11:44 AM
swh-public-ci added a comment to D8023: Install `swh provenance origin from-journal` cli and tests.

Build is green

Jun 30 2022, 11:41 AM
olasd updated the diff for D8023: Install `swh provenance origin from-journal` cli and tests.

Ensure coverage results are kept incrementally

Jun 30 2022, 11:34 AM
swh-public-ci added a comment to D8023: Install `swh provenance origin from-journal` cli and tests.

Build is green

Jun 30 2022, 11:31 AM
Harbormaster failed remote builds in B30153: Diff 29067 for D7988: api/origin: Do not attempt to lookup similar origin URLs!
Jun 30 2022, 11:29 AM
swh-public-ci added a comment to D7988: api/origin: Do not attempt to lookup similar origin URLs.

Build has FAILED

Jun 30 2022, 11:29 AM
anlambert updated the diff for D7988: api/origin: Do not attempt to lookup similar origin URLs.

Rebase

Jun 30 2022, 11:27 AM
olasd updated the diff for D8023: Install `swh provenance origin from-journal` cli and tests.

Add explanatory comment for the tests split in tox.ini

Jun 30 2022, 11:23 AM
ardumont added inline comments to D8033: Arch User Repository (AUR) lister.
Jun 30 2022, 11:18 AM
swh-public-ci added a comment to D8023: Install `swh provenance origin from-journal` cli and tests.

Build is green

Jun 30 2022, 11:11 AM
vlorentz requested review of D8055: github mapping: Add support for more terms from the Codemeta crosswalk.
Jun 30 2022, 11:08 AM
vlorentz added inline comments to D8023: Install `swh provenance origin from-journal` cli and tests.
Jun 30 2022, 11:08 AM
swh-public-ci added a comment to D8054: github mapping: Add support for terms outside the codemeta context.

Build is green

Jun 30 2022, 11:08 AM
swh-public-ci added a comment to D8053: Add minimal GitHub metadata mapping.

Build is green

Jun 30 2022, 11:08 AM
vlorentz accepted D7258: Update the mirror operation docker manual.
Jun 30 2022, 11:04 AM
vlorentz accepted D7988: api/origin: Do not attempt to lookup similar origin URLs.
Jun 30 2022, 11:03 AM
olasd updated the diff for D8023: Install `swh provenance origin from-journal` cli and tests.

Pass {posargs} to both pytest runs

Jun 30 2022, 11:02 AM
vlorentz updated the diff for D8054: github mapping: Add support for terms outside the codemeta context.

fix cli test

Jun 30 2022, 11:01 AM
vlorentz updated the diff for D8053: Add minimal GitHub metadata mapping.

fix cli test

Jun 30 2022, 11:01 AM
swh-public-ci added a comment to D8023: Install `swh provenance origin from-journal` cli and tests.

Build is green

Jun 30 2022, 11:00 AM
olasd updated the diff for D8023: Install `swh provenance origin from-journal` cli and tests.
  • Isolate journal tests
Jun 30 2022, 10:53 AM
vlorentz updated subscribers of T4296: Pagination does not work when using sort_by in search query language.
Jun 30 2022, 10:38 AM · Archive search
vlorentz merged task T4364: "sort_by" in the search QL does not support pagination into T4296: Pagination does not work when using sort_by in search query language.
Jun 30 2022, 10:38 AM · Archive search
vlorentz merged T4364: "sort_by" in the search QL does not support pagination into T4296: Pagination does not work when using sort_by in search query language.
Jun 30 2022, 10:38 AM · Archive search
swh-sentry-integration added a comment to T4296: Pagination does not work when using sort_by in search query language.

Sentry issue: SWH-WEBAPP-3QS

Jun 30 2022, 10:37 AM · Archive search
swh-sentry-integration added a comment to T4364: "sort_by" in the search QL does not support pagination.

Sentry issue: SWH-WEBAPP-3QS

Jun 30 2022, 10:37 AM · Archive search
ardumont added inline comments to D8033: Arch User Repository (AUR) lister.
Jun 30 2022, 10:37 AM
vlorentz triaged T4364: "sort_by" in the search QL does not support pagination as Normal priority.
Jun 30 2022, 10:36 AM · Archive search
vlorentz created T4364: "sort_by" in the search QL does not support pagination.
Jun 30 2022, 10:36 AM · Archive search
vlorentz added inline comments to D6138: package/utils: Handle downloads for urls with missing schema.
Jun 30 2022, 9:19 AM
ardumont added inline comments to D8023: Install `swh provenance origin from-journal` cli and tests.
Jun 30 2022, 8:10 AM
KShivendu added inline comments to D6138: package/utils: Handle downloads for urls with missing schema.
Jun 30 2022, 8:07 AM
KShivendu added a comment to D6138: package/utils: Handle downloads for urls with missing schema.

Is it safe to land this now?

Jun 30 2022, 7:19 AM

Jun 29 2022

Harbormaster failed remote builds in B30145: Diff 29059 for D8047: Indexer for Packagist(composer.json)!
Jun 29 2022, 11:01 PM
swh-public-ci added a comment to D8047: Indexer for Packagist(composer.json).

Build has FAILED

Jun 29 2022, 11:01 PM
VickyMerzOwn updated the diff for D8047: Indexer for Packagist(composer.json).

Adds test for ideal behavior of indexer
Removes type attribute in Packagist column of crosswalk.

Jun 29 2022, 10:55 PM
seirl closed D8050: Add missing copyright notices to the entire Java codebase.
Jun 29 2022, 9:46 PM
seirl committed rDGRPHd5a07973b1be: Add missing copyright notices to the entire Java codebase (authored by seirl).
Add missing copyright notices to the entire Java codebase
Jun 29 2022, 9:46 PM
vlorentz requested review of D8054: github mapping: Add support for terms outside the codemeta context.
Jun 29 2022, 7:59 PM
vlorentz requested review of D8053: Add minimal GitHub metadata mapping.
Jun 29 2022, 7:58 PM