Page MenuHomeSoftware Heritage
Feed All Stories

Today

ardumont added a comment to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.

Just one note: the name is IMHO inappropriate. This is NOT a JSON lister. JSON is nothing but the serialization format used to retrieve some (more or less) well defined structured data.
What defines this lister is its ability to comprehend the very data structure mentioned in this diff's description.

Indeed, i proposed a name in D2025#inline-13301 ;)

Wed, Oct 16, 10:27 AM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Wed, Oct 16, 10:20 AM · Lister
ardumont added a comment to D2145: package.tar: Add a tar loader implementation.

I think the hash and the version should be optional. I explain a bit why we can't always provide the version in D2025.

Wed, Oct 16, 10:16 AM
ardumont updated the summary of D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Wed, Oct 16, 10:11 AM · Lister
swh-public-ci added a comment to D2145: package.tar: Add a tar loader implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/197/ for more details.

Wed, Oct 16, 10:10 AM
ardumont updated the diff for D2145: package.tar: Add a tar loader implementation.

Make sure the snapshot is the same across the 2 visits

Wed, Oct 16, 10:09 AM
douardda added a comment to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.

Just one note: the name is IMHO inappropriate. This is NOT a JSON lister. JSON is nothing but the serialization format used to retrieve some (more or less) well defined structured data.

Wed, Oct 16, 9:37 AM · Lister
lewo added a comment to D2145: package.tar: Add a tar loader implementation.

I think the hash and the version should be optional. I explain a bit why we can't always provide the version in D2025.

Wed, Oct 16, 9:31 AM

Yesterday

seirl changed the visibility for P548 Masterwork From Distant Lands.
Tue, Oct 15, 11:23 PM
olasd committed rSPSITE06557c3f16ec: Replace sshkey with concat in phabricator profile (authored by olasd).
Replace sshkey with concat in phabricator profile
Tue, Oct 15, 7:04 PM
olasd committed rSPGUNIbb3ea9af8f37: Add missing reference to the azure logger in the main config (authored by olasd).
Add missing reference to the azure logger in the main config
Tue, Oct 15, 7:00 PM
olasd committed rSPGUNI1f1cd26a291f: Only ever log to the journal (authored by olasd).
Only ever log to the journal
Tue, Oct 15, 7:00 PM
swh-public-ci added a comment to D2145: package.tar: Add a tar loader implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/196/ for more details.

Tue, Oct 15, 6:52 PM
ardumont updated the diff for D2145: package.tar: Add a tar loader implementation.

Add test

Tue, Oct 15, 6:51 PM
olasd committed rSPGUNIad79395206c4: Silence azure.storage.common.storageclient noise (authored by olasd).
Silence azure.storage.common.storageclient noise
Tue, Oct 15, 6:50 PM
swh-public-ci added a comment to D2145: package.tar: Add a tar loader implementation.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/195/ for more details.

Tue, Oct 15, 6:37 PM
ardumont created D2145: package.tar: Add a tar loader implementation.
Tue, Oct 15, 6:36 PM
lewo added inline comments to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Tue, Oct 15, 6:26 PM · Lister
anlambert updated the summary of D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.
Tue, Oct 15, 6:02 PM
anlambert updated the diff for D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.

Update: Do not expose 8080 port to host and configure nginx reverse proxy to expose keycloak as http://localhost:5080/keycloak

Tue, Oct 15, 6:01 PM
ardumont added inline comments to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Tue, Oct 15, 5:44 PM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Tue, Oct 15, 5:26 PM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.json: Add lister getting sources from JSON file.
Tue, Oct 15, 5:21 PM · Lister
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Tue, Oct 15, 5:10 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/194/ for more details.

Tue, Oct 15, 5:09 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Tue, Oct 15, 5:08 PM
Harbormaster failed remote builds in B8473: Diff 7257 for D2142: package.debian: Use last snapshot to avoid re-loading a debian package!
Tue, Oct 15, 5:08 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/192/ for more details.

Tue, Oct 15, 5:07 PM · Debian loader, Core Loader
ardumont updated the diff for D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Rebase to latest D2135

Tue, Oct 15, 5:07 PM
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Fix edge case about date
Tue, Oct 15, 5:06 PM · Debian loader, Core Loader
ardumont accepted D2078: Add support for symbolic references.
Tue, Oct 15, 4:57 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Tue, Oct 15, 4:14 PM
Harbormaster failed remote builds in B8471: Diff 7255 for D2144: [WIP] typing: minimal changes to make a no-op mypy run pass!
Tue, Oct 15, 4:01 PM
swh-public-ci added a comment to D2144: [WIP] typing: minimal changes to make a no-op mypy run pass.

Build has FAILED

Tue, Oct 15, 4:01 PM
zack planned changes to D2144: [WIP] typing: minimal changes to make a no-op mypy run pass.

doesn't actually pass mypy yet, will update

Tue, Oct 15, 3:59 PM
zack created D2144: [WIP] typing: minimal changes to make a no-op mypy run pass.
Tue, Oct 15, 3:59 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX97267af1d885: Updated backport on buster-swh from debian/0.0.155-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.0.155-1_swh1 (unstable-swh)
Tue, Oct 15, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXc1db34d54ac4: Merge tag 'debian/0.0.155-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.0.155-1_swh1' into debian/buster-swh
Tue, Oct 15, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXfafddc76ff38: Updated backport on stretch-swh from debian/0.0.155-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on stretch-swh from debian/0.0.155-1_swh1 (unstable-swh)
Tue, Oct 15, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX418236c2da0a: Merge tag 'debian/0.0.155-1_swh1' into debian/stretch-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.0.155-1_swh1' into debian/stretch-swh
Tue, Oct 15, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX64fbfbfe068e: pristine-tar data for swh-indexer_0.0.155.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-indexer_0.0.155.orig.tar.gz
Tue, Oct 15, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXd197b55e7979: New upstream version 0.0.155 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.0.155
Tue, Oct 15, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXb89d0b89ee6b: Updated debian changelog for version 0.0.155 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.0.155
Tue, Oct 15, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX4595710b0a95: Update upstream source from tag 'debian/upstream/0.0.155' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.0.155'
Tue, Oct 15, 2:55 PM
vlorentz committed rDCIDX1d625af0ba1e: Add a command-line tool to run metadata translation. (authored by vlorentz).
Add a command-line tool to run metadata translation.
Tue, Oct 15, 2:50 PM
vlorentz closed D2141: Add a command-line too to run metadata translation..
Tue, Oct 15, 2:50 PM
vlorentz created P549 Origins with a codemeta.json at root.
Tue, Oct 15, 2:49 PM
seirl committed rDGRPH862ea0cdb686: java: Entry: add lightweight copies in count methods (authored by seirl).
java: Entry: add lightweight copies in count methods
Tue, Oct 15, 2:46 PM
seirl committed rDGRPH1248b92e0c37: app: add 3.6 compatibility (authored by seirl).
app: add 3.6 compatibility
Tue, Oct 15, 2:46 PM
seirl committed rDGRPHb6d0294cb6b4: backend: add hardcoded java_opts (authored by seirl).
backend: add hardcoded java_opts
Tue, Oct 15, 2:46 PM
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Tue, Oct 15, 2:43 PM
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Tue, Oct 15, 2:43 PM
ardumont retitled D2135: package.debian: Re-implement debian loader within the package loader mechanism from debian: Implement debian loader with package loader mechanism to package.debian: Re-implement debian loader within the package loader mechanism.
Tue, Oct 15, 2:41 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2141: Add a command-line too to run metadata translation..

Build is green
See https://jenkins.softwareheritage.org/job/DCIDX/job/tox/630/ for more details.

Tue, Oct 15, 2:35 PM
ardumont accepted D2141: Add a command-line too to run metadata translation..
Tue, Oct 15, 2:35 PM
ardumont added a comment to D2140: swh-docs: Add storage sites documentation.

That's off to a good start, thanks.

Tue, Oct 15, 2:33 PM
vlorentz added a comment to D2141: Add a command-line too to run metadata translation..

Because I messed up git. Removed

Tue, Oct 15, 2:33 PM
vlorentz updated the diff for D2141: Add a command-line too to run metadata translation..
  • remove print
  • remove stuff that wasn't supposed to be committed
Tue, Oct 15, 2:33 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/191/ for more details.

Tue, Oct 15, 2:28 PM
ardumont abandoned D1728: swh.loader.cran: Implement CRAN loader.
Tue, Oct 15, 2:27 PM
ardumont commandeered D1728: swh.loader.cran: Implement CRAN loader.
Tue, Oct 15, 2:27 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Tue, Oct 15, 2:26 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Tue, Oct 15, 2:21 PM
anlambert committed rCDFJ615ea42711d4: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer (authored by anlambert).
base/Dockerfile: Add missing libffi-dev dependency for swh-indexer
Tue, Oct 15, 2:21 PM
anlambert closed D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Tue, Oct 15, 2:21 PM
anlambert updated the diff for D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.

Rebase

Tue, Oct 15, 2:20 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Tue, Oct 15, 2:19 PM
vlorentz accepted D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Tue, Oct 15, 2:19 PM
anlambert created D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Tue, Oct 15, 2:18 PM
ardumont requested changes to D2141: Add a command-line too to run metadata translation..
Tue, Oct 15, 2:11 PM
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Tue, Oct 15, 2:08 PM · Debian loader, Core Loader
ardumont added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Tue, Oct 15, 2:05 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/189/ for more details.

Tue, Oct 15, 2:04 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Tue, Oct 15, 2:03 PM
Harbormaster failed remote builds in B8466: Diff 7249 for D2142: package.debian: Use last snapshot to avoid re-loading a debian package!
Tue, Oct 15, 2:03 PM
ardumont created D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Tue, Oct 15, 2:02 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/187/ for more details.

Tue, Oct 15, 2:00 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Add test to demonstrate we visit twice the artifacts for 2 visits (with no
change in between)

Tue, Oct 15, 1:59 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/186/ for more details.

Tue, Oct 15, 1:59 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian.loader: Update typing annotations
  • debian: Explicit we visit twice the same artifacts across 2 visits
  • package.debian: Check for known revisions using snapshot if any
Tue, Oct 15, 1:58 PM · Debian loader, Core Loader
Harbormaster failed remote builds in B8463: Diff 7246 for D2141: Add a command-line too to run metadata translation.!
Tue, Oct 15, 1:37 PM
swh-public-ci added a comment to D2141: Add a command-line too to run metadata translation..

Build has FAILED

Tue, Oct 15, 1:37 PM
vlorentz created D2141: Add a command-line too to run metadata translation..
Tue, Oct 15, 1:37 PM
ftigeot added a comment to T1974: Document low-level storage layers.

Some work-in-progress Sphinxdoc documentation is visible in this Phabricator review: https://forge.softwareheritage.org/D2140 .

Tue, Oct 15, 1:25 PM · Development documentation
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Tue, Oct 15, 1:11 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Tue, Oct 15, 1:10 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2134: debian.lister: Add integration test which checks scheduled tasks.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/441/ for more details.

Tue, Oct 15, 12:27 PM
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Rebase to latest master

Tue, Oct 15, 12:24 PM
ardumont committed rDLS960868badb08: pypi.tests: Remove trailing _ in test method name (authored by ardumont).
pypi.tests: Remove trailing _ in test method name
Tue, Oct 15, 12:23 PM
ardumont committed rDLSb73c657ea7a2: npm.lister: Align docstrings (authored by ardumont).
npm.lister: Align docstrings
Tue, Oct 15, 12:23 PM
ardumont committed rDLSb4867ccda965: npm.tests: Add an integration test on listing with pagination (authored by ardumont).
npm.tests: Add an integration test on listing with pagination
Tue, Oct 15, 12:23 PM
ardumont closed D2139: npm.tests: Add an integration test on listing with pagination.
Tue, Oct 15, 12:23 PM
swh-public-ci added a comment to D2139: npm.tests: Add an integration test on listing with pagination.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/440/ for more details.

Tue, Oct 15, 12:23 PM
ardumont updated the diff for D2139: npm.tests: Add an integration test on listing with pagination.

Branch diff to master

Tue, Oct 15, 12:20 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/185/ for more details.

Tue, Oct 15, 12:19 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/184/ for more details.

Tue, Oct 15, 12:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Diff against package-loader (not master :/)

Tue, Oct 15, 12:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • test_debian: Add test around get_package_metadata function
Tue, Oct 15, 12:17 PM · Debian loader, Core Loader
anlambert added inline comments to D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.
Tue, Oct 15, 12:05 PM
anlambert accepted D2139: npm.tests: Add an integration test on listing with pagination.

Looks good !

Tue, Oct 15, 12:03 PM