Page MenuHomeSoftware Heritage
Feed All Stories

Oct 16 2019

ardumont added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Just one note: the name is IMHO inappropriate. This is NOT a JSON lister. JSON is nothing but the serialization format used to retrieve some (more or less) well defined structured data.

What defines this lister is its ability to comprehend the very data structure mentioned in this diff's description.

Indeed, i proposed a name in D2025#inline-13301 ;)

Oct 16 2019, 10:27 AM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 16 2019, 10:20 AM · Lister
ardumont added a comment to D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

I think the hash and the version should be optional. I explain a bit why we can't always provide the version in D2025.

Oct 16 2019, 10:16 AM
ardumont updated the summary of D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 16 2019, 10:11 AM · Lister
swh-public-ci added a comment to D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/197/ for more details.

Oct 16 2019, 10:10 AM
ardumont updated the diff for D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

Make sure the snapshot is the same across the 2 visits

Oct 16 2019, 10:09 AM
douardda added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Just one note: the name is IMHO inappropriate. This is NOT a JSON lister. JSON is nothing but the serialization format used to retrieve some (more or less) well defined structured data.

Oct 16 2019, 9:37 AM · Lister
lewo added a comment to D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

I think the hash and the version should be optional. I explain a bit why we can't always provide the version in D2025.

Oct 16 2019, 9:31 AM

Oct 15 2019

seirl changed the visibility for P548 Masterwork From Distant Lands.
Oct 15 2019, 11:23 PM
olasd committed rSPSITE06557c3f16ec: Replace sshkey with concat in phabricator profile (authored by olasd).
Replace sshkey with concat in phabricator profile
Oct 15 2019, 7:04 PM
olasd committed rSPGUNIbb3ea9af8f37: Add missing reference to the azure logger in the main config (authored by olasd).
Add missing reference to the azure logger in the main config
Oct 15 2019, 7:00 PM
olasd committed rSPGUNI1f1cd26a291f: Only ever log to the journal (authored by olasd).
Only ever log to the journal
Oct 15 2019, 7:00 PM
swh-public-ci added a comment to D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/196/ for more details.

Oct 15 2019, 6:52 PM
ardumont updated the diff for D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

Add test

Oct 15 2019, 6:51 PM
olasd committed rSPGUNIad79395206c4: Silence azure.storage.common.storageclient noise (authored by olasd).
Silence azure.storage.common.storageclient noise
Oct 15 2019, 6:50 PM
swh-public-ci added a comment to D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/195/ for more details.

Oct 15 2019, 6:37 PM
ardumont created D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).
Oct 15 2019, 6:36 PM
lewo added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 15 2019, 6:26 PM · Lister
anlambert updated the summary of D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.
Oct 15 2019, 6:02 PM
anlambert updated the diff for D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.

Update: Do not expose 8080 port to host and configure nginx reverse proxy to expose keycloak as http://localhost:5080/keycloak

Oct 15 2019, 6:01 PM
ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 15 2019, 5:44 PM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 15 2019, 5:26 PM · Lister
ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.
Oct 15 2019, 5:21 PM · Lister
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Oct 15 2019, 5:10 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/194/ for more details.

Oct 15 2019, 5:09 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Oct 15 2019, 5:08 PM
Harbormaster failed remote builds in B8473: Diff 7257 for D2142: package.debian: Use last snapshot to avoid re-loading a debian package!
Oct 15 2019, 5:08 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/192/ for more details.

Oct 15 2019, 5:07 PM · Debian loader, Core Loader
ardumont updated the diff for D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Rebase to latest D2135

Oct 15 2019, 5:07 PM
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian: Fix edge case about date
Oct 15 2019, 5:06 PM · Debian loader, Core Loader
ardumont accepted D2078: Add support for symbolic references.
Oct 15 2019, 4:57 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Oct 15 2019, 4:14 PM
Harbormaster failed remote builds in B8471: Diff 7255 for D2144: typing: minimal changes to make a no-op mypy run pass!
Oct 15 2019, 4:01 PM
swh-public-ci added a comment to D2144: typing: minimal changes to make a no-op mypy run pass.

Build has FAILED

Oct 15 2019, 4:01 PM
zack planned changes to D2144: typing: minimal changes to make a no-op mypy run pass.

doesn't actually pass mypy yet, will update

Oct 15 2019, 3:59 PM
zack created D2144: typing: minimal changes to make a no-op mypy run pass.
Oct 15 2019, 3:59 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX97267af1d885: Updated backport on buster-swh from debian/0.0.155-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.0.155-1_swh1 (unstable-swh)
Oct 15 2019, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXc1db34d54ac4: Merge tag 'debian/0.0.155-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.0.155-1_swh1' into debian/buster-swh
Oct 15 2019, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXfafddc76ff38: Updated backport on stretch-swh from debian/0.0.155-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on stretch-swh from debian/0.0.155-1_swh1 (unstable-swh)
Oct 15 2019, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX418236c2da0a: Merge tag 'debian/0.0.155-1_swh1' into debian/stretch-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.0.155-1_swh1' into debian/stretch-swh
Oct 15 2019, 2:57 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX64fbfbfe068e: pristine-tar data for swh-indexer_0.0.155.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-indexer_0.0.155.orig.tar.gz
Oct 15 2019, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXd197b55e7979: New upstream version 0.0.155 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.0.155
Oct 15 2019, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDXb89d0b89ee6b: Updated debian changelog for version 0.0.155 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.0.155
Oct 15 2019, 2:55 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDCIDX4595710b0a95: Update upstream source from tag 'debian/upstream/0.0.155' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.0.155'
Oct 15 2019, 2:55 PM
vlorentz committed rDCIDX1d625af0ba1e: Add a command-line tool to run metadata translation. (authored by vlorentz).
Add a command-line tool to run metadata translation.
Oct 15 2019, 2:50 PM
vlorentz closed D2141: Add a command-line too to run metadata translation..
Oct 15 2019, 2:50 PM
vlorentz created P549 Origins with a codemeta.json at root.
Oct 15 2019, 2:49 PM
seirl committed rDGRPH862ea0cdb686: java: Entry: add lightweight copies in count methods (authored by seirl).
java: Entry: add lightweight copies in count methods
Oct 15 2019, 2:46 PM
seirl committed rDGRPH1248b92e0c37: app: add 3.6 compatibility (authored by seirl).
app: add 3.6 compatibility
Oct 15 2019, 2:46 PM
seirl committed rDGRPHb6d0294cb6b4: backend: add hardcoded java_opts (authored by seirl).
backend: add hardcoded java_opts
Oct 15 2019, 2:46 PM
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Oct 15 2019, 2:43 PM
ardumont updated the summary of D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Oct 15 2019, 2:43 PM
ardumont retitled D2135: package.debian: Re-implement debian loader within the package loader mechanism from debian: Implement debian loader with package loader mechanism to package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 2:41 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2141: Add a command-line too to run metadata translation..

Build is green
See https://jenkins.softwareheritage.org/job/DCIDX/job/tox/630/ for more details.

Oct 15 2019, 2:35 PM
ardumont accepted D2141: Add a command-line too to run metadata translation..
Oct 15 2019, 2:35 PM
ardumont added a comment to D2140: swh-docs: Add storage sites documentation.

That's off to a good start, thanks.

Oct 15 2019, 2:33 PM
vlorentz added a comment to D2141: Add a command-line too to run metadata translation..

Because I messed up git. Removed

Oct 15 2019, 2:33 PM
vlorentz updated the diff for D2141: Add a command-line too to run metadata translation..
  • remove print
  • remove stuff that wasn't supposed to be committed
Oct 15 2019, 2:33 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/191/ for more details.

Oct 15 2019, 2:28 PM
ardumont abandoned D1728: swh.loader.cran: Implement CRAN loader.
Oct 15 2019, 2:27 PM
ardumont commandeered D1728: swh.loader.cran: Implement CRAN loader.
Oct 15 2019, 2:27 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Oct 15 2019, 2:26 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Oct 15 2019, 2:21 PM
anlambert committed rCDFJ615ea42711d4: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer (authored by anlambert).
base/Dockerfile: Add missing libffi-dev dependency for swh-indexer
Oct 15 2019, 2:21 PM
anlambert closed D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Oct 15 2019, 2:21 PM
anlambert updated the diff for D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.

Rebase

Oct 15 2019, 2:20 PM
ardumont added inline comments to D2140: swh-docs: Add storage sites documentation.
Oct 15 2019, 2:19 PM
vlorentz accepted D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Oct 15 2019, 2:19 PM
anlambert created D2143: base/Dockerfile: Add missing libffi-dev dependency for swh-indexer.
Oct 15 2019, 2:18 PM
ardumont requested changes to D2141: Add a command-line too to run metadata translation..
Oct 15 2019, 2:11 PM
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 2:08 PM · Debian loader, Core Loader
ardumont added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Oct 15 2019, 2:05 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/189/ for more details.

Oct 15 2019, 2:04 PM
swh-public-ci added a comment to D2142: package.debian: Use last snapshot to avoid re-loading a debian package.

Build has FAILED

Oct 15 2019, 2:03 PM
Harbormaster failed remote builds in B8466: Diff 7249 for D2142: package.debian: Use last snapshot to avoid re-loading a debian package!
Oct 15 2019, 2:03 PM
ardumont created D2142: package.debian: Use last snapshot to avoid re-loading a debian package.
Oct 15 2019, 2:02 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/187/ for more details.

Oct 15 2019, 2:00 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Add test to demonstrate we visit twice the artifacts for 2 visits (with no
change in between)

Oct 15 2019, 1:59 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/186/ for more details.

Oct 15 2019, 1:59 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • debian.loader: Update typing annotations
  • debian: Explicit we visit twice the same artifacts across 2 visits
  • package.debian: Check for known revisions using snapshot if any
Oct 15 2019, 1:58 PM · Debian loader, Core Loader
Harbormaster failed remote builds in B8463: Diff 7246 for D2141: Add a command-line too to run metadata translation.!
Oct 15 2019, 1:37 PM
swh-public-ci added a comment to D2141: Add a command-line too to run metadata translation..

Build has FAILED

Oct 15 2019, 1:37 PM
vlorentz created D2141: Add a command-line too to run metadata translation..
Oct 15 2019, 1:37 PM
ftigeot added a comment to T1974: Document low-level storage layers.

Some work-in-progress Sphinxdoc documentation is visible in this Phabricator review: https://forge.softwareheritage.org/D2140 .

Oct 15 2019, 1:25 PM · Documentation
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 1:11 PM · Debian loader, Core Loader
ardumont updated the summary of D2135: package.debian: Re-implement debian loader within the package loader mechanism.
Oct 15 2019, 1:10 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2134: debian.lister: Add integration test which checks scheduled tasks.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/441/ for more details.

Oct 15 2019, 12:27 PM
ardumont updated the diff for D2134: debian.lister: Add integration test which checks scheduled tasks.

Rebase to latest master

Oct 15 2019, 12:24 PM
ardumont committed rDLS960868badb08: pypi.tests: Remove trailing _ in test method name (authored by ardumont).
pypi.tests: Remove trailing _ in test method name
Oct 15 2019, 12:23 PM
ardumont committed rDLSb73c657ea7a2: npm.lister: Align docstrings (authored by ardumont).
npm.lister: Align docstrings
Oct 15 2019, 12:23 PM
ardumont committed rDLSb4867ccda965: npm.tests: Add an integration test on listing with pagination (authored by ardumont).
npm.tests: Add an integration test on listing with pagination
Oct 15 2019, 12:23 PM
ardumont closed D2139: npm.tests: Add an integration test on listing with pagination.
Oct 15 2019, 12:23 PM
swh-public-ci added a comment to D2139: npm.tests: Add an integration test on listing with pagination.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/440/ for more details.

Oct 15 2019, 12:23 PM
ardumont updated the diff for D2139: npm.tests: Add an integration test on listing with pagination.

Plug diff to master

Oct 15 2019, 12:20 PM
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/185/ for more details.

Oct 15 2019, 12:19 PM · Debian loader, Core Loader
swh-public-ci added a comment to D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Build is green
See https://jenkins.softwareheritage.org/job/DLDBASE/job/tox/184/ for more details.

Oct 15 2019, 12:18 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.

Diff against package-loader (not master :/)

Oct 15 2019, 12:17 PM · Debian loader, Core Loader
ardumont updated the diff for D2135: package.debian: Re-implement debian loader within the package loader mechanism.
  • test_debian: Add test around get_package_metadata function
Oct 15 2019, 12:17 PM · Debian loader, Core Loader
anlambert added inline comments to D2131: [POC] Add keycloak service and sample SoftwareHeritage realm.
Oct 15 2019, 12:05 PM
anlambert accepted D2139: npm.tests: Add an integration test on listing with pagination.

Looks good !

Oct 15 2019, 12:03 PM