In D2542#60623, @ardumont wrote:

Also if we stopped using dict but object, that'd be clearer... Optional[OriginVisit] is the type we want here, i think.
I think that's in the pipe ;)

Jan 17 2020, 3:06 PM

ardumont added a comment to D2542: Make origin_visit_get_random return None instead of {} if there are no results..

Maybe it's my FP or ADT background leaking, in that for me, "X = always 1 object", "Option<X> = 0 or 1 object", "container of X = 0 or 1 or many objects".

Jan 17 2020, 3:04 PM

ardumont accepted D2547: Fix sphinx warnings.

Jan 17 2020, 2:59 PM

swh-public-ci added a comment to D2547: Fix sphinx warnings.

Build is green
See https://jenkins.softwareheritage.org/job/DCIDX/job/tox/668/ for more details.

Jan 17 2020, 2:58 PM

vlorentz added a comment to D2542: Make origin_visit_get_random return None instead of {} if there are no results..

In D2542#60532, @ardumont wrote:

In that case, I prefer an empty dict or an empty list.
Instead of Optional[Dict] or Optional[List], which i found convoluted (especially now that we are adding types)...

Jan 17 2020, 2:58 PM

ardumont committed rDLDBASE132d079572ae: core.loader: Drop retro-compatibility class names (authored by ardumont).

core.loader: Drop retro-compatibility class names

Jan 17 2020, 2:57 PM

ardumont committed rDLDBASE927214401f28: README: Update class names (authored by ardumont).

README: Update class names

Jan 17 2020, 2:57 PM

ardumont committed rDLDHG61c06bfc0aec: mercurial.loader: Migrate from UnbufferedLoader to DVCSLoader (authored by ardumont).

mercurial.loader: Migrate from UnbufferedLoader to DVCSLoader

Jan 17 2020, 2:55 PM

anlambert created D2547: Fix sphinx warnings.

Jan 17 2020, 2:54 PM

ardumont committed rDLDG519fcf06e84f: git.loader: Migrate from UnbufferedLoader to DVCSLoader (authored by ardumont).

git.loader: Migrate from UnbufferedLoader to DVCSLoader

Jan 17 2020, 2:51 PM

ardumont committed rDLS4b383abc5650: github.lister: Use Retry-After header when rate limit reached (authored by ardumont).

github.lister: Use Retry-After header when rate limit reached

Jan 17 2020, 2:20 PM

ardumont closed D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 2:20 PM

swh-public-ci added a comment to D2545: github.lister: Use Retry-After header when rate limit reached.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/535/ for more details.

Jan 17 2020, 2:19 PM

ardumont updated the diff for D2545: github.lister: Use Retry-After header when rate limit reached.

Plug to master branch

Jan 17 2020, 2:16 PM

douardda committed rDENV7fd9330b3fd2: docker/tox: install pdbpp in py3 environment (authored by douardda).

docker/tox: install pdbpp in py3 environment

Jan 17 2020, 2:13 PM

douardda committed rDENV5357798c55a6: docker/tox: add {posargs} to the pytest cli (authored by douardda).

docker/tox: add {posargs} to the pytest cli

Jan 17 2020, 2:13 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOe07c742bc183: Updated backport on buster-swh from debian/0.0.165-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Updated backport on buster-swh from debian/0.0.165-1_swh1 (unstable-swh)

Jan 17 2020, 2:12 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO2ebcbc97a682: Merge tag 'debian/0.0.165-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Merge tag 'debian/0.0.165-1_swh1' into debian/buster-swh

Jan 17 2020, 2:12 PM

anlambert triaged T2188: Fix documentation build on Jenkins as Normal priority.

Jan 17 2020, 2:10 PM · Documentation

Harbormaster failed to build B10169: rDSTO91c20e86f1fa: pristine-tar data for swh-storage_0.0.165.orig.tar.gz for rDSTO91c20e86f1fa: pristine-tar data for swh-storage_0.0.165.orig.tar.gz!

Jan 17 2020, 2:10 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO91c20e86f1fa: pristine-tar data for swh-storage_0.0.165.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

pristine-tar data for swh-storage_0.0.165.orig.tar.gz

Jan 17 2020, 2:09 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOac79988e4c4f: Update upstream source from tag 'debian/upstream/0.0.165' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Update upstream source from tag 'debian/upstream/0.0.165'

Jan 17 2020, 2:09 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO079fa613f5a4: New upstream version 0.0.165 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

New upstream version 0.0.165

Jan 17 2020, 2:09 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO92af2cd93aad: Updated debian changelog for version 0.0.165 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Updated debian changelog for version 0.0.165

Jan 17 2020, 2:09 PM

ardumont committed rDSTObf77f143f065: storage.retry: Fix objects loading when using generator parameters (authored by ardumont).

storage.retry: Fix objects loading when using generator parameters

Jan 17 2020, 2:02 PM

vlorentz accepted D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 1:49 PM

anlambert committed rDICPc1f5784da6b4: test_deposit: Use http scheme in BASE_URL (authored by anlambert).

test_deposit: Use http scheme in BASE_URL

Jan 17 2020, 1:19 PM

anlambert closed D2546: test_deposit: Use http scheme in BASE_URL.

Jan 17 2020, 1:19 PM

ardumont added a comment to T2029: cran lister: Align lister to output list of tarballs per origin.

The original description of this task was adapted by D2531 D2532 D2524.
A sample of what's been listed and ingested can be seen through the staging webapp instance [1].

Jan 17 2020, 12:35 PM · Origin-CRAN, Archive coverage

ardumont renamed T2029: cran lister: Align lister to output list of tarballs per origin from cran lister: Align lister to output list of tarballs per origin (if possible) to cran lister: Align lister to output list of tarballs per origin.

Jan 17 2020, 12:25 PM · Origin-CRAN, Archive coverage

ardumont accepted D2546: test_deposit: Use http scheme in BASE_URL.

I was heading in that direction!

Jan 17 2020, 12:23 PM

swh-public-ci added a comment to D2546: test_deposit: Use http scheme in BASE_URL.

Build is green
See https://jenkins.softwareheritage.org/job/DICP/job/tox/22/ for more details.

Jan 17 2020, 12:15 PM

anlambert created D2546: test_deposit: Use http scheme in BASE_URL.

Jan 17 2020, 12:14 PM

ardumont updated the summary of D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 12:03 PM

ardumont updated the summary of D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 12:03 PM

ardumont updated the summary of D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 12:02 PM

anlambert committed rDWAPPS6de6849ca5df: tests/resources: Update elasticsearch sample JSON response (authored by anlambert).

tests/resources: Update elasticsearch sample JSON response

Jan 17 2020, 11:52 AM

Harbormaster failed to build B10164: rDWAPPSf4a7ed735d1a: common/origin_save: Fix elasticsearch total hits extraction for rDWAPPSf4a7ed735d1a: common/origin_save: Fix elasticsearch total hits extraction!

Jan 17 2020, 11:45 AM

anlambert committed rDWAPPSf4a7ed735d1a: common/origin_save: Fix elasticsearch total hits extraction (authored by anlambert).

common/origin_save: Fix elasticsearch total hits extraction

Jan 17 2020, 11:41 AM

ardumont accepted D2538: Remove test_content_*_same_input, which check for behavior we do not want to guarantee..

ok then.

Jan 17 2020, 11:26 AM

ardumont retitled D2545: github.lister: Use Retry-After header when rate limit reached from github.lister: Simplify rate limit approach according to github doc to github.lister: Use Retry-After header when rate limit reached.

Jan 17 2020, 10:36 AM

douardda updated the task description for T1805: Public API v2.

Jan 17 2020, 10:21 AM · meta-task, Web app

douardda updated the task description for T1805: Public API v2.

Jan 17 2020, 10:21 AM · meta-task, Web app

ardumont added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Could you please update the title and the description according to the current state?
(i you don't have time, please tell me so i will ;)

Jan 17 2020, 9:17 AM · Lister

ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Jan 17 2020, 8:41 AM · Lister

Jan 16 2020

lewo added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Jan 16 2020, 10:12 PM · Lister

swh-public-ci added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/534/ for more details.

Jan 16 2020, 10:03 PM · Lister

lewo updated the diff for D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

And fix another one :/

Jan 16 2020, 10:00 PM · Lister

ardumont added inline comments to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Jan 16 2020, 8:20 PM · Lister

Harbormaster failed remote builds in B10162: Diff 9099 for D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file!

Jan 16 2020, 7:36 PM · Lister

swh-public-ci added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Build has FAILED

Jan 16 2020, 7:36 PM · Lister

lewo updated the diff for D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Fix the loader name in the test

Jan 16 2020, 7:33 PM · Lister

olasd committed rSPSITEeb179416dbcd: Set an icinga check URI for the keycloak reverse proxy (authored by olasd).

Set an icinga check URI for the keycloak reverse proxy

Jan 16 2020, 7:31 PM

olasd changed the status of T2162: Setup a centralized authentication service, a subtask of T1982: Add user authentication and permissions to swh-web, from Open to Work in Progress.

Jan 16 2020, 7:30 PM · Web app

olasd changed the status of T2162: Setup a centralized authentication service, a subtask of T2163: Hook up sentry to centralized authentication, from Open to Work in Progress.

Jan 16 2020, 7:30 PM · Sentry

olasd changed the status of T2162: Setup a centralized authentication service from Open to Work in Progress.

Keycloak has been installed on a new vm, and the (empty) install is available at https://idp.softwareheritage.org/.

Jan 16 2020, 7:30 PM · System administration

olasd committed rSPPRIVCf16997184b8c: Add keycloak admin password (authored by olasd).

Add keycloak admin password

Jan 16 2020, 7:16 PM

olasd committed rSPSITE60706cdf5601: pgbouncer: add ignore_startup_parameters setting (authored by olasd).

pgbouncer: add ignore_startup_parameters setting

Jan 16 2020, 7:04 PM

olasd committed rSENVa482a98b28cf: Add facts for kelvingrove (authored by olasd).

Add facts for kelvingrove

Jan 16 2020, 6:52 PM

olasd committed rSENVb4061f1b01f8: Import module treydock/keycloak (authored by olasd).

Import module treydock/keycloak

Jan 16 2020, 6:52 PM

swh-public-ci added a comment to D2545: github.lister: Use Retry-After header when rate limit reached.

Build is green
See https://jenkins.softwareheritage.org/job/DLS/job/tox/532/ for more details.

Jan 16 2020, 6:52 PM

ardumont created D2545: github.lister: Use Retry-After header when rate limit reached.

Jan 16 2020, 6:48 PM

vlorentz committed rDSTOC96f8aa5093fe: Use prepared statements as much as possible. (authored by vlorentz).

Use prepared statements as much as possible.

Jan 16 2020, 6:42 PM

vlorentz committed rDSTOC47df742bb6dc: Add type annotations. (authored by vlorentz).

Add type annotations.

Jan 16 2020, 6:19 PM

anlambert committed rDDEPfbbf6e74a1fa: tests/gunicorn_config: Fix tests after recent changes in swh-core (authored by anlambert).

tests/gunicorn_config: Fix tests after recent changes in swh-core

Jan 16 2020, 6:15 PM

anlambert closed D2544: gunicorn_config: Fix tests after recent changes in swh-core.

Jan 16 2020, 6:15 PM

swh-public-ci added a comment to D2544: gunicorn_config: Fix tests after recent changes in swh-core.

Build is green
See https://jenkins.softwareheritage.org/job/DDEP/job/tox/249/ for more details.

Jan 16 2020, 6:14 PM

ardumont accepted D2544: gunicorn_config: Fix tests after recent changes in swh-core.

Jan 16 2020, 6:12 PM

ardumont committed rDLDBASEdec0ad6d19ec: loader.tests: Add filter and buffer proxy storage (authored by ardumont).

loader.tests: Add filter and buffer proxy storage

Jan 16 2020, 6:10 PM

anlambert created D2544: gunicorn_config: Fix tests after recent changes in swh-core.

Jan 16 2020, 6:09 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO72ea9d22c235: Merge tag 'debian/0.0.164-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Merge tag 'debian/0.0.164-1_swh1' into debian/buster-swh

Jan 16 2020, 6:08 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOa6742ee499da: Updated backport on buster-swh from debian/0.0.164-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Updated backport on buster-swh from debian/0.0.164-1_swh1 (unstable-swh)

Jan 16 2020, 6:08 PM

Harbormaster failed to build B10157: rDSTO7455cab8c71d: pristine-tar data for swh-storage_0.0.164.orig.tar.gz for rDSTO7455cab8c71d: pristine-tar data for swh-storage_0.0.164.orig.tar.gz!

Jan 16 2020, 6:05 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO7455cab8c71d: pristine-tar data for swh-storage_0.0.164.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

pristine-tar data for swh-storage_0.0.164.orig.tar.gz

Jan 16 2020, 6:05 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO4738b2e64b1f: New upstream version 0.0.164 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

New upstream version 0.0.164

Jan 16 2020, 6:05 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTO45789870d4d0: Update upstream source from tag 'debian/upstream/0.0.164' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Update upstream source from tag 'debian/upstream/0.0.164'

Jan 16 2020, 6:05 PM

Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSTOa7cbaf1f7831: Updated debian changelog for version 0.0.164 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).

Updated debian changelog for version 0.0.164

Jan 16 2020, 6:05 PM

olasd committed rSPSITE97bfeb200d7b: Improve letsencrypt livedns hook (authored by olasd).

Improve letsencrypt livedns hook

Jan 16 2020, 5:59 PM

olasd committed rSPSITEb190daac32cd: Add keycloak letsencrypt certificate (authored by olasd).

Add keycloak letsencrypt certificate

Jan 16 2020, 5:59 PM

anlambert committed rDSTOcc29708564c3: storage: Fix objects loading when using generator parameters (authored by anlambert).

storage: Fix objects loading when using generator parameters

Jan 16 2020, 5:57 PM

All StoriesUse ResultsEdit QueryHide Query

Jan 17 2020

Jan 16 2020

All Stories
Use Results
Edit Query
Hide Query