Page MenuHomeSoftware Heritage
Feed All Stories

May 7 2021

Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Remove pytest-postgresql hotfix

May 7 2021, 1:26 PM
Harbormaster failed remote builds in B21367: Diff 20388 for D5708: git_bare: When possible, use swh-graph instead of swh-storage to query revision history!
May 7 2021, 12:41 PM
swh-public-ci added a comment to D5708: git_bare: When possible, use swh-graph instead of swh-storage to query revision history.

Build has FAILED

May 7 2021, 12:41 PM
vlorentz updated the diff for D5708: git_bare: When possible, use swh-graph instead of swh-storage to query revision history.

wrong base commit

May 7 2021, 12:40 PM
vlorentz requested review of D5708: git_bare: When possible, use swh-graph instead of swh-storage to query revision history.
May 7 2021, 12:40 PM
anlambert requested review of D5710: api/throttling: Increase rate limit for authenticated users.
May 7 2021, 12:35 PM
anlambert added a revision to T3312: web API rate limit: 10x more quota for authenticated users: D5710: api/throttling: Increase rate limit for authenticated users.
May 7 2021, 12:19 PM · Web app
vsellier requested review of D5709: Add a monitoring alert when logstash is failing to send logs to ES.
May 7 2021, 12:09 PM
vsellier added a revision to T3222: Monitor daily indexes are present on the log cluster and logs are correctly ingested: D5709: Add a monitoring alert when logstash is failing to send logs to ES.
May 7 2021, 12:09 PM · System administration
ardumont moved T3203: docs: Document the firewall installation and procedures from Weekly backlog to code-review/await-feedback/pause on the System administration board.
May 7 2021, 12:07 PM · Documentation, System administration
ardumont changed the status of T3310: Deploy sourceforge lister on staging, a subtask of T735: SourceForge lister, from Open to Work in Progress.
May 7 2021, 12:07 PM · Origin-SourceForge
ardumont changed the status of T3310: Deploy sourceforge lister on staging from Open to Work in Progress.
May 7 2021, 12:07 PM · System administration, Origin-SourceForge
vlorentz claimed T3314: Test swh.storage.cassandra with ScyllaDB.
May 7 2021, 12:07 PM · Storage manager
ardumont accepted D5691: Remove `os.environ` manipulation in tests.

lgtm

May 7 2021, 12:06 PM
vlorentz added a subtask for T1892: Cassandra as a storage backend: T3314: Test swh.storage.cassandra with ScyllaDB.
May 7 2021, 12:06 PM · meta-task, Storage manager
vlorentz added a parent task for T3314: Test swh.storage.cassandra with ScyllaDB: T1892: Cassandra as a storage backend.
May 7 2021, 12:06 PM · Storage manager
vlorentz triaged T3314: Test swh.storage.cassandra with ScyllaDB as Normal priority.
May 7 2021, 12:05 PM · Storage manager
swh-public-ci added a comment to D5687: Make the Mercurial loader incremental.

Build is green

May 7 2021, 12:02 PM
swh-public-ci added a comment to D5691: Remove `os.environ` manipulation in tests.

Build is green

May 7 2021, 12:00 PM
Alphare updated the diff for D5687: Make the Mercurial loader incremental.

Rebase + remove useless loader call in test

May 7 2021, 11:58 AM
Alphare added inline comments to D5691: Remove `os.environ` manipulation in tests.
May 7 2021, 11:58 AM
Alphare updated the diff for D5691: Remove `os.environ` manipulation in tests.

Better fix for environment manipulation

May 7 2021, 11:58 AM
swh-public-ci added a comment to D5676: Allow privileged user to trigger save code now bundle visit type.

Build is green

May 7 2021, 11:50 AM
ardumont added inline comments to D5676: Allow privileged user to trigger save code now bundle visit type.
May 7 2021, 11:49 AM
rdicosmo added a comment to T3312: web API rate limit: 10x more quota for authenticated users.

If we need to tune rate limit for specific type of users, this could be easily added in the new throttling
code I am currently working on.

May 7 2021, 11:45 AM · Web app
ardumont retitled D5676: Allow privileged user to trigger save code now bundle visit type from wip: Allow privileged user to trigger save code now bundle visit type to Allow privileged user to trigger save code now bundle visit type.
May 7 2021, 11:44 AM
ardumont updated the summary of D5696: tests: Add new ambassador user for frontend tests.
May 7 2021, 11:43 AM
ardumont updated the summary of D5676: Allow privileged user to trigger save code now bundle visit type.
May 7 2021, 11:42 AM
ardumont updated the diff for D5676: Allow privileged user to trigger save code now bundle visit type.
  • Add python test to cover the bundle type
  • Add frontend tests to ensure the ui behaves as expected.
May 7 2021, 11:41 AM
anlambert added a comment to T3312: web API rate limit: 10x more quota for authenticated users.

Thanks! Please make sure we can also have specific rate limits for specific classees of authenticated users, on top of the default new rate limit for all registered users.

May 7 2021, 11:20 AM · Web app
rdicosmo committed rMSLD71dc9ed81cfb: Add eLife logo (authored by rdicosmo).
Add eLife logo
May 7 2021, 11:16 AM
rdicosmo committed rMSLD0ad820cf9a76: Update growth in SIF slides (authored by rdicosmo).
Update growth in SIF slides
May 7 2021, 11:09 AM
rdicosmo committed rMSLDa38474327e31: Update growth figures (authored by rdicosmo).
Update growth figures
May 7 2021, 11:08 AM
rdicosmo added a comment to T3312: web API rate limit: 10x more quota for authenticated users.

@zack, @rdicosmo yes this is totally feasible by adding a dedicated Django REST Framework throttling handler for authenticated users.

Let's work on that then.

May 7 2021, 11:05 AM · Web app
anlambert changed the status of T3312: web API rate limit: 10x more quota for authenticated users from Open to Work in Progress.

@zack, @rdicosmo yes this is totally feasible by adding a dedicated Django REST Framework throttling handler for authenticated users.

May 7 2021, 10:58 AM · Web app
rdicosmo committed rMSLD04062c8f1869: Structure (authored by rdicosmo).
Structure
May 7 2021, 10:28 AM
vlorentz added inline comments to D5707: fix the semantic of max_edges parameter.
May 7 2021, 10:26 AM
rdicosmo committed rMSLDbd56776e3d4d: Slides SIF reproductibilite (authored by rdicosmo).
Slides SIF reproductibilite
May 7 2021, 10:20 AM
rdicosmo committed rMSLDd4b4e016ea3c: Add pillar of OS entry in ARDC module (authored by rdicosmo).
Add pillar of OS entry in ARDC module
May 7 2021, 10:20 AM
vsellier added a project to T3313: Web API: per-user accounting: System administration.
May 7 2021, 9:54 AM · System administration, Web app
zack triaged T3313: Web API: per-user accounting as Low priority.
May 7 2021, 9:48 AM · System administration, Web app
rdicosmo added a comment to T3312: web API rate limit: 10x more quota for authenticated users.

@anlambert ; ping me when this is done, so we can answer some pending requests :-)

May 7 2021, 9:44 AM · Web app
zack triaged T3312: web API rate limit: 10x more quota for authenticated users as High priority.
May 7 2021, 9:35 AM · Web app
ardumont added inline comments to D5691: Remove `os.environ` manipulation in tests.
May 7 2021, 9:33 AM
ardumont requested changes to D5692: document the firewalls upgrade procedure.

couples of questions and suggestions inline. Request changes for the sake of those though.

May 7 2021, 9:16 AM
ardumont updated the summary of D5676: Allow privileged user to trigger save code now bundle visit type.
May 7 2021, 8:58 AM
swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build is green

May 7 2021, 2:15 AM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.

typo

May 7 2021, 2:12 AM
Harbormaster failed remote builds in B21355: Diff 20376 for D5707: fix the semantic of max_edges parameter!
May 7 2021, 2:12 AM
swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build has FAILED

May 7 2021, 2:12 AM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.

remove unecessered line on test_api_client

May 7 2021, 2:10 AM
Harbormaster failed remote builds in B21354: Diff 20374 for D5707: fix the semantic of max_edges parameter!
May 7 2021, 2:09 AM
swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build has FAILED

May 7 2021, 2:09 AM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.

fix typo and errors

May 7 2021, 2:07 AM
Hakimb added inline comments to D5707: fix the semantic of max_edges parameter.
May 7 2021, 2:03 AM
Hakimb added a comment to D5707: fix the semantic of max_edges parameter.

What is the difference between nbEdgesAccessed and currentEdgeAccessed? It looks like the latter is not used at all (only incremented, but never read), but I may be missing something

I see that in multiple place, you set currentEdgeAccessed = 0; before breaking/returning. What is it for? Is the same instance of Traversal used to serve multiple queries?

May 7 2021, 1:38 AM
Hakimb added inline comments to D5707: fix the semantic of max_edges parameter.
May 7 2021, 1:24 AM
vlorentz added a comment to D5707: fix the semantic of max_edges parameter.

What is the difference between nbEdgesAccessed and currentEdgeAccessed? It looks like the latter is not used at all (only incremented, but never read), but I may be missing something

May 7 2021, 1:00 AM

May 6 2021

swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build is green

May 6 2021, 8:54 PM
swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build is green

May 6 2021, 8:51 PM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.

change commit name

May 6 2021, 8:51 PM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.

squash commits

May 6 2021, 8:49 PM
swh-public-ci added a comment to D5707: fix the semantic of max_edges parameter.

Build is green

May 6 2021, 8:49 PM
Hakimb updated the diff for D5707: fix the semantic of max_edges parameter.
  • add all possible values for the request
May 6 2021, 8:46 PM
Hakimb requested review of D5707: fix the semantic of max_edges parameter.
May 6 2021, 8:38 PM
zack added a comment to T3311: Use .gitmodules to discover origins.

I think the only issue with (3) is not being retroactive

May 6 2021, 6:49 PM · Archive coverage, Git loader
ardumont requested review of D5676: Allow privileged user to trigger save code now bundle visit type.
May 6 2021, 6:41 PM
vlorentz added a project to T3311: Use .gitmodules to discover origins: Archive coverage.
May 6 2021, 6:34 PM · Archive coverage, Git loader
vlorentz added a comment to T3311: Use .gitmodules to discover origins.

I think the only issue with (3) is not being retroactive

May 6 2021, 6:30 PM · Archive coverage, Git loader
vlorentz closed D5699: swh-indexer: Use swh.core 0.14.
May 6 2021, 6:28 PM
vlorentz committed rDCIDX8fd4846af546: Use swh.core 0.14 (authored by vlorentz).
Use swh.core 0.14
May 6 2021, 6:28 PM
zack added a comment to T3311: Use .gitmodules to discover origins.

This is a good idea, thanks for raising it.

May 6 2021, 6:06 PM · Archive coverage, Git loader
vlorentz committed rDWCM6c00baa21d16: Fix crash in validateThingOrId when formatting error messages. (authored by vlorentz).
Fix crash in validateThingOrId when formatting error messages.
May 6 2021, 5:54 PM
Alphare closed D5706: Initial commit.
May 6 2021, 5:31 PM
Alphare committed rDLDBZR8352a4454af5: Initial commit (authored by Alphare).
Initial commit
May 6 2021, 5:31 PM
ardumont accepted D5706: Initial commit.

lgtm

May 6 2021, 5:29 PM
Alphare requested review of D5706: Initial commit.
May 6 2021, 5:26 PM
ardumont added a comment to T3310: Deploy sourceforge lister on staging.

Note that it helped yet but i reproduced the issue in jenkins *locally*.
Prior to that, other issues with our moving cogs (swh.core, etc...) prevented it
(other unrelated failures arose).

May 6 2021, 5:19 PM · System administration, Origin-SourceForge
ardumont accepted D5699: swh-indexer: Use swh.core 0.14.
May 6 2021, 5:16 PM
vlorentz requested review of D5699: swh-indexer: Use swh.core 0.14.
May 6 2021, 5:16 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH479b38dfe5a8: Updated backport on buster-swh from debian/0.14.2-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.14.2-1_swh1 (unstable-swh)
May 6 2021, 5:15 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH0035687059c3: Merge tag 'debian/0.14.2-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.14.2-1_swh1' into debian/buster-swh
May 6 2021, 5:15 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH27e47420a9a5: pristine-tar data for swh-scheduler_0.14.2.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-scheduler_0.14.2.orig.tar.gz
May 6 2021, 5:13 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH04db8225969f: Updated debian changelog for version 0.14.2 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated debian changelog for version 0.14.2
May 6 2021, 5:13 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCHebe1d6d8c82f: Update upstream source from tag 'debian/upstream/0.14.2' (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Update upstream source from tag 'debian/upstream/0.14.2'
May 6 2021, 5:13 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH628a203d6f38: New upstream version 0.14.2 (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
New upstream version 0.14.2
May 6 2021, 5:13 PM
vlorentz closed D5701: swh-vault: Use swh.core 0.14.
May 6 2021, 5:09 PM
vlorentz committed rDVAU35c9f519cd70: Use swh.core 0.14 (authored by vlorentz).
Use swh.core 0.14
May 6 2021, 5:09 PM
vlorentz triaged T3311: Use .gitmodules to discover origins as Low priority.
May 6 2021, 5:07 PM · Archive coverage, Git loader
vlorentz updated the task description for T3179: Add an how-to create a new swh package.
May 6 2021, 5:00 PM · Documentation
vlorentz created BZR loader.
May 6 2021, 4:58 PM
vlorentz closed D5705: Fix flaky test_grab_ready_* tests.
May 6 2021, 4:55 PM
vlorentz committed rDSCHfe9d94905a86: Fix flaky test_grab_ready_* tests (authored by vlorentz).
Fix flaky test_grab_ready_* tests
May 6 2021, 4:55 PM
ardumont accepted D5705: Fix flaky test_grab_ready_* tests.
May 6 2021, 4:54 PM
ardumont added a comment to D5705: Fix flaky test_grab_ready_* tests.

hopefully ;)

May 6 2021, 4:54 PM
swh-public-ci added a comment to D5680: Make the TenaciousProxyStorage retry when a single object add fails.

Build is green

May 6 2021, 4:36 PM
vlorentz requested review of D5705: Fix flaky test_grab_ready_* tests.
May 6 2021, 4:24 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH7225578bdecb: Updated backport on buster-swh from debian/0.14.1-1_swh1 (unstable-swh) (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Updated backport on buster-swh from debian/0.14.1-1_swh1 (unstable-swh)
May 6 2021, 4:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCHdf7ca996dc7f: Merge tag 'debian/0.14.1-1_swh1' into debian/buster-swh (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
Merge tag 'debian/0.14.1-1_swh1' into debian/buster-swh
May 6 2021, 4:19 PM
Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org> committed rDSCH0306c68c5624: pristine-tar data for swh-scheduler_0.14.1.orig.tar.gz (authored by Jenkins for Software Heritage <jenkins@jenkins-debian1.internal.softwareheritage.org>).
pristine-tar data for swh-scheduler_0.14.1.orig.tar.gz
May 6 2021, 4:17 PM