I was hoping it would be more efficient, but it's not.
I'm committing this anyway in case we ever want to try it again
Depends on D6652.
Details
Details
- Reviewers
- None
- Group Reviewers
Reviewers - Maniphest Tasks
- T3731: Try parallelizing directory_get_entries with an async swh-storage client
Diff Detail
Diff Detail
- Repository
- rDVAU Software Heritage Vault
- Branch
- async
- Lint
No Linters Available - Unit
No Unit Test Coverage - Build Status
Buildable 25061 Build 39162: Phabricator diff pipeline on jenkins Jenkins console · Jenkins Build 39161: arc lint + arc unit
Event Timeline
Comment Actions
Build has FAILED
Patch application report for D6653 (id=24181)
Could not rebase; Attempt merge onto bd649ccb97...
Updating bd649cc..4807ec7 Fast-forward swh/vault/cookers/git_bare.py | 51 +++++++++++++++++++++++++++++++++++++------ 1 file changed, 44 insertions(+), 7 deletions(-)
Changes applied before test
commit 4807ec792e422de0d0c5b6f7cc8e214a27f79a24
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date: Wed Nov 17 18:25:28 2021 +0100
git_bare: Add an alternative using asyncio instead of threads.
I was hoping it would be more efficient, but it's not.
I'm committing this anyway in case we ever want to try it again
commit c26a46f689288090930e22cf0e0f8378728bbe08
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date: Wed Nov 17 18:18:06 2021 +0100
git_bare: Fetch directories concurrently, using threads.
This divides the total wall time by ~2.Link to build: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/187/
See console output for more information: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/187/console