This is an important feature: it has been dormant for a while, but we need to actually start implementing it.
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed All Stories
All Stories
All Stories
Today
Today
rdicosmo raised the priority of T1099: support origin blacklist for archive search and browse from Low to High.
Looks promising ;)
Build is green
Build is green
check-in slides for SoHeal 2020 keynote
olasd committed rCJSWH4ca591ff184a: Drop obsolete args for the automatic backport job (authored by olasd).
Drop obsolete args for the automatic backport job
anlambert committed rDWAPPS299ed02cbebd: package.json: Upgrade dependencies (authored by anlambert).
package.json: Upgrade dependencies
anlambert committed rDWAPPSa4da1d819a45: common/service: Ensure to get last status when looking up origin visit (authored by anlambert).
common/service: Ensure to get last status when looking up origin visit
ardumont committed rDLDBASEaafac87f5c48: Reuse swh.model.from_disk.iter_directory function (authored by ardumont).
Reuse swh.model.from_disk.iter_directory function
ardumont updated the test plan for D3393: loader.svn: Reuse swh.model.from_disk.iter_directory function.
ardumont updated the test plan for D3392: loader-core: Reuse swh.model.from_disk.iter_directory function.
swh-public-ci added a comment to D3392: loader-core: Reuse swh.model.from_disk.iter_directory function.
Build is green
ardumont committed rDLDSVNee23fd758227: Reuse swh.model.from_disk.iter_directory function (authored by ardumont).
Reuse swh.model.from_disk.iter_directory function
swh-public-ci added a comment to D3393: loader.svn: Reuse swh.model.from_disk.iter_directory function.
Build is green
swh-public-ci added a comment to D3392: loader-core: Reuse swh.model.from_disk.iter_directory function.
Build has FAILED
ardumont committed rDMOD8863b5c186dd: Refactor common loader behavior within from_disk.iter_directory (authored by ardumont).
Refactor common loader behavior within from_disk.iter_directory
ardumont committed rDMOD363b1659a6f5: Unify object_type some more within the merkle and from_disk modules (authored by ardumont).
Unify object_type some more within the merkle and from_disk modules
swh-public-ci added a comment to D3395: common/service: Ensure to get last status when looking up origin visit.
Build is green
swh-public-ci added a comment to D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
Build is green
ardumont updated the diff for D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
- Use "refactor" instead of "factorize" term
- Adapt according to review
swh-public-ci added a comment to D3390: Unify object_type some more within the merkle and from_disk modules.
Build is green
ardumont updated the diff for D3390: Unify object_type some more within the merkle and from_disk modules.
Adapt according to review
ardumont added inline comments to D3390: Unify object_type some more within the merkle and from_disk modules.
anlambert added inline comments to D3390: Unify object_type some more within the merkle and from_disk modules.
ardumont retitled D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function from Factorize common loader behavior within swh.model.from_disk.iter_directory function to Refactor common loader behavior within swh.model.from_disk.iter_directory function.
ardumont added a comment to D3390: Unify object_type some more within the merkle and from_disk modules.
kinda hope that solves [1]
ardumont added inline comments to D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
anlambert accepted D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
Looks good, I added some nitpicking comments.
ardumont added inline comments to D3390: Unify object_type some more within the merkle and from_disk modules.
LGTM, maybe you could set object_type type as Final like in other model classes (see inline comment).
ardumont added a comment to P709 ERROR swh/core/api/tests/test_async.py - ValueError: option names {'--aiohttp-fast'} already added.
Solution that worked for me:
Looks globally fine to me, but I have a few comments/requests.
Build is green
ardumont added a comment to P709 ERROR swh/core/api/tests/test_async.py - ValueError: option names {'--aiohttp-fast'} already added.
tox run is fine
ardumont retitled D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function from Factorize common loader behavior within from_disk.iter_directory to Factorize common loader behavior within swh.model.from_disk.iter_directory function.
ardumont updated the summary of D3390: Unify object_type some more within the merkle and from_disk modules.
ardumont updated the summary of D3390: Unify object_type some more within the merkle and from_disk modules.
Harbormaster failed remote builds in B13256: Diff 12036 for D3393: loader.svn: Reuse swh.model.from_disk.iter_directory function!
swh-public-ci added a comment to D3393: loader.svn: Reuse swh.model.from_disk.iter_directory function.
Build has FAILED
zack added a comment to T2430: lookup ingested tarballs (or similar source code containers) by container checksum.
@civodul I wanted to raise the topic of storing container metadata (in the style of what tools like pristine-tar do) here too, so thanks for giving me the chance :-)
I agree it might be a technical solution, *but*, I'm not sure I see the point.
Didn't you agree that having a "lookup service" from tarball/container checksums to SWHIDs (the Software Heritage identifiers, that can then be used to lookup stuff in the archive) would be enough to satisfy distro needs?
If yes, then "archiving container metadata" could be replaced by simply having a way to add entries to the lookup table. And allowing distros to do so is option that we can explore. (Once the service exists, of course.)
Harbormaster failed remote builds in B13255: Diff 12035 for D3392: loader-core: Reuse swh.model.from_disk.iter_directory function!
swh-public-ci added a comment to D3392: loader-core: Reuse swh.model.from_disk.iter_directory function.
Build has FAILED
swh-public-ci added a comment to D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
Build is green
ardumont updated the diff for D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
Make the returned results a tuple of lists
civodul added a comment to T2430: lookup ingested tarballs (or similar source code containers) by container checksum.
Do I get it right that the primary reason why tarballs aren't systematically archived is that doing so would be too expensive storage-wise (no deduplication)?
swh-public-ci added a comment to D3391: Refactor common loader behavior within swh.model.from_disk.iter_directory function.
Build is green
anlambert committed rDWAPPS76d9162807e0: origin_visits/get_origin_visit: Improve default visit picking strategy (authored by anlambert).
origin_visits/get_origin_visit: Improve default visit picking strategy
swh-public-ci added a comment to D3385: origin_visits/get_origin_visit: Improve default visit picking strategy.
Build is green
ardumont updated the summary of D3390: Unify object_type some more within the merkle and from_disk modules.
anlambert updated the diff for D3385: origin_visits/get_origin_visit: Improve default visit picking strategy.
Update: Improve tests implementation
ardumont added a comment to D3383: Implement {directory,revision,release,snapshot}_metadata_{add,get}..
I'll rewrite this using swh-model and only two endpoints for all types
ardumont updated the summary of D3390: Unify object_type some more within the merkle and from_disk modules.
I'll rewrite this using swh-model and only two endpoints for all types
swh-public-ci added a comment to D3390: Unify object_type some more within the merkle and from_disk modules.
Build is green
Landed as 248c277445adbae5813ba80ce0618858d8126634.
vlorentz committed rDSTO248c277445ad: Move tests of content_metadata_* next to origin_metadata_* (authored by vlorentz).
Move tests of content_metadata_* next to origin_metadata_*
Replaced by linked diffs
Yesterday
Yesterday
nice ;)
swh-public-ci added a comment to D3385: origin_visits/get_origin_visit: Improve default visit picking strategy.
Build is green
anlambert updated the diff for D3385: origin_visits/get_origin_visit: Improve default visit picking strategy.
- Use new swh.storage.algos.origin.origin_get_latest_visit_status utility function in revised get_origin_visit implementation
swh-public-ci added a comment to D3389: Extract the extra_headers from metadata on the Revision model class.
Build is green
douardda updated the diff for D3389: Extract the extra_headers from metadata on the Revision model class.
more mypy vs. attrs-strict fighting
Harbormaster failed remote builds in B13246: Diff 12027 for D3389: Extract the extra_headers from metadata on the Revision model class!
swh-public-ci added a comment to D3389: Extract the extra_headers from metadata on the Revision model class.
Build has FAILED
douardda updated the diff for D3389: Extract the extra_headers from metadata on the Revision model class.
make mypy happy (hopefully)
moranegg triaged T2472: Indexing intrinsic metadata in a deposit using a sub-folder for the content as Normal priority.
Harbormaster failed remote builds in B13245: Diff 12026 for D3389: Extract the extra_headers from metadata on the Revision model class!
swh-public-ci added a comment to D3389: Extract the extra_headers from metadata on the Revision model class.
Build has FAILED
douardda updated the diff for D3389: Extract the extra_headers from metadata on the Revision model class.
restrict extra_headers to (bytes, bytes) only
Harbormaster failed remote builds in B13244: Diff 12025 for D3389: Extract the extra_headers from metadata on the Revision model class!
swh-public-ci added a comment to D3389: Extract the extra_headers from metadata on the Revision model class.
Build has FAILED
douardda updated the diff for D3389: Extract the extra_headers from metadata on the Revision model class.
improve bw-compat support, tests and hypothesis strategies