Diffusion Provenance database 90ef2faef5c6

Merge swh-provenance tools in main repository
90ef2faef5c6
Actions

Description

Merge swh-provenance tools in main repository

Details

Provenance

olasd	Authored on May 11 2022, 4:52 PM
olasd	Pushed on May 11 2022, 5:22 PM

Parents

rDPROV74ef01d4f4ec: Drop conflicting .gitignore
rDPROV54eb96c0184b: Bump mypy to v0.942

Branches

Unknown

Tags

Unknown

Build Status

Buildable 29322
Build 45821: test-and-build	Jenkins console · Jenkins

Event Timeline

olasd committed rDPROV90ef2faef5c6: Merge swh-provenance tools in main repository (authored by olasd).May 11 2022, 4:52 PM

Harbormaster failed to build B29322: rDPROV90ef2faef5c6: Merge swh-provenance tools in main repository!May 11 2022, 5:25 PM

Merged Changes

74ef01d4f4ec Drop conflicting .gitignore
Author
olasd
Browse Repository
Failed
No Audits
cd4be335d34b Move all tools to swh/provenance/tools
Author
olasd
Browse Repository
Failed
No Audits
edf8f1b8dbbb Add client/server scripts for the origin-revision layer
Author
aeviso
Browse Repository
Failed
No Audits
8ffdc1734c99 Add flatten parameter to revisions client
Author
aeviso
Browse Repository
Failed
No Audits
e09f2618fc33 Add latest revision date to server stats
Author
aeviso
Browse Repository
Failed
No Audits
b3844caaba92 Add isort configuration and make script compliant with it
Author
aeviso
Browse Repository
Failed
No Audits
69cfb8771348 Simplify client logic
Author
aeviso
Browse Repository
Failed
No Audits
e71621469b30 Remove persistent connection from server
Author
aeviso
Browse Repository
Failed
No Audits
cff60957c720 Fix provenance object initialization
Author
aeviso
Browse Repository
Failed
No Audits
ca22b911c3c7 Update find first/all and improve type annotations
Author
aeviso
Browse Repository
Failed
No Audits
dc09c6af26c0 Refactor client/server to dispatch revisions in batches
Author
aeviso
Browse Repository
Failed
No Audits
0b732cfa737f Improve statistics logic
Author
aeviso
Browse Repository
Failed
No Audits
2ca8e31bebaf Move client/server config to a file
Author
aeviso
Browse Repository
Failed
No Audits
ed4824526e80 Update revision client/server scripts
Author
aeviso
Browse Repository
Failed
No Audits
50ed46d1d81c Make find first/all scripts backend agnostic
Author
aeviso
Browse Repository
Failed
No Audits
128e4a53b5aa Update auxiliar scripts and make the compliant with black and isort
Author
aeviso
Browse Repository
Failed
No Audits
df1b1164a07f Improve date parsing
Author
aeviso
Browse Repository
Failed
No Audits
c0adb80b9318 Updated client to use new module's interface.
Author
aeviso
Browse Repository
Failed
No Audits
cf5c292e4d3a Updated client/server.
Author
aeviso
Browse Repository
Failed
No Audits
e02074dc37b4 Updated scripts to latest provenance API.
Author
aeviso
Browse Repository
Failed
No Audits
eff9a4983c9a Code clean-up.
Author
aeviso
Browse Repository
Failed
No Audits
3933c17f5e01 Fixed histogram calculation to distinguish root.
Author
aeviso
Browse Repository
Failed
No Audits
3d9ef8ebeb68 Added histogram utility.
Author
aeviso
Browse Repository
Failed
No Audits
1d12a7e0c647 Updated tools to use latest version of the module.
Author
aeviso
Browse Repository
Failed
No Audits
155287f49e09 Refactored server to take command line parameters.
Author
aeviso
Browse Repository
Failed
No Audits
82d7f033f82f New utility to query occurrencies of a given file.
Author
aeviso
Browse Repository
Failed
No Audits
ffc97956853b Added stats about the root directory as frontier.
Author
aeviso
Browse Repository
Failed
No Audits
0155d5b39884 Refactored utility get revisions from the archive.
Author
aeviso
Browse Repository
Failed
No Audits
84a45d9bb60d Minor fixes to metrics script.
Author
aeviso
Browse Repository
Failed
No Audits
a68b5a5d912d Added script to get db metrics.
Author
aeviso
Browse Repository
Failed
No Audits
d4d814c9cceb Ignore list updated.
Author
aeviso
Browse Repository
Failed
No Audits
9e696875cf7a New script to check db structure.
Author
aeviso
Browse Repository
Failed
No Audits
a2d25d1b85be Refactored to use old queries over first db.
Author
aeviso
Browse Repository
Failed
No Audits
402476374f2f Refactor client to parallelize in two levels.
Author
aeviso
Browse Repository
Failed
No Audits
53cc0182e3be Server/client tools for provenance db creation.
Author
aeviso
Browse Repository
Failed
No Audits
be770b5139ee New script to compare dbs by first occurrence.
Author
aeviso
Browse Repository
Failed
No Audits
f8b8ea064393 Improved logging and cli feedback.
Author
aeviso
Browse Repository
Failed
No Audits
ba4801c0a243 Output comparison tool.
Author
aeviso
Browse Repository
Failed
No Audits
286d0084692e Content comparison script
Author
aeviso
Browse Repository
Failed
No Audits

Changes (17)

Path

Size

swh/

provenance/

tools/

rDPROV90ef2faef5c6

View Options

swh/provenance/tools/compare-all.py

View Options

swh/provenance/tools/compare-first.py

View Options

swh/provenance/tools/count.py

View Options

swh/provenance/tools/dump.py

View Options

swh/provenance/tools/find-blob.py

View Options

swh/provenance/tools/histogram.py

View Options

swh/provenance/tools/metrics.py

View Options

swh/provenance/tools/origins/client.py

View Options

swh/provenance/tools/origins/server.py

View Options

swh/provenance/tools/revisions/client.py

View Options

swh/provenance/tools/revisions/server.py

View Options

swh/provenance/tools/revisions_format.py

View Options

swh/provenance/tools/revisions_pick.py

View Options

swh/provenance/tools/revisions_sort.py

Merge swh-provenance tools in main repository90ef2faef5c6Actions

Description

Details

Event Timeline

Merged Changes

Changes (17)

rDPROV90ef2faef5c6

swh/provenance/tools/compare-all.py

swh/provenance/tools/compare-first.py

swh/provenance/tools/count.py

swh/provenance/tools/dump.py

swh/provenance/tools/find-blob.py

swh/provenance/tools/histogram.py

swh/provenance/tools/metrics.py

swh/provenance/tools/origins/client.py

swh/provenance/tools/origins/server.py

swh/provenance/tools/revisions/client.py

swh/provenance/tools/revisions/server.py

swh/provenance/tools/revisions_format.py

swh/provenance/tools/revisions_pick.py

swh/provenance/tools/revisions_sort.py

Merge swh-provenance tools in main repository
90ef2faef5c6
Actions