thx
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Dec 16 2022
Dec 16 2022
Dec 15 2022
Dec 15 2022
vlorentz closed T4676: Add Luigi workflow in swh-dataset, a subtask of T2220: swh-graph in production, as Resolved.
vlorentz closed T4676: Add Luigi workflow in swh-dataset, a subtask of T4677: Add support for generating subdatasets in swh.dataset.luigi, as Resolved.
vlorentz added inline comments to D8959: github: Export statsd metrics about API requests and token usage.
vlorentz requested review of D8959: github: Export statsd metrics about API requests and token usage.
Please add comments next to commented out code to explain why it's commented out. (it could be a link to this diff)
Shouldn't it be enabled in prod too, then?
In D8939#232687, @douardda wrote:In D8939#232508, @vlorentz wrote:Could you use a logger instance,
what do you mean by "use a logger instance"?
to avoid attacks
Dec 14 2022
Dec 14 2022
vlorentz updated the task description for T4726: ValueError: Hash tree computation divergence detected while loading https://svn.code.sf.net/p/openautomation/code.
vlorentz committed rDVAUeb055b2c0487: Fix incorrect error messages when failing to connect (authored by vlorentz).
Fix incorrect error messages when failing to connect
Dec 13 2022
Dec 13 2022
Fix crash on non-UTF8 branch names
@KShivendu pointed out that Neo4j may be a strong option too. It doesn't natively support SPARQL, but we could have it as a layer on top of the Tinkerpop API
Actually the open-source version of Virtuoso is unmaintained, and I couldn't figure out how to use it. Blazegraph and Apache Jena look promising too, though.
Dec 12 2022
Dec 12 2022
Dec 8 2022
Dec 8 2022
Add dataset name to the export id
vlorentz closed T4354: Contribute terms to ForgeFed, a subtask of T4249: Choose/define an ontology to use for indexed extrinsic origin metadata, as Resolved.
vlorentz added a comment to D8944: replay: Copy dir states and external paths in copy_from operations.
Are you sure the path argument to add_directory cannot start with a / or contain ..?
Could you use a logger instance, and add if logger.isEnabledFor(logging.DEBUG): before logger.debug statements that use hash_to_hex?
Dec 7 2022
Dec 7 2022
vlorentz committed rDGRPHcd69e48b5acc: Replace RunAll with RunExportCompressUpload (authored by vlorentz).
Replace RunAll with RunExportCompressUpload
vlorentz committed rDGRPH233b0508395a: Prevent incorrect warning from being printed to output files (authored by vlorentz).
Prevent incorrect warning from being printed to output files
vlorentz committed rDGRPH042af3adf5b6: Fix crash when the sensitive dataset directory does not exist (authored by vlorentz).
Fix crash when the sensitive dataset directory does not exist
Remove tool ids from Kafka messages
rebase
I'm tired
rebase
remove useless function
rebase
less awful fix
In D8931#232231, @olasd wrote:Why not just touch all the files?
vlorentz triaged T4719: indexer storage crashes on kafka errors, because of integers in the key as Normal priority.
vlorentz committed rDGRPH66253a872d6b: Add missing dependency on pytest-mock (authored by vlorentz).
Add missing dependency on pytest-mock
vlorentz committed rDGRPHb8ddd6ceadbd: origin_contributors: Fix typo and improve readability (authored by vlorentz).
origin_contributors: Fix typo and improve readability
vlorentz committed rDGRPHe65858a73918: Split swh/graph/luigi.py into modules (authored by vlorentz).
Split swh/graph/luigi.py into modules
vlorentz committed rDGRPHb76801259953: Add CLI script to generate Luigi config and call it (authored by vlorentz).
Add CLI script to generate Luigi config and call it
vlorentz committed rDGRPHdfd4c1dc3b22: ListOriginContributors: Ignore null author/committer in revisions/releases (authored by vlorentz).
ListOriginContributors: Ignore null author/committer in revisions/releases
vlorentz committed rDGRPHab2703efcb9a: Add Luigi task TopoSort and add a simple test (authored by vlorentz).
Add Luigi task TopoSort and add a simple test
Add ListOriginContributors
vlorentz committed rDGRPH559d4068bfe1: Regenerate the test dataset to include a release with no author (authored by vlorentz).
Regenerate the test dataset to include a release with no author
vlorentz committed rDGRPH7bee5d47a6eb: revert multithreading, it's actually twice as slow as singlethread (authored by vlorentz).
revert multithreading, it's actually twice as slow as singlethread
Improve comments
vlorentz committed rDGRPH922894410b6e: Add a sample of two ancestor with each node (authored by vlorentz).
Add a sample of two ancestor with each node
tentative multithread DFS
Implement a naive topological sort
vlorentz committed rDGRPHb8dc411ccd30: luigi: Add tasks UploadGraphToS3 and DownloadGraphFromS3 (authored by vlorentz).
luigi: Add tasks UploadGraphToS3 and DownloadGraphFromS3
rebase + fix typos + improve readability
rebase
vlorentz updated the diff for D8912: ListOriginContributors: Ignore null author/committer in revisions/releases.
rebase
vlorentz updated the diff for D8910: Regenerate the test dataset to include a release with no author.
rebase
rebase