We've dropped the pristine-tar branch which was causing a bunch of issues (and wasn't being used anyway). The github mirroring from phabricator should now work automatically.

Dec 20 2022, 4:00 PM · System administration, Compressed graph service

Dec 15 2022

vlorentz closed T4676: Add Luigi workflow in swh-dataset, a subtask of T2220: swh-graph in production, as Resolved.

Dec 15 2022, 1:00 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

vlorentz closed T4676: Add Luigi workflow in swh-dataset as Resolved.

Dec 15 2022, 1:00 PM · Datasets, Compressed graph service

Dec 6 2022

vlorentz added a revision to T2220: swh-graph in production: D8919: Add CLI script to generate Luigi config and call it.

Dec 6 2022, 2:37 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

vlorentz added revisions to T4676: Add Luigi workflow in swh-dataset: D8919: Add CLI script to generate Luigi config and call it, D8924: exporters/orc: Fix crash on visit status with no type, D8925: luigi.CreateAthena: Fix validation of DB name, D8926: luigi.RunExportAll: Default to exporting all formats.

Dec 6 2022, 2:37 PM · Datasets, Compressed graph service

Nov 28 2022

vlorentz added a revision to T2220: swh-graph in production: D8891: Add luigi task to compress the graph.

Nov 28 2022, 4:34 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

olasd added a comment to T4701: GitHub mirror of swh-graph is not updated.

(I've at least pushed the main branch and relevant tags)

Nov 28 2022, 2:00 PM · System administration, Compressed graph service

olasd added a comment to T4701: GitHub mirror of swh-graph is not updated.

As I've suspected, this is due to the pristine-tar branch having objects that exceed 100MB:

Nov 28 2022, 1:58 PM · System administration, Compressed graph service

vlorentz reopened T4549: Write a script to generate qualified SWHID from swh-graph as "Open".

We should add some tests so the code doesn't break when we change other stuff. I'll try to do it this week

Nov 28 2022, 11:08 AM · Compressed graph service

vlorentz renamed T4701: GitHub mirror of swh-graph is not updated from swh-graph mirror not updated to GitHub mirror of swh-graph is not updated.

Nov 28 2022, 10:11 AM · System administration, Compressed graph service

RomainLefeuvre created T4701: GitHub mirror of swh-graph is not updated.

Nov 28 2022, 10:10 AM · System administration, Compressed graph service

Nov 25 2022

rdicosmo closed T4549: Write a script to generate qualified SWHID from swh-graph as Resolved.

Nov 25 2022, 9:23 PM · Compressed graph service

rdicosmo added a comment to T4549: Write a script to generate qualified SWHID from swh-graph.

This is now fully implemented in https://forge.softwareheritage.org/source/swh-graph/browse/master/tools/swh-graph-lookup/swh-graph-lookup.py

Nov 25 2022, 9:23 PM · Compressed graph service

Nov 24 2022

vlorentz added revisions to T2220: swh-graph in production: D8881: Document the need for higher vm.max_map_count, D8880: Fix crash on null Release message.

Nov 24 2022, 11:24 AM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

Nov 10 2022

vlorentz added a revision to T2579: swh-graph: display server and dataset versions in the live server instance: D8829: Add luigi tasks.

Nov 10 2022, 10:42 AM · Compressed graph service

vlorentz added revisions to T4676: Add Luigi workflow in swh-dataset: D8827: athena: Fix create_table to work with restricted permissions, D8828: cli: Move the main code of export_graph to its own function, D8829: Add luigi tasks.

Nov 10 2022, 10:42 AM · Datasets, Compressed graph service

vlorentz added a parent task for T4676: Add Luigi workflow in swh-dataset: T4677: Add support for generating subdatasets in swh.dataset.luigi.

Nov 10 2022, 10:42 AM · Datasets, Compressed graph service

vlorentz triaged T4676: Add Luigi workflow in swh-dataset as High priority.

Nov 10 2022, 10:41 AM · Datasets, Compressed graph service

vlorentz claimed T2220: swh-graph in production.

Nov 10 2022, 10:39 AM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

Nov 2 2022

vlorentz closed T4637: Document/showcase examples gRPC clients of the swh-graph as Resolved.

Nov 2 2022, 11:49 AM · Documentation, Compressed graph service

Oct 31 2022

vlorentz triaged T4666: swh-graph returns 500 errors when counting origins containing two particular contents as Low priority.

Oct 31 2022, 10:37 AM · Compressed graph service

Oct 28 2022

rdicosmo moved T2220: swh-graph in production from Backlog to Work in progress on the Roadmap 2022 board.

Oct 28 2022, 4:23 PM · Roadmap 2022, meta-task, Roadmap 2021, Compressed graph service

Oct 19 2022

gitlab-migration closed T4516: swh-graph: Add jvm monitoring as Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:08 PM · System administration, Compressed graph service

gitlab-migration changed the status of T4509: [swh-graph] Configure the max_memory to use, a subtask of T4507: Out of memory on granet, from Resolved to Migrated.

Oct 19 2022, 6:08 PM · System administration, Compressed graph service

gitlab-migration changed the status of T4509: [swh-graph] Configure the max_memory to use from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:08 PM · System administration, Compressed graph service

gitlab-migration changed the status of T4507: Out of memory on granet from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:08 PM · System administration, Compressed graph service

gitlab-migration changed the status of T4471: swh-graph Add java process port monitoring from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:08 PM · Compressed graph service, System administration

gitlab-migration changed the status of T4316: Push of swh-graph to pypi is broken from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:07 PM · System administration, Compressed graph service

gitlab-migration changed the status of T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet, a subtask of T3623: Run swh-graph with gunicorn to support multiple/parallel requests, from Resolved to Migrated.

Oct 19 2022, 6:04 PM · Compressed graph service, System administration

gitlab-migration changed the status of T3623: Run swh-graph with gunicorn to support multiple/parallel requests from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:04 PM · Compressed graph service, System administration

gitlab-migration changed the status of T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:04 PM · Compressed graph service, System administration

gitlab-migration changed the status of T2900: Public graph/ API does not handle streaming results from endpoints from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:00 PM · System administration, Compressed graph service, Web app

gitlab-migration changed the status of T2589: expose swh-graph API at archive.s.o/api/1/graph/ from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:58 PM · System administration, Web app, Compressed graph service

gitlab-migration changed the status of T2096: CNAME for graph service: graph.internal.softwareheritage.org (?) from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:56 PM · Compressed graph service, System administration

gitlab-migration changed the status of T3564: Puppetize graph service and add icinga alert, a subtask of T3168: Proper deployment of swh-graph with debian package, from Resolved to Migrated.

Oct 19 2022, 5:51 PM · Compressed graph service, Puppet recipes

gitlab-migration changed the status of T3168: Proper deployment of swh-graph with debian package from Wontfix to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:51 PM · Compressed graph service, Puppet recipes

gitlab-migration changed the status of T3564: Puppetize graph service and add icinga alert from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:51 PM · System administration, Compressed graph service, Puppet recipes

anlambert closed T4641: Jenkins jobs for swh-graph time out while cloning repository, a subtask of T4637: Document/showcase examples gRPC clients of the swh-graph , as Resolved.

Oct 19 2022, 11:09 AM · Documentation, Compressed graph service

anlambert closed T4641: Jenkins jobs for swh-graph time out while cloning repository as Resolved.

Jenkins jobs for swh packages have been updated to only fetch the master branch of repositories, closing this.

Oct 19 2022, 11:09 AM · Compressed graph service, System administration, Continuous Integration

Oct 18 2022

anlambert added a revision to T4641: Jenkins jobs for swh-graph time out while cloning repository: D8733: jobs/swh-environment: Only fetch master branches of swh repositories.

Oct 18 2022, 7:18 PM · Compressed graph service, System administration, Continuous Integration

anlambert added a revision to T4641: Jenkins jobs for swh-graph time out while cloning repository: D8707: templates/swh-pipeline: Fetch master branch only when cloning repo.

Oct 18 2022, 7:12 PM · Compressed graph service, System administration, Continuous Integration

vlorentz added a parent task for T4641: Jenkins jobs for swh-graph time out while cloning repository: T4637: Document/showcase examples gRPC clients of the swh-graph .

Oct 18 2022, 3:46 PM · Compressed graph service, System administration, Continuous Integration

vlorentz added a subtask for T4637: Document/showcase examples gRPC clients of the swh-graph : T4641: Jenkins jobs for swh-graph time out while cloning repository.

Oct 18 2022, 3:46 PM · Documentation, Compressed graph service

anlambert added a comment to T4641: Jenkins jobs for swh-graph time out while cloning repository.

Passing --single-branch option to git clone do not result in a timeout:

$ git clone https://forge.softwareheritage.org/source/swh-graph.git
Cloning into 'swh-graph'...
error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504
fatal: the remote end hung up unexpectedly

Oct 18 2022, 2:32 PM · Compressed graph service, System administration, Continuous Integration

vlorentz added a project to T4641: Jenkins jobs for swh-graph time out while cloning repository: Compressed graph service.

Oct 18 2022, 10:34 AM · Compressed graph service, System administration, Continuous Integration

Oct 17 2022

vlorentz added a revision to T4637: Document/showcase examples gRPC clients of the swh-graph : D8691: docs/grpc-api.rst: Add Python examples.

Oct 17 2022, 5:54 PM · Documentation, Compressed graph service

vlorentz updated the task description for T4637: Document/showcase examples gRPC clients of the swh-graph .

Oct 17 2022, 11:48 AM · Documentation, Compressed graph service

vlorentz raised the priority of T4637: Document/showcase examples gRPC clients of the swh-graph from Normal to High.

Oct 17 2022, 11:48 AM · Documentation, Compressed graph service

vlorentz claimed T4637: Document/showcase examples gRPC clients of the swh-graph .

Oct 17 2022, 11:48 AM · Documentation, Compressed graph service

vlorentz triaged T4637: Document/showcase examples gRPC clients of the swh-graph as Normal priority.

Oct 17 2022, 11:48 AM · Documentation, Compressed graph service

Oct 11 2022

vlorentz closed T4507: Out of memory on granet as Resolved.

in the end I ran FindEarliestRevision.java on a different server, which worked nicely

Oct 11 2022, 11:45 AM · System administration, Compressed graph service

Oct 3 2022

vlorentz closed T4586: max_matching_nodes is applied before filtering for node type as Resolved.

Oct 3 2022, 9:56 AM · Compressed graph service

Sep 29 2022

vlorentz added revisions to T4586: max_matching_nodes is applied before filtering for node type: D8579: http_client: Add max_matching_nodes parameter to visit_nodes(), D8580: Apply 'max_matching_nodes' restriction after 'return_types' filter.

Sep 29 2022, 3:43 PM · Compressed graph service

vlorentz added a parent task for T4507: Out of memory on granet: T4469: update license blob dataset to match-ish latest compress graph.

Sep 29 2022, 3:08 PM · System administration, Compressed graph service

vlorentz removed a parent task for T4507: Out of memory on granet: T4586: max_matching_nodes is applied before filtering for node type.

Sep 29 2022, 3:08 PM · System administration, Compressed graph service

vlorentz removed a subtask for T4586: max_matching_nodes is applied before filtering for node type: T4507: Out of memory on granet.

Sep 29 2022, 3:08 PM · Compressed graph service

vlorentz added a parent task for T4507: Out of memory on granet: T4586: max_matching_nodes is applied before filtering for node type.

Sep 29 2022, 3:08 PM · System administration, Compressed graph service

vlorentz added a subtask for T4586: max_matching_nodes is applied before filtering for node type: T4507: Out of memory on granet.

Sep 29 2022, 3:08 PM · Compressed graph service

vlorentz claimed T4586: max_matching_nodes is applied before filtering for node type.

Sep 29 2022, 3:08 PM · Compressed graph service

vlorentz removed a parent task for T4522: graph gRPC API: Add support for limiting traversals by number of results: T4469: update license blob dataset to match-ish latest compress graph.

Sep 29 2022, 3:07 PM · Compressed graph service

vlorentz added a parent task for T3626: graph API: add ?limit parameter to /leaves endpoint: T4469: update license blob dataset to match-ish latest compress graph.

Sep 29 2022, 3:06 PM · Easy hack, Compressed graph service

vlorentz added a parent task for T4586: max_matching_nodes is applied before filtering for node type: T4469: update license blob dataset to match-ish latest compress graph.

Sep 29 2022, 3:06 PM · Compressed graph service

vlorentz added a parent task for T4522: graph gRPC API: Add support for limiting traversals by number of results: T4469: update license blob dataset to match-ish latest compress graph.

Sep 29 2022, 3:06 PM · Compressed graph service

vlorentz triaged T4586: max_matching_nodes is applied before filtering for node type as High priority.

Sep 29 2022, 3:06 PM · Compressed graph service

vlorentz added a comment to T4521: Non-deterministic failures in test_visit_edges_diamond_pattern[remote].

<seirl> T4521 sounds like a missing copy() issue
<seirl> it corrupts the iterators

Sep 29 2022, 2:08 PM · Compressed graph service

vlorentz closed T4522: graph gRPC API: Add support for limiting traversals by number of results, a subtask of T3626: graph API: add ?limit parameter to /leaves endpoint, as Resolved.

Sep 29 2022, 2:07 PM · Easy hack, Compressed graph service

Advanced SearchUse ResultsEdit QueryHide Query

Jan 8 2023

Jan 5 2023

Dec 20 2022

Dec 15 2022

Dec 6 2022

Nov 28 2022

Nov 25 2022

Nov 24 2022

Nov 10 2022

Nov 2 2022

Oct 31 2022

Oct 28 2022

Oct 19 2022

Oct 18 2022

Oct 17 2022

Oct 11 2022

Oct 3 2022

Sep 29 2022

Advanced Search
Use Results
Edit Query
Hide Query