Page MenuHomeSoftware Heritage

Create SourceHut Lister
Open, NormalPublic

Event Timeline

bchauvet triaged this task as Normal priority.Jun 21 2022, 3:32 PM
bchauvet created this task.

Currently, there is no REST API endpoint to list SourceHut public projects.

It looks like the only way to get all projects would be to scrap HTML pages of SourceHut project hub which seems easy to do but not great.

This has now been discussed on the sourcehut mailing list and I took part in the conversation.

Bottom line is that there is indeed no suitable API on the Sourcehut side and that web crawling would not be ideal as it is a privacy feature that without knowing usernames one cannot find their repositories.

In the future they are planning to add a suitable GraphQL API (presumably taking into account desired user privacy settings), but it does not exist yet.
We should put this on hold until that API exists (or develop it ourselves).