moranegg renamed T833: When listing an origin, add origin level metadata to RMD storage from When listing an origin, add origin level metadata to storage to When listing an origin, add origin level metadata to RMD storage.

Sep 18 2020, 2:31 PM · Extrinsic metadata, Restricted Project, GitHub lister

moranegg moved T833: When listing an origin, add origin level metadata to RMD storage from Backlog to Implementation on the Metadata workflow board.

Sep 18 2020, 1:49 PM · Extrinsic metadata, Restricted Project, GitHub lister

Jan 16 2020

ardumont added a comment to P584 github token creation routine.

Tried this in python but for some reason (come to think of it, most probably because of session issue, it did not work...)

Jan 16 2020, 1:34 PM · GitHub lister, Lister

ardumont created P584 github token creation routine.

Jan 16 2020, 1:32 PM · GitHub lister, Lister

Nov 19 2019

olasd triaged T2099: GitHub lister: better handling of wrong credentials as Normal priority.

Nov 19 2019, 4:33 PM · GitHub lister

Sep 19 2019

anlambert closed T2014: Github lister erroneously delete some loading tasks as Resolved by committing rDLS04d8fdf8df45: github/lister: Prevent erroneous scheduler tasks disabling.

Sep 19 2019, 2:36 PM · GitHub lister

anlambert triaged T2014: Github lister erroneously delete some loading tasks as Normal priority.

Sep 19 2019, 1:59 PM · GitHub lister

Sep 18 2019

anlambert closed T2001: Github incremental lister is broken as Resolved by committing rDLS7572228f7c89: listers: Ensure run can be called without bounds arguments.

Sep 18 2019, 11:10 AM · GitHub lister

Sep 17 2019

anlambert triaged T2001: Github incremental lister is broken as High priority.

Sep 17 2019, 11:22 AM · GitHub lister

Aug 27 2019

ardumont closed T1590: lister: Update readme instructions to be able to run listers after a git clone as Resolved.

Aug 27 2019, 12:11 PM · GitHub lister

May 23 2019

vlorentz removed a parent task for T833: When listing an origin, add origin level metadata to RMD storage: T1102: Handle all GitHub elements.

May 23 2019, 12:07 PM · Extrinsic metadata, Restricted Project, GitHub lister

vlorentz added a subtask for T833: When listing an origin, add origin level metadata to RMD storage: T1344: Write specs about metadata workflow .

May 23 2019, 11:58 AM · Extrinsic metadata, Restricted Project, GitHub lister

vlorentz added a comment to T833: When listing an origin, add origin level metadata to RMD storage.

@zack Yes, rate limit. And I determined this based on our current listing rate (@olasd said 2 to 3 days to fully list GitHub with 500 repos per request; so an API call for each repo would take a total of 500 times 2 or 3 days).

May 23 2019, 11:34 AM · Extrinsic metadata, Restricted Project, GitHub lister

May 20 2019

zack added a comment to T833: When listing an origin, add origin level metadata to RMD storage.

In T833#31772, @vlorentz wrote:

sending a request for each repository would need ~2 to 3 years for a full pass over github. That's with our current infrastructure, so it's not a hard limit.

May 20 2019, 3:45 PM · Extrinsic metadata, Restricted Project, GitHub lister

moranegg added a comment to T833: When listing an origin, add origin level metadata to RMD storage.

Also adding this example:
https://github.com/etalab/data-codes-sources-fr

May 20 2019, 3:23 PM · Extrinsic metadata, Restricted Project, GitHub lister

vlorentz updated subscribers of T833: When listing an origin, add origin level metadata to RMD storage.

Some thoughts about this (with contributions from @moranegg and @olasd):

May 20 2019, 2:47 PM · Extrinsic metadata, Restricted Project, GitHub lister

Apr 4 2019

zack closed T1625: Repository with trailing slash are archived separately as Wontfix.

This is intended, because there is no guarantee that the Git repository accessible via an URL with a trailing slash will be the same of the one accessible at the same URL without the trailing slash. Same argument goes for all other examples you mention.

Apr 4 2019, 7:58 PM · GitHub lister

kalpitk triaged T1625: Repository with trailing slash are archived separately as Low priority.

Apr 4 2019, 7:24 PM · GitHub lister

kalpitk created T1625: Repository with trailing slash are archived separately in the S1 Public space.

Apr 4 2019, 7:22 PM · GitHub lister

Mar 24 2019

ardumont added a comment to T1590: lister: Update readme instructions to be able to run listers after a git clone.

@nahimilega I'll let you close the task if you think there are nothing more to add.

Mar 24 2019, 11:18 AM · GitHub lister

ardumont updated the task description for T1590: lister: Update readme instructions to be able to run listers after a git clone.

Mar 24 2019, 11:16 AM · GitHub lister

ardumont renamed T1590: lister: Update readme instructions to be able to run listers after a git clone from lister: Update readme instructions to be able to run lister to lister: Update readme instructions to be able to run listers after a git clone.

Mar 24 2019, 11:15 AM · GitHub lister

ardumont renamed T1590: lister: Update readme instructions to be able to run listers after a git clone from Not able bootstrap the db instance schema for listers through cli to lister: Update readme instructions to be able to run lister.

Mar 24 2019, 11:15 AM · GitHub lister

nahimilega added a revision to T1590: lister: Update readme instructions to be able to run listers after a git clone: D1287: Updated toplevel function names in README.

Mar 24 2019, 6:37 AM · GitHub lister

nahimilega added a comment to T1590: lister: Update readme instructions to be able to run listers after a git clone.

The sample top levels for the different listers are also out of date(as discussed in IRC as well as mentioned by @ardumont in https://forge.softwareheritage.org/D1281). Hence I wish to update the names of those functions in the documentation of lister.

Mar 24 2019, 6:15 AM · GitHub lister

Mar 19 2019

nahimilega added a revision to T1590: lister: Update readme instructions to be able to run listers after a git clone: D1281: Updated README.md for listers.

Mar 19 2019, 6:49 PM · GitHub lister

ardumont added a comment to T1590: lister: Update readme instructions to be able to run listers after a git clone.

In T1590#29519, @nahimilega wrote:

Ok, next time I will remember this to paste the text and quote it with triple backquote "`".

Mar 19 2019, 10:16 AM · GitHub lister

nahimilega added a comment to T1590: lister: Update readme instructions to be able to run listers after a git clone.

Ok, next time I will remember this to paste the text and quote it with triple backquote "`".
I would love to fix the documentation as it would be a good starting point in contributing to this project. I am familiar with the process of pull request on Github but new to this forge. Can you guide to on what should I do next?

Mar 19 2019, 9:58 AM · GitHub lister

ardumont added a comment to T1590: lister: Update readme instructions to be able to run listers after a git clone.

Please, next time, can you paste the text and quote it with triple backquote "`":

Mar 19 2019, 12:02 AM · GitHub lister

Mar 18 2019

zack lowered the priority of T1590: lister: Update readme instructions to be able to run listers after a git clone from Unbreak Now! to Normal.

Mar 18 2019, 8:54 PM · GitHub lister

nahimilega triaged T1590: lister: Update readme instructions to be able to run listers after a git clone as Unbreak Now! priority.

Mar 18 2019, 8:49 PM · GitHub lister

Feb 21 2019

vlorentz added a project to T833: When listing an origin, add origin level metadata to RMD storage: Restricted Project.

Feb 21 2019, 10:11 AM · Extrinsic metadata, Restricted Project, GitHub lister

Oct 31 2018

moranegg added a comment to T1110: document GitHub caseness caveats.

When using the save code now feature with https://github.com/codemeta/codemeta.git the origin created was exactly as requested.
Now there are 2 different origins:

Oct 31 2018, 11:03 AM · GitHub lister, Documentation

Oct 29 2018

vlorentz added a project to T833: When listing an origin, add origin level metadata to RMD storage: GitHub lister.

Oct 29 2018, 4:35 PM · Extrinsic metadata, Restricted Project, GitHub lister

Aug 1 2018

ardumont closed T1138: Migrate remaining modules to remote scheduler api use as Resolved.

Aug 1 2018, 3:28 PM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

ardumont updated the task description for T1138: Migrate remaining modules to remote scheduler api use.

Aug 1 2018, 3:27 PM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

Jul 18 2018

ardumont updated the task description for T1138: Migrate remaining modules to remote scheduler api use.

Jul 18 2018, 2:57 PM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

ardumont updated the task description for T1138: Migrate remaining modules to remote scheduler api use.

Jul 18 2018, 2:56 PM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

ardumont updated the task description for T1138: Migrate remaining modules to remote scheduler api use.

Jul 18 2018, 2:42 PM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

ardumont triaged T1138: Migrate remaining modules to remote scheduler api use as Normal priority.

Jul 18 2018, 11:42 AM · Vault, SWORD deposit, GitHub lister, Scheduling utilities

Jun 19 2018

zack triaged T1110: document GitHub caseness caveats as Low priority.

Jun 19 2018, 2:51 PM · GitHub lister, Documentation

Mar 6 2017

olasd added a comment to D165: refactor github lister into something more generic.

In D165#3734, @zack wrote:

In D165#3728, @fiendish wrote:

does this work?

@fiendish it does, but shouldn't be needed. When you push the accepted revision via git, differential should close the corresponding diff automatically.