@douardda We have a separate task(T1777) for rubygem lister. I guess we can add a separate column in the table by @anlambert showing status of the lister implementation and the tasks related to it.

I don't reproduce this error.

• Reorder tests and add missing tests

• Fix the bug which was preventing the the loader to save snapshot
• Restructure git commits

• Make recomended changes

I solved this issue by changing my system locale to 'en_US'.
You can refer to these tutorials to change your system
https://www.tecmint.com/set-system-locales-in-linux/
https://askubuntu.com/questions/89976/how-do-i-change-the-default-locale-in-ubuntu-server

Revision Created:

{'author': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 
'committer': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 
'committer_date': {'negative_utc': False, 'offset': 0, 'timestamp': {...}}, 
'date': {'negative_utc': False, 'offset': 0, 'timestamp': {...}}, 
'directory': b':\xeb\xc2\x9e\xd1\...\x06\xb5(', 'id': b'D\x184\x88\xc0wL\x...x8aJB\xb3', 'message': b'swh-loader-package...n message', 
'metadata': {'package': {...}}, 
'parents': [], 
'synthetic': True, 
'type': 'tar'}

• convert tests in pytest format

• Follow the incremental approach and break the diff into different small parts.

In D1694#41622, @ardumont wrote:

@anlambert and i discussed this, just need some time to digest and summarize to get back to you on this.

• Change class name
• Improve docstring of convert_to_standard_format() and extract_metadata()
• Change signature of prepare_origin_visit() and prepare()

I think the role to each and every method in PackageLoader is not explicit enough or I am not able to make it. explicit enough(electric communication is hard;) ).
To elaborate upon the working of PackageLoader I have made this diagram.

Here are the bugs I found and fixed ;)

I will look at pytest documentation and try to convert these tests according to the new format. One doubt though.

to move away from tests defined within classes.

If these all tests are not concealed in a class then how will these tests be inherited by all the loader?

• swh.loader.base: Add base tests for download and loader

• swh.loader.gnu: Add tests

• Fixed bugs found in tests

• Remove cran loader from this diff

• Made recommended changes

I was thinking we can make this task of adding docstrings for all lister class as an Easy-Hack for first-time contributors.

• Fixed typo in docstring

And now, there will be a need to add a 'load-packagist' task-type in scheduler.

Do we need to do this in this diff itself?

• Update docstring of the class

• rebase on latest master
• fixed few bugs
• ran in docker

I tested this docker. It is running fine. Here is a task created by the lister

Task 8
  Next run: 2 minutes ago (2019-07-18 18:25:07+00:00)
  Interval: 90 days, 0:00:00
  Type: load-packagist
  Policy: recurring
  Status: next_run_scheduled
  Priority: 
  Args:
    'hypejunction/hypegamemechanics'
    'https://repo.packagist.org/p/hypejunction/hypegamemechanics.json'
  Keyword args:

• Add FIXME in ambigious tests
• Remove bad response from simple lister test