Page MenuHomeSoftware Heritage

Git loader: update README for YAML-based syntax
Closed, MigratedEdits Locked

Description

The Git loader README still reference the old ini-based syntax for configuration file. It should be updated to use the new yaml-based format.
Its content is also out-of-date in other ways (configuration path, keys, etc.).

While we are at it, it is nowadays probably pointless to document configuration in README. Rather, we should consistently store configuration information in the python documentation of each module, so that we can cross-reference from one module to another. For instance, instead of (re-)documenting the storage configuration requirements in the Git loader module, we should just point to the corresponding configuration documentation of the storage module.

How about a top-level "configuration" document in each module?

Event Timeline

zack renamed this task from Git loader: update README for YAML-based syntax. to Git loader: update README for YAML-based syntax.Jan 6 2018, 8:50 AM
zack created this task.

Moving the documentation about the config to a top-level configuration document, in the docs directory, sounds like a very good plan. You assigned yourself the ticket, will you do it?

In T917#16911, @olasd wrote:

Moving the documentation about the config to a top-level configuration document, in the docs directory, sounds like a very good plan. You assigned yourself the ticket, will you do it?

Yep, and will try to do that for other modules too. I'll ask for review of what I wrote though :)

$ cat .config/swh/loader/git-updater.yml

---
content_size_limit: 1000000
save_data: True
save_data_path: /home/ndandrim/.cache/swh/packfiles
storage:
  cls: remote
  args:
    url: http://localhost:5002/
zack claimed this task.
zack updated the task description. (Show Details)

This is done, I've forked off the part about consistently documenting configuration options to T1758.