Page MenuHomeSoftware Heritage

[DNR] add database backend
ClosedPublic

Authored by seirl on May 28 2017, 2:01 PM.

Diff Detail

Repository
rDVAU Software Heritage Vault
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

  • vault: WIP notifications
  • vault: fix tuple passing to cursor.execute()
  • vault: use uuid as schema type for celery uuid

just briefly reviewed the SQL schema, adding minor comments

sql/swh-vault-schema.sql
13–14

This is the type of the cooking *format*, right?
As type is ambiguous in this context, maybe this should actually be "cook_format", or maybe even "export_format", or something such?

(just a nit, of course)

32

not sure what this is, if it's progress info why it's in the DB and isn't task_status enough?

if it's actually needed, a comment describing what this is for in the SQL would be nice :-)

sql/swh-vault-schema.sql
13–14

It's not exactly the format, it's the format AND the type. for instance: directory, revision_gitfast, revision_hgbundle, snapshot_gitfast...

32

status is just a way of checking whether the bundle is new, pending or done. progress is arbitrary data the cookers can fill to describe their progress, like "[phase 1/6] sorting revisions (54764/978784112)".

  • requirements: python-fastimport module was renamed to fastimport
  • vault schema: fixup sql syntax
  • cooking_tasks: change celery queue name
  • cookers: rename revision_git to revision_gitfast
  • cookers: remove circular import in __init__.py
  • backend: fix db api
  • api: add email field
  • vault: initial database backend
  • vault: initial notification system
  • vault: fix tuple passing to cursor.execute()
  • vault: use uuid as schema type for celery uuid
  • requirements: python-fastimport module was renamed to fastimport
  • cooking_tasks: change celery queue name
  • cookers: rename revision_git to revision_gitfast
  • cookers: remove circular import in __init__.py
  • backend: fix db api
  • api: add email field
  • setup.py: update from storage to vault
  • cooking_tasks: use run_task() from swh.scheduler
  • backend: fix cooking task name
  • backend: fix database accesses
  • backend: prettier e-mail
  • revision_git: update progress_msg
This revision was automatically updated to reflect the committed changes.