Page MenuHomeSoftware Heritage

Convert relevant munin graph information as json
Closed, MigratedEdits Locked

Description

Graphs are stored in .rrd files on pergamon. RRD format is not client-side friendly.
So we need to extract those information as another format. JSON seems suited well enough for web purposes.

Software Heritage Objects on a yearly basis are the graph we are interested in:

ardumont@pergamon:~$ ls /var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-*-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-content-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-directory_entry_dir-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-directory_entry_file-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-directory_entry_rev-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-directory-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-entity-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-occurrence_history-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-origin-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-person-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-project-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-release-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-revision-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-revision_history-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-skipped_content-g.rrd
/var/lib/munin/softwareheritage.org/prado.softwareheritage.org-softwareheritage_objects_softwareheritage-visit-g.rrd

Product: a script in charge of:

  • extraction
  • aggregation
  • json conversion

Related Objects

StatusAssignedTask
Migratedgitlab-migration

Event Timeline

ardumont renamed this task from Export relevant munin graph information as json to Convert relevant munin graph information as json.Jun 16 2016, 12:18 AM
ardumont closed this task as Resolved.
ardumont mentioned this in Unknown Object (Maniphest Task).