Installed on /api/1/stat/counters

we can use this flask decorator:

• https://gist.github.com/aisipos/1094140
• http://flask.pocoo.org/snippets/79/

after rSPROLEf55466f and rSPSITEfe51482 + deployment, https://base.softwareheritage.org/api/1/stat/counters is now available.

done in all modules registered under swh-environment

this will go into the current webui, as the first endpoint that returns json stuff instead of rendering an html page

current status: about 1/3 done (by the look of it…)

This is now done. Some details:

done at https://intranet.softwareheritage.org/index.php/Phabricator_callsign_naming_convention

And apache through to rSPPROFa11a325c.

uWSGI has been deployed through rSPPROFb76ea39d4

done in rDSTO793fb06f89d27c6ed94ab9392594dab14a941e3f

chmods restarted in a scren session of root@uffizi

"create index concurrently ..." is now running on prado, in a screen section

committed rDSTO672dd1c as mkstemp creates files with mode 0o600

chmods interrupted, as we just discovered that uwsgi is currently creating object files with perms 0600, which are not the right ones.
We need to first fix that, and then restart the chmods.

current status: 16 chmods (one for each physical disk) are currently running on uffizi, in a screen session of user root

Those repositories have been rescheduled with the rest of the 13 million repos that hadn't been imported yet.

In progress.

The tasks are currently running.

swh's puppet state of art - https://forge.softwareheritage.org/diffusion/SENV/

• Inject content
• Inject directories
• Inject revision
• Inject release
• Inject occurrence
• Add tests on lower level
• Tag + Release + Install to make sure the packaging is ok
• pep8 compliance + tests ok
• Orchestration test

In light of issues like T78 , the ideal test based on "git cloning" from SWH would include both:

• verifying that the top-most commits have the right sha1_git checksum, and
• verifying that the Git object store contains all and only the objects we started with

Done in rDLDG61e2b1ecd061

In T36#629, @olasd wrote:

sadly, 14k is only .1% ;)

In T36#626, @olasd wrote:

IPython notebook to play with the result times scatter plot :

result_times.ipynb2 KBDownload

In T36#628, @zack wrote:

Based on that data, here are the current average/stddev processing times per repository based on the first ~14k random repositories loaded (~1% of our total):

(Thanks for making me play for the first time with a IPython notebook, it's a pretty impressive environment to play with scientific data.)

IPython notebook to play with the result times scatter plot :