Not packaged in debian yet but for us.
That's a start :D
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Nov 4 2016
Nov 4 2016
ardumont closed T595: Read sha1s from git repositories and send them for archive in azure as Resolved.
ardumont closed T594: Properly package universal-ctags, a subtask of T589: Add ctags content indexer, as Resolved.
Oct 27 2016
Oct 27 2016
zack renamed T589: Add ctags content indexer from Add semantic indexer to Add ctags content indexer.
ardumont closed T589: Add ctags content indexer, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), as Resolved.
ardumont changed the status of T595: Read sha1s from git repositories and send them for archive in azure from Open to Work in Progress.
ardumont added a comment to T595: Read sha1s from git repositories and send them for archive in azure.
reader git is currently running from worker01.
Oct 25 2016
Oct 25 2016
ardumont edited parent tasks for T595: Read sha1s from git repositories and send them for archive in azure, added: Unknown Object (Maniphest Task); removed: T594: Properly package universal-ctags.
ardumont edited parent tasks for T595: Read sha1s from git repositories and send them for archive in azure, added: Unknown Object (Maniphest Task); removed: T594: Properly package universal-ctags.
ardumont raised the priority of T595: Read sha1s from git repositories and send them for archive in azure from Low to Normal.
ardumont added a comment to T595: Read sha1s from git repositories and send them for archive in azure.
Related:
- 86928fa8ff8c491ce830387080ab47e668204f4f
- 50754523e84b4bff4e1a9c6765302cc3796d70b0
Oct 22 2016
Oct 22 2016
zack changed the status of T585: Re-engineer github lister, a subtask of T573: Lister engineering, from Open to Work in Progress.
zack added a parent task for T329: hg / mercurial loader: T593: ingest bitbucket hg/mercurial repositories.
zack renamed T561: ingest bitbucket (meta task) from ingest bitbucket.com repositories (meta task) to ingest bitbucket repositories (meta task).
zack renamed T561: ingest bitbucket (meta task) from ingest bitbucket.com repositories to ingest bitbucket.com repositories (meta task).
Thanks for reporting this, we should definitely add bitbucket.com to the coverage of our archive.
I'll add subtasks to this meta-task to structure more precisely what we need to do to achieve this goal.
Oct 17 2016
Oct 17 2016
| Tools | Pros | Cons |
| exuberant-ctags - http://ctags.sourceforge.net/ | - debian-packaged | - development stalled (last commit on 2014) |
| - extensible | - 41 languages supported | |
| - difficulties to deal with files' content alone | ||
| - no recent release (last official 5.8 dates back from 2009, the actual debian's is 5.9~svn20110310-11) | ||
| universal-ctags - http://docs.ctags.io/en/latest/ | - 84 supported languages | - manual install (not debian-packaged) |
| - extensible | - not released yet (planned for dec 2016, https://github.com/universal-ctags/ctags/milestone/3) | |
| - active development (last commit 12/10/2016) | - same limit as exuberant-ctags to recognize data from file's content alone | |
| - fork from exuberant-ctags | ||
ardumont closed T584: Deploy and run latest indexer code, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), as Resolved.
Oct 15 2016
Oct 15 2016
Oct 13 2016
Oct 13 2016
currently running
ardumont changed the status of T584: Deploy and run latest indexer code from Open to Work in Progress.
ardumont changed the status of T584: Deploy and run latest indexer code, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), from Open to Work in Progress.
ardumont closed T581: Text content orchestrator, a subtask of T577: Mimetype/Encoding indexer, as Resolved.
ardumont closed T582: Orchestrator - Optional filtering on existing contents, a subtask of T575: Pipe contents copied to azure to the indexer orchestrator, as Resolved.
ardumont renamed T582: Orchestrator - Optional filtering on existing contents from Orchestrator - Optional filtering on existing content to Orchestrator - Optional filtering on existing contents.
Oct 11 2016
Oct 11 2016
ardumont changed the status of T580: Start indexing computations (mimetype, language) from Open to Work in Progress.
ardumont changed the status of T580: Start indexing computations (mimetype, language), a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), from Open to Work in Progress.
As of today, this is the archiver (archiver-uffizi) which is in charge of copying data from our objstorages (uffizi, banco) to azure.
(currently this is deployed on uffizi).
Oct 10 2016
Oct 10 2016
Pre-requisite steps:
- migrate db version to 85
- stop workers (currently ongoing...)
- Upgrade uffizi's python3-swh.storage
- send sha1s contents to orchestrator
A POC is ongoing for as T548
ardumont closed T578: Language indexer, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), as Resolved.
ardumont closed T576: Indexer orchestrator, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), as Resolved.
ardumont closed T577: Mimetype/Encoding indexer, a subtask of T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task), as Resolved.
Oct 7 2016
Oct 7 2016
Check debsources' enum for language
Oct 5 2016
Oct 5 2016
ardumont shifted T575: Pipe contents copied to azure to the indexer orchestrator from the Restricted Space space to the S1 Public space.
ardumont shifted T574: Pipeline copy content to azure and then compute multiple indexes independently (meta task) from the Restricted Space space to the S1 Public space.
ardumont renamed T575: Pipe contents copied to azure to the indexer orchestrator from Pipe contents copied to azure to the indexer to Pipe contents copied to azure to the indexer orchestrator.
Sep 23 2016
Sep 23 2016
ardumont changed the status of T328: svn / subversion loader, a subtask of T367: ingest Google Code repositories, from Work in Progress to Open.
Sep 21 2016
Sep 21 2016
olasd closed T313: Retrieve fork information for github repositories in swh.lister.github, a subtask of T382: stay up to date w.r.t. new GitHub repositories, as Wontfix.
olasd closed T313: Retrieve fork information for github repositories in swh.lister.github, a subtask of T66: clone and load fork GitHub repositories, as Wontfix.
We have just started scheduling github fork repos as normal repos.
olasd closed T66: clone and load fork GitHub repositories, a subtask of T382: stay up to date w.r.t. new GitHub repositories, as Resolved.
Sep 20 2016
Sep 20 2016
ardumont closed Unknown Object (Maniphest Task), a subtask of T547: Azure prototype: Content provenance information API, as Resolved.
Sep 15 2016
Sep 15 2016
zack updated the task description for T565: embrace repository snapshot object in the data model (meta task).
zack triaged T565: embrace repository snapshot object in the data model (meta task) as Normal priority.
Sep 9 2016
Sep 9 2016
olasd closed T551: List interesting origins for the content provenance information prototype as Resolved.
rDSNIP0d79928 generates a list of 1k+ stars repositories (pass in a GitHub api login and token as arguments).
olasd closed T551: List interesting origins for the content provenance information prototype, a subtask of T547: Azure prototype: Content provenance information API, as Resolved.
Sep 2 2016
Sep 2 2016
ardumont renamed T553: Open api endpoint /api/1/provenance/ to read a content's provenance information from Open api endpoint to read content provenance information to Open api endpoint /api/1/provenance/ to read a content's provenance information.
Sep 1 2016
Sep 1 2016