Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 8 2016

ardumont added a comment to T347: ingest antelink s3 contents in swh.

Like i said in an email, those match the corrupted files at ~99,5%, the remaining ones are files whose size > 4Gib.
We are good for s3 bucket deletion.

Apr 8 2016, 4:01 PM · General

Apr 7 2016

olasd added a comment to T347: ingest antelink s3 contents in swh.

Latest missing files (24348 items)

Apr 7 2016, 2:42 PM · General
zack added a comment to T268: ontology - document on the wiki the data model terminology.

there is now a page on the WG wiki to do this: https://wg.softwareheritage.org/index.php?title=Glossary

Apr 7 2016, 12:09 PM · General, Restricted Project
ardumont added a parent task for T347: ingest antelink s3 contents in swh: T322: Inject antepedia contents (backuped in sesi and not in swh) into swh.
Apr 7 2016, 11:56 AM · General
ardumont added a comment to T347: ingest antelink s3 contents in swh.

Thanks.
Missing data reinjected.

Apr 7 2016, 11:47 AM · General

Apr 5 2016

olasd added a comment to T347: ingest antelink s3 contents in swh.

Check done (source file : a s3 listing Guillaume provided me in december). 85670 unique sha1s are missing.

Apr 5 2016, 6:14 PM · General
olasd added a comment to T347: ingest antelink s3 contents in swh.

Currently independently running a final check of what data has been properly imported from s3 before removing it from the source.

Apr 5 2016, 4:53 PM · General

Apr 1 2016

ardumont added a comment to T347: ingest antelink s3 contents in swh.

I forgot to update this, sorry.

Apr 1 2016, 5:41 PM · General
zack updated the task description for T359: Indexers: batch content analyzer infrastructure.
Apr 1 2016, 10:52 AM · Indexer, General
zack created T359: Indexers: batch content analyzer infrastructure.
Apr 1 2016, 10:51 AM · Indexer, General
zack triaged T358: doc: high-level architecture diagram as High priority.
Apr 1 2016, 10:49 AM · Documentation
zack created T358: doc: high-level architecture diagram.
Apr 1 2016, 10:49 AM · Documentation
zack added a project to T57: git commit IRC notifications on #swh-devel: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T5: pg_hash: postgres datatype for checksums: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T77: continuous integration to run test suite and static code checks: General.
Apr 1 2016, 10:15 AM · Phabricator
zack added a project to T67: prototype: git clone from SWH: General.
Apr 1 2016, 10:15 AM · Vault, General
zack added a project to T66: clone and load fork GitHub repositories: General.
Apr 1 2016, 10:15 AM · Restricted Project, General
zack added a project to T189: centralized syslog: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T239: preserve at least 2 copies of each content object: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T268: ontology - document on the wiki the data model terminology: General.
Apr 1 2016, 10:15 AM · General, Restricted Project
zack added a project to T273: Darcs loader: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T329: hg / mercurial loader: General.
Apr 1 2016, 10:15 AM · Mercurial loader
zack added a project to T335: specify the URI scheme swh:... to point to software heritage objects: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T337: specify a manifest format for documenting archived software: General.
Apr 1 2016, 10:15 AM · General
zack added a project to T341: store ingested tarball artifacts (in a separate storage area): General.
Apr 1 2016, 10:13 AM · General
zack renamed T347: ingest antelink s3 contents in swh from Inject s3 contents in swh to ingest antelink s3 contents in swh.
Apr 1 2016, 10:12 AM · General
zack added a project to T349: Investigate alternatives to Celery + RabbitMQ: General.
Apr 1 2016, 10:08 AM · General
zack created General.
Apr 1 2016, 10:06 AM