Status | Assigned | Task | ||
---|---|---|---|---|
Migrated | gitlab-migration | T309 Delete duplicated antelink/antepedia content from s3 | ||
Migrated | gitlab-migration | T322 Inject antepedia contents (backuped in sesi and not in swh) into swh | ||
Migrated | gitlab-migration | T347 ingest antelink s3 contents in swh |
Event Timeline
Comment Actions
I forgot to update this, sorry.
This is done but for 34 files whose size are > 4,000,000,000 bytes.
List is https://forge.softwareheritage.org/P52
Comment Actions
Currently independently running a final check of what data has been properly imported from s3 before removing it from the source.
I'm only looking at databases, not at the object store.
Comment Actions
Check done (source file : a s3 listing Guillaume provided me in december). 85670 unique sha1s are missing.
Comment Actions
Like i said in an email, those match the corrupted files at ~99,5%, the remaining ones are files whose size > 4Gib.
We are good for s3 bucket deletion.