Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 8 2023

gitlab-migration closed T4341: Add a jenkins job for the docker E2E deployment mirror stack, a subtask of T4336: Add deployment tests for the mirror, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4342: Add a jenkins job for the AKS mirror deployment test, a subtask of T4338: mirror: k8s/terraform/hlem deployment test, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4342: Add a jenkins job for the AKS mirror deployment test as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4341: Add a jenkins job for the docker E2E deployment mirror stack, a subtask of T4337: mirror: docker swarm deployment test, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4341: Add a jenkins job for the docker E2E deployment mirror stack as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4342: Add a jenkins job for the AKS mirror deployment test, a subtask of T4336: Add deployment tests for the mirror, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4339: Write a tool to handle the kafka dataset for the mirror E2E tests as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4339: Write a tool to handle the kafka dataset for the mirror E2E tests, a subtask of T4336: Add deployment tests for the mirror, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4338: mirror: k8s/terraform/hlem deployment test, a subtask of T4336: Add deployment tests for the mirror, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4338: mirror: k8s/terraform/hlem deployment test, a subtask of T4339: Write a tool to handle the kafka dataset for the mirror E2E tests, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4337: mirror: docker swarm deployment test as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4337: mirror: docker swarm deployment test, a subtask of T4339: Write a tool to handle the kafka dataset for the mirror E2E tests, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4338: mirror: k8s/terraform/hlem deployment test as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4337: mirror: docker swarm deployment test, a subtask of T4336: Add deployment tests for the mirror, as Migrated.
Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T4336: Add deployment tests for the mirror as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:24 PM · Mirror
gitlab-migration closed T3881: Mirror - handle handling of multiple kafka messages for the same object as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Mirror
gitlab-migration closed T3883: Handle updated kafka messages for the objstorage replayer, a subtask of T3881: Mirror - handle handling of multiple kafka messages for the same object , as Migrated.
Jan 8 2023, 10:23 PM · Mirror
gitlab-migration closed T3883: Handle updated kafka messages for the objstorage replayer as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Mirror
gitlab-migration closed T3829: Document mirror - how to create and deploy a mirror from scratch as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:23 PM · Mirror
gitlab-migration closed T3199: Mirror: key value violates unique constraint "person_fullname_idx" as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3200: Mirror: year is out of range, a subtask of T3197: Mirror: fix common issues of a replayer session, as Migrated.
Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3200: Mirror: year is out of range as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3199: Mirror: key value violates unique constraint "person_fullname_idx", a subtask of T3197: Mirror: fix common issues of a replayer session, as Migrated.
Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3198: Mirror: unexpected closed connection to the pg server as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3197: Mirror: fix common issues of a replayer session as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3198: Mirror: unexpected closed connection to the pg server, a subtask of T3197: Mirror: fix common issues of a replayer session, as Migrated.
Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3116: Roll out at least one operational mirror as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:22 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task
gitlab-migration closed T3089: Remove the 'metadata' column of the 'revision' table, a subtask of T3201: Mirror: unsupported Unicode escape sequence, as Migrated.
Jan 8 2023, 10:22 PM · Mirror
gitlab-migration closed T3054: Scale out object storage design, a subtask of T3116: Roll out at least one operational mirror, as Migrated.
Jan 8 2023, 10:22 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task
gitlab-migration changed the status of T3303: Replaying REMD topics is broken, a subtask of T3197: Mirror: fix common issues of a replayer session, from Resolved to Migrated.
Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T3303: Replaying REMD topics is broken from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T3218: The graph replayer generates REQTMOUT Timeout errors, a subtask of T3197: Mirror: fix common issues of a replayer session, from Resolved to Migrated.
Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T3218: The graph replayer generates REQTMOUT Timeout errors from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T3201: Mirror: unsupported Unicode escape sequence, a subtask of T3197: Mirror: fix common issues of a replayer session, from Resolved to Migrated.
Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T3201: Mirror: unsupported Unicode escape sequence from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:02 PM · Mirror
gitlab-migration changed the status of T2209: At least 2 full mirrors up and running from Duplicate to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 10:00 PM · Mirror, Roadmap 2020
gitlab-migration changed the status of T1825: Deploy kafka direct journal_writer to main storage from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 9:59 PM · Mirror
gitlab-migration closed T3882: Handle updated kafka messages for the storage replayer, a subtask of T3881: Mirror - handle handling of multiple kafka messages for the same object , as Migrated.
Jan 8 2023, 5:03 PM · Mirror
gitlab-migration closed T3882: Handle updated kafka messages for the storage replayer as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Storage manager, Mirror
gitlab-migration closed T3865: Update diagram of mirror architecture as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:03 PM · Mirror, Documentation
gitlab-migration closed T2914: mirror documentation: add ballpark storage/infra requirements, a subtask of T3116: Roll out at least one operational mirror, as Migrated.
Jan 8 2023, 5:02 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task
gitlab-migration closed T2914: mirror documentation: add ballpark storage/infra requirements as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:02 PM · Mirror, Documentation
gitlab-migration closed T2706: Benchmark objstorage for mirror (uffizi vs. azure vs. s3) as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:02 PM · Object storage, Mirror
gitlab-migration closed T1576: document the typical cost(s) of hosting an archive mirror, a subtask of T3116: Roll out at least one operational mirror, as Migrated.
Jan 8 2023, 5:00 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task
gitlab-migration closed T1576: document the typical cost(s) of hosting an archive mirror as Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 5:00 PM · Documentation, Mirror
gitlab-migration changed the status of T2351: Consider backfilling mistakenly rejected large objects from PostgreSQL, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
Jan 8 2023, 4:30 PM · Mirror, Journal
gitlab-migration changed the status of T2350: Support large messages in swh.journal / kafka, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
Jan 8 2023, 4:30 PM · Mirror, Journal
gitlab-migration changed the status of T2349: Make the journal writer reliable, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
Jan 8 2023, 4:30 PM · Mirror, Journal
gitlab-migration changed the status of T2348: swh.journal silently loses large objects instead of rejecting them from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:30 PM · Mirror, Journal
gitlab-migration changed the status of T2003: Content replayer may try to copy objects before they are available from an objstorage, a subtask of T1914: Keep mirror of contents on S3 up to date, from Resolved to Migrated.
Jan 8 2023, 4:28 PM · Mirror, Datasets
gitlab-migration changed the status of T1914: Keep mirror of contents on S3 up to date, a subtask of T1899: complete object storage mirror on AWS, from Duplicate to Migrated.
Jan 8 2023, 4:28 PM · Mirror, Datasets
gitlab-migration changed the status of T1914: Keep mirror of contents on S3 up to date from Duplicate to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:28 PM · Mirror, Datasets
gitlab-migration changed the status of T1899: complete object storage mirror on AWS from Duplicate to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:27 PM · Mirror, Datasets
gitlab-migration changed the status of T1827: Tweak content backfill order to help content replayer from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:27 PM · Mirror, Journal
gitlab-migration changed the status of T1828: Improve directory journal backfill performance from Resolved to Migrated.

This task has been migrated to GitLab.

Jan 8 2023, 4:27 PM · Mirror, Journal

Oct 19 2022

gitlab-migration changed the status of T4234: Add snyk credentials for the staging r/o object storage from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:06 PM · Mirror, System administration
gitlab-migration changed the status of T1829: Find a way to properly open the kafka brokers to the internet from Resolved to Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 5:56 PM · System administration, Mirror

Jun 21 2022

vlorentz triaged T4345: get_filtered_files_content fails with "unexpected status None for content" as Normal priority.
Jun 21 2022, 2:57 PM · Vault

Jun 20 2022

douardda added a subtask for T4338: mirror: k8s/terraform/hlem deployment test: T4342: Add a jenkins job for the AKS mirror deployment test.
Jun 20 2022, 10:17 AM · Mirror
douardda added a parent task for T4342: Add a jenkins job for the AKS mirror deployment test: T4338: mirror: k8s/terraform/hlem deployment test.
Jun 20 2022, 10:17 AM · Mirror
douardda added a parent task for T4341: Add a jenkins job for the docker E2E deployment mirror stack: T4337: mirror: docker swarm deployment test.
Jun 20 2022, 10:17 AM · Mirror
douardda added a subtask for T4337: mirror: docker swarm deployment test: T4341: Add a jenkins job for the docker E2E deployment mirror stack.
Jun 20 2022, 10:17 AM · Mirror
douardda renamed T4342: Add a jenkins job for the AKS mirror deployment test from Add a jankins job for the AKS mirror deployment test to Add a jenkins job for the AKS mirror deployment test.
Jun 20 2022, 10:16 AM · Mirror
douardda triaged T4342: Add a jenkins job for the AKS mirror deployment test as High priority.
Jun 20 2022, 10:16 AM · Mirror
douardda triaged T4341: Add a jenkins job for the docker E2E deployment mirror stack as High priority.
Jun 20 2022, 10:16 AM · Mirror
douardda added a subtask for T4339: Write a tool to handle the kafka dataset for the mirror E2E tests: T4337: mirror: docker swarm deployment test.
Jun 20 2022, 9:58 AM · Mirror
douardda added a parent task for T4337: mirror: docker swarm deployment test: T4339: Write a tool to handle the kafka dataset for the mirror E2E tests.
Jun 20 2022, 9:58 AM · Mirror
douardda added a subtask for T4339: Write a tool to handle the kafka dataset for the mirror E2E tests: T4338: mirror: k8s/terraform/hlem deployment test.
Jun 20 2022, 9:58 AM · Mirror
douardda added a parent task for T4338: mirror: k8s/terraform/hlem deployment test: T4339: Write a tool to handle the kafka dataset for the mirror E2E tests.
Jun 20 2022, 9:58 AM · Mirror
douardda triaged T4339: Write a tool to handle the kafka dataset for the mirror E2E tests as High priority.
Jun 20 2022, 9:57 AM · Mirror
douardda triaged T4338: mirror: k8s/terraform/hlem deployment test as High priority.
Jun 20 2022, 9:53 AM · Mirror
douardda renamed T4336: Add deployment tests for the mirror from Add a deployment test for the mirror to Add deployment tests for the mirror.
Jun 20 2022, 9:52 AM · Mirror
douardda triaged T4337: mirror: docker swarm deployment test as High priority.
Jun 20 2022, 9:51 AM · Mirror
douardda triaged T4336: Add deployment tests for the mirror as High priority.
Jun 20 2022, 9:50 AM · Mirror

May 11 2022

vsellier closed T4234: Add snyk credentials for the staging r/o object storage as Resolved.

credentials created following https://docs.softwareheritage.org/sysadm/mirror-operations/onboard.html#how-to-create-the-objstorage-credentials

May 11 2022, 3:53 PM · Mirror, System administration
vsellier changed the status of T4234: Add snyk credentials for the staging r/o object storage from Open to Work in Progress.
May 11 2022, 3:40 PM · Mirror, System administration

Mar 25 2022

bchauvet raised the priority of T3116: Roll out at least one operational mirror from Normal to High.
Mar 25 2022, 5:27 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task

Mar 23 2022

bchauvet renamed T3116: Roll out at least one operational mirror from Roll out first operational mirror to Roll out at least one operational mirror.
Mar 23 2022, 4:42 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task

Feb 7 2022

moranegg added a comment to T1576: document the typical cost(s) of hosting an archive mirror.

Is this page enough?
https://docs.softwareheritage.org/sysadm/mirror-operations/planning.html

Feb 7 2022, 11:58 AM · Documentation, Mirror

Jan 27 2022

douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors, a subtask of T3197: Mirror: fix common issues of a replayer session, as Resolved.
Jan 27 2022, 1:43 PM · Mirror
douardda closed T3218: The graph replayer generates REQTMOUT Timeout errors as Resolved.

Seems moslty ok, even if these errors still pop now and then in the logs.

Jan 27 2022, 1:43 PM · Mirror

Jan 24 2022

douardda triaged T3883: Handle updated kafka messages for the objstorage replayer as High priority.
Jan 24 2022, 5:25 PM · Mirror
douardda triaged T3882: Handle updated kafka messages for the storage replayer as High priority.
Jan 24 2022, 5:22 PM · Storage manager, Mirror
douardda triaged T3881: Mirror - handle handling of multiple kafka messages for the same object as High priority.
Jan 24 2022, 5:22 PM · Mirror

Jan 19 2022

moranegg triaged T3865: Update diagram of mirror architecture as Normal priority.
Jan 19 2022, 4:42 PM · Mirror, Documentation
vsellier added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6979: Document the mirror credentials management.
Jan 19 2022, 3:23 PM · Mirror
olasd added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6978: Update docker stack configuration to match documentation changes.
Jan 19 2022, 2:56 PM · Mirror
ardumont added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6967: docs: Fix redondant extlink link warnings on archive.s.o.
Jan 19 2022, 2:32 PM · Mirror
ardumont added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6965: mirror-operations: Convert markup to restructuredtext.
Jan 19 2022, 2:31 PM · Mirror
ardumont added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6969: Update mirror docker docs following a walkthrough.
Jan 19 2022, 2:30 PM · Mirror

Jan 18 2022

vsellier added a revision to T3829: Document mirror - how to create and deploy a mirror from scratch: D6966: Move mirror documentation from devel to sysadm.
Jan 18 2022, 5:00 PM · Mirror

Jan 4 2022

moranegg triaged T3829: Document mirror - how to create and deploy a mirror from scratch as Normal priority.
Jan 4 2022, 12:15 PM · Mirror

May 11 2021

vlorentz closed T3303: Replaying REMD topics is broken, a subtask of T3197: Mirror: fix common issues of a replayer session, as Resolved.
May 11 2021, 4:23 PM · Mirror
vlorentz closed T3303: Replaying REMD topics is broken as Resolved.
May 11 2021, 4:23 PM · Mirror

May 4 2021

vlorentz added a revision to T3303: Replaying REMD topics is broken: D5670: Stop storing authority/fetcher metadata..
May 4 2021, 4:07 PM · Mirror
douardda triaged T3303: Replaying REMD topics is broken as High priority.
May 4 2021, 10:11 AM · Mirror

Apr 27 2021

zack added a comment to T1576: document the typical cost(s) of hosting an archive mirror.

docs !

Apr 27 2021, 4:06 PM · Documentation, Mirror
moranegg added a comment to T1576: document the typical cost(s) of hosting an archive mirror.

Where should this information be available?

  • on the main website
  • docs
  • a private location
Apr 27 2021, 3:48 PM · Documentation, Mirror

Apr 23 2021

vlorentz assigned T3116: Roll out at least one operational mirror to douardda.
Apr 23 2021, 4:49 PM · Roadmap 2022, Unknown Object (Project), Mirror, Roadmap 2021, meta-task

Apr 22 2021

douardda added a comment to T3200: Mirror: year is out of range.

These revisions are probably coming from https://gitlab.com/gitlab-org/gitlab-test (or a clone)

Apr 22 2021, 12:10 PM · Mirror