Page MenuHomeSoftware Heritage

GitLab migrationTag
ActivePublic

Members

  • This project does not have any members.
  • View All

Details

Description

stuff related to the Phabricator → GitLab migration

Recent Activity

Fri, Jun 24

ardumont moved T4064: Test GitLab migration scripts from in-progress to deployed/landed/monitoring on the System administration board.
Fri, Jun 24, 4:15 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4334: Test rollback of a repo migration , a subtask of T4064: Test GitLab migration scripts, as Resolved.
Fri, Jun 24, 3:11 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4334: Test rollback of a repo migration as Resolved.
Fri, Jun 24, 3:11 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4334: Test rollback of a repo migration .

New test. tl; dr There is a way to update a repository migrated (drop it and import it
back, see 2nd run.)

Fri, Jun 24, 3:08 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Fri, Jun 24, 11:05 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

I'm reseting the gitlab state again and doing a migration from scratch.

Fri, Jun 24, 10:26 AM · System administration, GitLab migration, Roadmap 2020

Wed, Jun 22

ardumont added a comment to T4064: Test GitLab migration scripts.

My tryout in T4334 made me reset an important file which now messes up everything.
I'm reseting the gitlab state again and doing a migration from scratch.

Wed, Jun 22, 5:13 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4334: Test rollback of a repo migration .

I'm gonna check again tomorrow.

Wed, Jun 22, 5:11 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4064: Test GitLab migration scripts from deployed/landed/monitoring to in-progress on the System administration board.
Wed, Jun 22, 4:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4334: Test rollback of a repo migration from in-progress to deployed/landed/monitoring on the System administration board.
Wed, Jun 22, 4:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont changed the status of T4334: Test rollback of a repo migration from Open to Work in Progress.
Wed, Jun 22, 4:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont changed the status of T4334: Test rollback of a repo migration , a subtask of T4064: Test GitLab migration scripts, from Open to Work in Progress.
Wed, Jun 22, 4:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4334: Test rollback of a repo migration .

Actions:

  • connect through the gitlab ui
  • Select the repository to drop
  • Settings > General > Section "Advanced" > Expand > Bottom of the page click on "Delete"
  • input the name of the repository to destroy and validate on "Yes, delete project"
  • Cleanup eventually remains from the previous run on the host running the migration:
rm -rvf /var/tmp/migrate-gitlab/forgerie/{gitlab,phabricator}/swh-ansible
  • Trigger back the migration:
Wed, Jun 22, 4:34 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

A new one...

Got error running git command push with args ("gitlab" "--delete"
                                              "generated-differential-D1804-source") in dir /tmp/forgerie/gitlab/swh-jenkins-jobs
Wed, Jun 22, 3:07 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4347: gitlab migration reset state routine is flaky, a subtask of T4064: Test GitLab migration scripts, as Resolved.
Wed, Jun 22, 1:59 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4347: gitlab migration reset state routine is flaky as Resolved.
Wed, Jun 22, 1:59 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4347: gitlab migration reset state routine is flaky from in-progress to deployed/landed/monitoring on the System administration board.
Wed, Jun 22, 1:59 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4334: Test rollback of a repo migration from Backlog to Weekly backlog on the System administration board.
Wed, Jun 22, 12:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4320: Upgrade gitlab instance to v15, a subtask of T4064: Test GitLab migration scripts, as Resolved.
Wed, Jun 22, 12:53 PM · System administration, GitLab migration, Roadmap 2020
ardumont closed T4320: Upgrade gitlab instance to v15 as Resolved.
Wed, Jun 22, 12:52 PM · System administration, GitLab migration, Roadmap 2020
ardumont changed the status of T4347: gitlab migration reset state routine is flaky, a subtask of T4064: Test GitLab migration scripts, from Open to Work in Progress.
Wed, Jun 22, 12:52 PM · System administration, GitLab migration, Roadmap 2020
ardumont changed the status of T4347: gitlab migration reset state routine is flaky from Open to Work in Progress.
Wed, Jun 22, 12:52 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4347: gitlab migration reset state routine is flaky.

Thanks.

Wed, Jun 22, 12:17 PM · System administration, GitLab migration, Roadmap 2020
vsellier added a comment to T4347: gitlab migration reset state routine is flaky.

Looks like something is wrong in the operator state management.
For what I found on internet, it could be related to the cert-manager version but it should be already fixed. For example: https://gitlab.com/gitlab-org/cloud-native/gitlab-operator/-/issues/315
(The current cert-manager version in the cluster is 1.8.0)

Wed, Jun 22, 10:40 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

After unstucking the migration again, i've come up with the avatar upload routine compliant with the last http client optimization change.
I had finished the migration and wanted to trigger it back from scratch to have a non-failure and timed scenario ok.

Wed, Jun 22, 9:54 AM · System administration, GitLab migration, Roadmap 2020
ardumont triaged T4347: gitlab migration reset state routine is flaky as High priority.
Wed, Jun 22, 9:53 AM · System administration, GitLab migration, Roadmap 2020

Mon, Jun 20

ardumont added a comment to T4064: Test GitLab migration scripts.

/me grunts
another one bites the dust:

Mon, Jun 20, 10:49 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Mon, Jun 20, 3:35 PM · System administration, GitLab migration, Roadmap 2020

Fri, Jun 17

ardumont added a comment to T4064: Test GitLab migration scripts.

Unstuck after some mob debugging ;)
There is a fallback which tries and use the git am command and fails as some git config is missing.
We unstuck it by adding some .gitconfig in the dockerfile declaration.

Fri, Jun 17, 4:13 PM · System administration, GitLab migration, Roadmap 2020
bchauvet triaged T4334: Test rollback of a repo migration as High priority.
Fri, Jun 17, 2:59 PM · System administration, GitLab migration, Roadmap 2020

Thu, Jun 16

ardumont added a comment to T4064: Test GitLab migration scripts.

The migration did a lot more work this time. It finally crashed on the git am command though [1] [2] [3].

Thu, Jun 16, 10:15 AM · System administration, GitLab migration, Roadmap 2020

Wed, Jun 15

vsellier added a comment to T4064: Test GitLab migration scripts.

\o/ well done

Wed, Jun 15, 6:41 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4064: Test GitLab migration scripts from in-progress to deployed/landed/monitoring on the System administration board.
Wed, Jun 15, 4:07 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Wed, Jun 15, 2:40 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Wed, Jun 15, 2:40 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Wed, Jun 15, 2:39 PM · System administration, GitLab migration, Roadmap 2020
ardumont updated the task description for T4064: Test GitLab migration scripts.
Wed, Jun 15, 2:39 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.
  • Private repository after migration are private.
Wed, Jun 15, 2:38 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

And it seems it finished without any issues this time [1] [2]

Wed, Jun 15, 2:25 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Changing the command args from [1] to [2], the run cli no longer complains!

Booting: Unable to use a TTY - input is not a terminal or the right kind of file
Booting: --------------------------------------------------------------------------------
Booting:  Ruby:         ruby 2.7.5p203 (2021-11-24 revision f69aeb8314) [x86_64-linux]
Booting:  GitLab:       15.0.0 (8a186dedfc1) FOSS
Booting:  GitLab Shell: 14.3.0
Booting:  PostgreSQL:   12.7
Booting: ------------------------------------------------------------[ booted in 16.11s ]
Wed, Jun 15, 1:56 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.
  • Report migration status
Wed, Jun 15, 11:23 AM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Status update:

  • gitlab state cleaned up again (making sure host ssh key did not change, permissions ok, ...)
  • triggered migration
  • status report...
Wed, Jun 15, 10:42 AM · System administration, GitLab migration, Roadmap 2020

Mon, Jun 13

ardumont added a comment to T4064: Test GitLab migration scripts.

So i dug as to why my laptop was ok but not my desktop.

Mon, Jun 13, 5:10 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Better cli to execute...

forgerie@bespin:~$ logpath="/tmp/forgerie/run-$(date +%Y%m%d-%H%M).log"; echo "## Running migration logs in $logpath ##"; time /opt/forgerie/bin/run | tee $logpath
## Running migration logs in /tmp/forgerie/run-20220613-1410.log ##
...
Mon, Jun 13, 4:14 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Ah the migration scripts are still relying on the rails console to actually create merge requests... so we need that setup to work.
So i dug as to why my laptop was ok but not my desktop.

Mon, Jun 13, 4:07 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

And now it fails on snippet creation which needs access to the rails console (in the current state of the migration script).
I've got no proper setup which allows this to work now [1].
The only way i see is to comment that part for now...

Mon, Jun 13, 3:47 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4064: Test GitLab migration scripts from code-review/await-feedback to in-progress on the System administration board.
Mon, Jun 13, 1:11 PM · System administration, GitLab migration, Roadmap 2020
ardumont moved T4320: Upgrade gitlab instance to v15 from in-progress to deployed/landed/monitoring on the System administration board.
Mon, Jun 13, 1:11 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

Migration failed again with a problem when creating a snippet [1]

Mon, Jun 13, 1:10 PM · System administration, GitLab migration, Roadmap 2020
ardumont added a comment to T4064: Test GitLab migration scripts.

The source of that issue was the ssh connection failing to be established [1]
Fixing with ssh-keygen [2]

Mon, Jun 13, 10:35 AM · System administration, GitLab migration, Roadmap 2020