Page MenuHomeSoftware Heritage

De-containerify uffizi
Closed, ResolvedPublic

Description

uffizi (the main storage backend and objstorage server) should move to the bare metal that currently hosts the louvre hypervisor, removing the containerization layer and giving it all the ram of the host.

on the container :

  • install a kernel, install grub
  • install lvm2, multipath, mdadm
  • pull lvm2, multipath, mdadm config from louvre
  • write /etc/fstab
  • install ifenslave, vlan
  • pull network config (bond, vlan, storage array management) from louvre and adapt to use uffizi ip address
  • pull the hand-installed storage array management tools from /opt on louvre

on the infra:

  • stop workers

on the host:

  • stop the container
  • chroot in the container rootfs and run grub install
  • reboot

Event Timeline

olasd triaged this task as High priority.Jul 8 2019, 2:13 PM
olasd created this task.
olasd updated the task description. (Show Details)Jul 8 2019, 2:51 PM
olasd updated the task description. (Show Details)Jul 8 2019, 2:55 PM
olasd updated the task description. (Show Details)Jul 8 2019, 3:47 PM
olasd changed the status of subtask T1895: De-baremetalify louvre from Open to Work in Progress.Jul 8 2019, 5:45 PM
olasd updated the task description. (Show Details)Jul 10 2019, 2:57 PM
olasd updated the task description. (Show Details)Jul 10 2019, 3:09 PM
olasd updated the task description. (Show Details)Jul 10 2019, 3:54 PM
olasd added a comment.Jul 10 2019, 3:56 PM

I'm not 100% certain about the config of the array management interfaces as the system is going to move to predictable interface names that I'm not quite sure how to predict...

Current config:

5: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether ec:f4:bb:dd:42:22 brd ff:ff:ff:ff:ff:ff
    inet 192.168.254.94/31 scope global eth2
       valid_lft forever preferred_lft forever
    inet6 fe80::eef4:bbff:fedd:4222/64 scope link 
       valid_lft forever preferred_lft forever
6: eth3: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether ec:f4:bb:dd:42:23 brd ff:ff:ff:ff:ff:ff
    inet 192.168.254.96/31 scope global eth3
       valid_lft forever preferred_lft forever
olasd added a comment.Jul 10 2019, 3:58 PM
root@louvre:~# sudo udevadm test-builtin net_id /sys/class/net/eth2
calling: test-builtin
=== trie on-disk ===
tool version:          232
file size:         8441068 bytes
header size             80 bytes
strings            1846908 bytes
nodes              6594080 bytes
Load module index
Found container virtualization none
timestamp of '/etc/systemd/network' changed
timestamp of '/lib/systemd/network' changed
Parsed configuration file /lib/systemd/network/99-default.link
Created link configuration context.
ID_NET_NAME_MAC=enxecf4bbdd4222
ID_OUI_FROM_DATABASE=Dell Inc.
ID_NET_NAME_ONBOARD=eno3
ID_NET_LABEL_ONBOARD=enNIC3
ID_NET_NAME_PATH=enp1s0f2
Unload module index
Unloaded link configuration context.
root@louvre:~# sudo udevadm test-builtin net_id /sys/class/net/eth3
calling: test-builtin
=== trie on-disk ===
tool version:          232
file size:         8441068 bytes
header size             80 bytes
strings            1846908 bytes
nodes              6594080 bytes
Load module index
Found container virtualization none
timestamp of '/etc/systemd/network' changed
timestamp of '/lib/systemd/network' changed
Parsed configuration file /lib/systemd/network/99-default.link
Created link configuration context.
ID_NET_NAME_MAC=enxecf4bbdd4223
ID_OUI_FROM_DATABASE=Dell Inc.
ID_NET_NAME_ONBOARD=eno4
ID_NET_LABEL_ONBOARD=enNIC4
ID_NET_NAME_PATH=enp1s0f3
Unload module index
Unloaded link configuration context.

Only $DEITY knows if that's going to end up as eno3/4 or enp1s0f2/3??

olasd updated the task description. (Show Details)Jul 10 2019, 4:54 PM
olasd closed this task as Resolved.Jul 10 2019, 7:08 PM

So, that all happened and uffizi is now bare metal.

multipath-tools-boot needed to be installed to get the proper boot sequencing between mdraid, multipath and lvm. also, typos in /etc/lvm/lvm.conf fixed.

The interfaces showed up as eno3/4 so that got fixed in /etc/network/interfaces as well.

I've confirmed that the dell storage manager works fine.