Page MenuHomeSoftware Heritage

investigate XFS tuning slowdown on uffizi w.r.t. banco
Closed, MigratedEdits Locked

Description

The I/O read performances on banco seems to be much better (50% more, 1.5x) than those on uffizi, even after discounting the slow down due to libvirt (see T283). The only significant difference seems to be XFS tuning, which has been tuned for performances to match strip sizes on uffizi (where it is slower!) but not on banco.
We need to review XFS performance tuning, and improve uffizi's I/O performances to match banco.

Banco's benchs:

zack@banco$ bonnie++ -d /srv/softwareheritage/objects/01/bonnie++
Seq OutSeq InRandom
CharBlockRewriteCharBlockSeeks
K/s - CPUK/s - CPUK/s - CPUK/s - CPUK/s - CPU/s - CPU
1211 - 99%952310 - 98%569833 - 66%2612 - 99%1503015 - 88%576.2 - 22%
8600us17858us325ms7576us336ms133ms
Seq CreateRandom Create
CreateReadDeleteCreateReadDelete
/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU
32351 - 81%+++++ - +++%+++++ - +++%32666 - 82%+++++ - +++%+++++ - +++%
22834us136us11007us14554us12us16350us
zack@banco$ bonnie++ -d /srv/softwareheritage/objects/a1/bonnie++
Seq OutSeq InRandom
CharBlockRewriteCharBlockSeeks
K/s - CPUK/s - CPUK/s - CPUK/s - CPUK/s - CPU/s - CPU
1230 - 99%988938 - 98%558315 - 67%2561 - 97%1566189 - 88%586.5 - 22%
7934us15883us346ms21770us140ms98680us
Seq CreateRandom Create
CreateReadDeleteCreateReadDelete
/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU
+++++ - +++%+++++ - +++%+++++ - +++%+++++ - +++%+++++ - +++%+++++ - +++%
6700us131us10769us301us15us104us

Uffizi's bench (via louvre, bare metal):

zack@louvre$ mount|grep /mnt
/dev/mapper/vg--data-0 on /mnt type xfs (rw,relatime,attr2,inode64,noquota)
zack@louvre$ bonnie++ -d /mnt/bonnie
Seq OutSeq InRandom
CharBlockRewriteCharBlockSeeks
K/s - CPUK/s - CPUK/s - CPUK/s - CPUK/s - CPU/s - CPU
1404 - 99%633900 - 99%478570 - 75%2820 - 99%919112 - 91%345.1 - 27%
7770us244ms359ms10967us513ms111ms
Seq CreateRandom Create
CreateReadDeleteCreateReadDelete
/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU
28184 - 88%+++++ - +++%+++++ - +++%28916 - 84%+++++ - +++%+++++ - +++%
478us151us14701us444us15us43015us
zack@louvre$ mount | grep /mnt                     
/dev/mapper/vg--data-a on /mnt type xfs (rw,relatime,attr2,inode64,noquota)
zack@louvre$ bonnie++ -d /mnt/bonnie
Seq OutSeq InRandom
CharBlockRewriteCharBlockSeeks
K/s - CPUK/s - CPUK/s - CPUK/s - CPUK/s - CPU/s - CPU
1317 - 99%655989 - 99%480398 - 75%2571 - 95%948253 - 92%350.6 - 25%
9479us297ms10843ms38326us358ms136ms
Seq CreateRandom Create
CreateReadDeleteCreateReadDelete
/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU/sec - CPU
28950 - 85%+++++ - +++%+++++ - +++%29147 - 88%+++++ - +++%+++++ - +++%
478us112us13591us355us30us24317us

Related Objects