Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Paste
P752
fio tests on proxmox / ceph
Active
Public
Actions
Authored by
olasd
on Sep 1 2020, 8:27 PM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
System administration
Subscribers
None
olasd@boatbucket:~/tmp$ fio --name=seqread --rw=read --direct=1 --ioengine=libaio --bs=8k --numjobs=8 --size=1G --runtime=600 --group_reporting
seqread: (g=0): rw=read, bs=(R) 8192B-8192B, (W) 8192B-8192B, (T) 8192B-8192B, ioengine=libaio, iodepth=1
...
fio-3.12
Starting 8 processes
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
seqread: Laying out IO file (1 file / 1024MiB)
Jobs: 1 (f=1): [_(4),R(1),_(3)][100.0%][r=18.6MiB/s][r=2387 IOPS][eta 00m:00s]
seqread: (groupid=0, jobs=8): err= 0: pid=8361: Tue Sep 1 18:05:58 2020
read: IOPS=10.8k, BW=84.2MiB/s (88.3MB/s)(8192MiB/97253msec)
slat (usec): min=4, max=11850, avg=20.23, stdev=32.98
clat (nsec): min=1633, max=208561k, avg=700836.03, stdev=700106.61
lat (usec): min=279, max=208626, avg=721.66, stdev=701.17
clat percentiles (usec):
| 1.00th=[ 334], 5.00th=[ 367], 10.00th=[ 392], 20.00th=[ 429],
| 30.00th=[ 461], 40.00th=[ 498], 50.00th=[ 553], 60.00th=[ 635],
| 70.00th=[ 709], 80.00th=[ 799], 90.00th=[ 979], 95.00th=[ 1303],
| 99.00th=[ 3523], 99.50th=[ 5145], 99.90th=[ 8455], 99.95th=[10552],
| 99.99th=[14877]
bw ( KiB/s): min= 1520, max=18528, per=12.76%, avg=11008.30, stdev=3231.02, samples=1516
iops : min= 190, max= 2316, avg=1376.00, stdev=403.88, samples=1516
lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
lat (usec) : 250=0.01%, 500=40.23%, 750=34.85%, 1000=15.46%
lat (msec) : 2=7.27%, 4=1.35%, 10=0.78%, 20=0.06%, 50=0.01%
lat (msec) : 250=0.01%
cpu : usr=1.04%, sys=3.93%, ctx=1075658, majf=0, minf=123
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=1048576,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=84.2MiB/s (88.3MB/s), 84.2MiB/s-84.2MiB/s (88.3MB/s-88.3MB/s), io=8192MiB (8590MB), run=97253-97253msec
Disk stats (read/write):
sda: ios=1048402/292, merge=0/280, ticks=732472/1937, in_queue=727676, util=100.00%
olasd@boatbucket:~/tmp$ fio --name=seqread --rw=read --direct=1 --ioengine=libaio --bs=64k --numjobs=8 --size=1G --runtime=600 --group_reporting
seqread: (g=0): rw=read, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=libaio, iodepth=1
...
fio-3.12
Starting 8 processes
Jobs: 1 (f=1): [R(1),_(7)][100.0%][r=295MiB/s][r=4717 IOPS][eta 00m:00s]
seqread: (groupid=0, jobs=8): err= 0: pid=8405: Tue Sep 1 18:08:07 2020
read: IOPS=7264, BW=454MiB/s (476MB/s)(8192MiB/18044msec)
slat (usec): min=6, max=8671, avg=23.85, stdev=29.90
clat (nsec): min=1573, max=148056k, avg=1034890.15, stdev=901095.20
lat (usec): min=285, max=148068, avg=1059.38, stdev=901.94
clat percentiles (usec):
| 1.00th=[ 392], 5.00th=[ 482], 10.00th=[ 562], 20.00th=[ 668],
| 30.00th=[ 742], 40.00th=[ 807], 50.00th=[ 898], 60.00th=[ 988],
| 70.00th=[ 1074], 80.00th=[ 1205], 90.00th=[ 1434], 95.00th=[ 1844],
| 99.00th=[ 4359], 99.50th=[ 5932], 99.90th=[ 9372], 99.95th=[11731],
| 99.99th=[17957]
bw ( KiB/s): min=35456, max=82944, per=12.89%, avg=59938.41, stdev=7964.35, samples=273
iops : min= 554, max= 1296, avg=936.50, stdev=124.44, samples=273
lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 500=6.25%, 750=25.30%
lat (usec) : 1000=30.17%
lat (msec) : 2=34.12%, 4=2.96%, 10=1.12%, 20=0.08%, 50=0.01%
lat (msec) : 100=0.01%, 250=0.01%
cpu : usr=0.80%, sys=3.15%, ctx=133066, majf=0, minf=232
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=131072,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=454MiB/s (476MB/s), 454MiB/s-454MiB/s (476MB/s-476MB/s), io=8192MiB (8590MB), run=18044-18044msec
Disk stats (read/write):
sda: ios=130931/25, merge=0/31, ticks=135419/121, in_queue=134668, util=99.56%
olasd@boatbucket:~/tmp$ fio --name=seqread --rw=read --direct=1 --ioengine=libaio --bs=256k --numjobs=8 --size=1G --runtime=600 --group_reporting
seqread: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=1
...
fio-3.12
Starting 8 processes
Jobs: 1 (f=1): [_(7),R(1)][100.0%][r=332MiB/s][r=1326 IOPS][eta 00m:00s]
seqread: (groupid=0, jobs=8): err= 0: pid=8423: Tue Sep 1 18:08:46 2020
read: IOPS=2972, BW=743MiB/s (779MB/s)(8192MiB/11025msec)
slat (usec): min=13, max=9591, avg=35.15, stdev=62.75
clat (usec): min=444, max=215391, avg=2460.30, stdev=6472.00
lat (usec): min=472, max=215413, avg=2496.12, stdev=6472.48
clat percentiles (usec):
| 1.00th=[ 644], 5.00th=[ 783], 10.00th=[ 906], 20.00th=[ 1205],
| 30.00th=[ 1434], 40.00th=[ 1614], 50.00th=[ 1795], 60.00th=[ 1975],
| 70.00th=[ 2180], 80.00th=[ 2540], 90.00th=[ 3326], 95.00th=[ 4883],
| 99.00th=[ 14484], 99.50th=[ 19268], 99.90th=[124257], 99.95th=[166724],
| 99.99th=[208667]
bw ( KiB/s): min=40960, max=146944, per=13.42%, avg=102125.24, stdev=20148.49, samples=161
iops : min= 160, max= 574, avg=398.89, stdev=78.71, samples=161
lat (usec) : 500=0.08%, 750=3.68%, 1000=9.95%
lat (msec) : 2=47.63%, 4=31.76%, 10=5.42%, 20=1.02%, 50=0.26%
lat (msec) : 100=0.08%, 250=0.12%
cpu : usr=0.49%, sys=1.72%, ctx=33253, majf=0, minf=603
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=32768,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=743MiB/s (779MB/s), 743MiB/s-743MiB/s (779MB/s-779MB/s), io=8192MiB (8590MB), run=11025-11025msec
Disk stats (read/write):
sda: ios=32685/21, merge=0/20, ticks=80600/323, in_queue=80176, util=98.78%
olasd@boatbucket:~/tmp$ fio --name=seqread --rw=read --direct=1 --ioengine=libaio --bs=1M --numjobs=8 --size=1G --runtime=600 --group_reporting
seqread: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1
...
fio-3.12
Starting 8 processes
Jobs: 1 (f=1): [_(3),E(1),_(3),R(1)][100.0%][r=787MiB/s][r=787 IOPS][eta 00m:00s]
seqread: (groupid=0, jobs=8): err= 0: pid=8439: Tue Sep 1 18:09:08 2020
read: IOPS=1013, BW=1014MiB/s (1063MB/s)(8192MiB/8080msec)
slat (usec): min=40, max=4124, avg=84.87, stdev=100.53
clat (usec): min=1121, max=229567, avg=7183.78, stdev=13945.25
lat (usec): min=1180, max=229646, avg=7269.47, stdev=13947.12
clat percentiles (usec):
| 1.00th=[ 1598], 5.00th=[ 2040], 10.00th=[ 2376], 20.00th=[ 2999],
| 30.00th=[ 3785], 40.00th=[ 4490], 50.00th=[ 5080], 60.00th=[ 5735],
| 70.00th=[ 6652], 80.00th=[ 7963], 90.00th=[ 10814], 95.00th=[ 15401],
| 99.00th=[ 38011], 99.50th=[113771], 99.90th=[212861], 99.95th=[217056],
| 99.99th=[229639]
bw ( KiB/s): min=61440, max=221184, per=13.41%, avg=139181.52, stdev=37312.62, samples=116
iops : min= 60, max= 216, avg=135.89, stdev=36.44, samples=116
lat (msec) : 2=4.48%, 4=28.00%, 10=55.62%, 20=9.12%, 50=1.99%
lat (msec) : 100=0.27%, 250=0.52%
cpu : usr=0.19%, sys=1.36%, ctx=8377, majf=0, minf=2139
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=8192,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=1014MiB/s (1063MB/s), 1014MiB/s-1014MiB/s (1063MB/s-1063MB/s), io=8192MiB (8590MB), run=8080-8080msec
Disk stats (read/write):
sda: ios=16317/88, merge=0/27, ticks=113434/900, in_queue=112492, util=97.33%
Event Timeline
olasd
created this paste.
Sep 1 2020, 8:27 PM
2020-09-01 20:27:13 (UTC+2)
Log In to Comment