readtest: (groupid=0, jobs=1): err= 0: pid=15025: Thu Dec 5 07:28:49 2013 read : io=810490MB, bw=230539KB/s, iops=57634, runt=3600001msec slat (usec): min=4, max=9114, avg=14.48, stdev=13.22 clat (usec): min=56, max=30613, avg=2204.42, stdev=1699.35 lat (usec): min=68, max=30620, avg=2219.15, stdev=1710.57 clat percentiles (usec): | 1.00th=[ 1448], 5.00th=[ 1480], 10.00th=[ 1496], 20.00th=[ 1512], | 30.00th=[ 1528], 40.00th=[ 1544], 50.00th=[ 1560], 60.00th=[ 1576], | 70.00th=[ 1592], 80.00th=[ 1608], 90.00th=[ 6496], 95.00th=[ 6624], | 99.00th=[ 6944], 99.50th=[ 7776], 99.90th=[ 8896], 99.95th=[ 9152], | 99.99th=[12352] bw (KB /s): min=75272, max=325472, per=100.00%, avg=230536.47, stdev=119769.64 lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% lat (msec) : 2=86.36%, 4=1.13%, 10=12.49%, 20=0.02%, 50=0.01% cpu : usr=12.04%, sys=87.74%, ctx=83128, majf=0, minf=154 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% issued : total=r=207485489/w=0/d=0, short=r=0/w=0/d=0 writetest: (groupid=0, jobs=1): err= 0: pid=15026: Thu Dec 5 07:28:49 2013 write: io=573569MB, bw=163148KB/s, iops=40787, runt=3600001msec slat (usec): min=5, max=11424, avg=20.58, stdev=23.72 clat (usec): min=56, max=19525, avg=3114.94, stdev=2392.44 lat (usec): min=72, max=19533, avg=3135.87, stdev=2408.66 clat percentiles (usec): | 1.00th=[ 1608], 5.00th=[ 1608], 10.00th=[ 1624], 20.00th=[ 1624], | 30.00th=[ 1624], 40.00th=[ 1624], 50.00th=[ 1624], 60.00th=[ 1640], | 70.00th=[ 1640], 80.00th=[ 6880], 90.00th=[ 7008], 95.00th=[ 7072], | 99.00th=[ 7136], 99.50th=[ 7200], 99.90th=[ 7392], 99.95th=[ 7456], | 99.99th=[ 7520] bw (KB /s): min=72048, max=314704, per=100.00%, avg=163151.89, stdev=116030.66 lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% lat (msec) : 2=72.04%, 4=0.02%, 10=27.94%, 20=0.01% cpu : usr=9.20%, sys=90.18%, ctx=841281, majf=0, minf=27 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% issued : total=r=0/w=146833635/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=810490MB, aggrb=230539KB/s, minb=230539KB/s, maxb=230539KB/s, mint=3600001msec, maxt=3600001msec WRITE: io=573569MB, aggrb=163148KB/s, minb=163148KB/s, maxb=163148KB/s, mint=3600001msec, maxt=3600001msec Disk stats (read/write): dm-0: ios=207485489/146826881, merge=0/0, ticks=34269780/9981359, in_queue=43957492, util=100.00%, aggrios=103742744/73416817, aggrmerge=0/0, aggrticks=16090521/4450190, aggrin_queue=20523877, aggrutil=100.00% sdc: ios=103724519/73435041, merge=0/0, ticks=16063900/4466351, in_queue=20514713, util=100.00% sdd: ios=103760970/73398594, merge=0/0, ticks=16117142/4434030, in_queue=20533042, util=100.00%