readtest: (groupid=0, jobs=1): err= 0: pid=8342: Wed Dec 4 08:48:09 2013 read : io=169645MB, bw=48255KB/s, iops=12063, runt=3600002msec slat (usec): min=7, max=275, avg=16.38, stdev= 7.40 clat (usec): min=0, max=19687, avg=146.51, stdev=206.01 lat (usec): min=64, max=19703, avg=163.14, stdev=206.14 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 63], 10.00th=[ 67], 20.00th=[ 76], | 30.00th=[ 109], 40.00th=[ 127], 50.00th=[ 135], 60.00th=[ 143], | 70.00th=[ 147], 80.00th=[ 155], 90.00th=[ 173], 95.00th=[ 201], | 99.00th=[ 980], 99.50th=[ 1816], 99.90th=[ 2576], 99.95th=[ 2704], | 99.99th=[ 6496] bw (KB /s): min= 2728, max=51064, per=100.00%, avg=48261.17, stdev=1282.87 lat (usec) : 2=0.01%, 4=0.01%, 20=0.01%, 50=0.11%, 100=28.10% lat (usec) : 250=69.93%, 500=0.47%, 750=0.24%, 1000=0.16% lat (msec) : 2=0.59%, 4=0.37%, 10=0.02%, 20=0.01% cpu : usr=6.26%, sys=25.17%, ctx=33433859, majf=0, minf=28 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=43429247/w=0/d=0, short=r=0/w=0/d=0 writetest: (groupid=0, jobs=1): err= 0: pid=8343: Wed Dec 4 08:48:09 2013 write: io=314955MB, bw=89587KB/s, iops=22396, runt=3600001msec slat (usec): min=8, max=266, avg=16.56, stdev= 9.20 clat (usec): min=14, max=4497, avg=69.84, stdev=24.39 lat (usec): min=47, max=4506, avg=86.66, stdev=23.87 clat percentiles (usec): | 1.00th=[ 32], 5.00th=[ 44], 10.00th=[ 47], 20.00th=[ 49], | 30.00th=[ 51], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 72], | 70.00th=[ 79], 80.00th=[ 90], 90.00th=[ 108], 95.00th=[ 115], | 99.00th=[ 137], 99.50th=[ 139], 99.90th=[ 145], 99.95th=[ 147], | 99.99th=[ 153] bw (KB /s): min=87880, max=112984, per=100.00%, avg=89589.90, stdev=570.03 lat (usec) : 20=0.01%, 50=21.75%, 100=62.35%, 250=15.90%, 500=0.01% lat (usec) : 750=0.01%, 1000=0.01% lat (msec) : 2=0.01%, 10=0.01% cpu : usr=11.38%, sys=48.36%, ctx=44953016, majf=0, minf=27 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=80628355/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=169645MB, aggrb=48254KB/s, minb=48254KB/s, maxb=48254KB/s, mint=3600002msec, maxt=3600002msec WRITE: io=314955MB, aggrb=89587KB/s, minb=89587KB/s, maxb=89587KB/s, mint=3600001msec, maxt=3600001msec Disk stats (read/write): dm-0: ios=43429247/80627022, merge=0/0, ticks=6229620/4472632, in_queue=10621479, util=97.69%, aggrios=21714623/40314177, aggrmerge=0/0, aggrticks=2962816/2115856, aggrin_queue=5079148, aggrutil=78.84% sdc: ios=21608305/40420495, merge=0/0, ticks=2948185/2129167, in_queue=5077746, util=78.71% sdd: ios=21820942/40207860, merge=0/0, ticks=2977448/2102546, in_queue=5080551, util=78.84%