readtest: (groupid=0, jobs=1): err= 0: pid=13481: Thu Dec 5 02:20:06 2013 read : io=680070MB, bw=193442KB/s, iops=48360, runt=3600002msec slat (usec): min=7, max=193, avg=11.08, stdev= 1.62 clat (usec): min=22, max=22533, avg=152.75, stdev=258.43 lat (usec): min=62, max=22546, avg=164.01, stdev=258.44 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 62], 10.00th=[ 65], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 127], 50.00th=[ 133], 60.00th=[ 143], | 70.00th=[ 147], 80.00th=[ 153], 90.00th=[ 161], 95.00th=[ 175], | 99.00th=[ 1560], 99.50th=[ 2128], 99.90th=[ 2640], 99.95th=[ 2832], | 99.99th=[ 7264] bw (KB /s): min=11464, max=205984, per=100.00%, avg=193448.02, stdev=5714.25 lat (usec) : 50=0.01%, 100=34.52%, 250=62.52%, 500=0.67%, 750=0.41% lat (usec) : 1000=0.29% lat (msec) : 2=0.99%, 4=0.56%, 10=0.04%, 20=0.01%, 50=0.01% cpu : usr=14.49%, sys=56.23%, ctx=59114231, majf=0, minf=34 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=174097797/w=0/d=0, short=r=0/w=0/d=0 writetest: (groupid=0, jobs=1): err= 0: pid=13482: Thu Dec 5 02:20:06 2013 write: io=434006MB, bw=123451KB/s, iops=30862, runt=3600001msec slat (usec): min=8, max=419, avg=27.11, stdev=17.45 clat (usec): min=29, max=3181, avg=228.42, stdev=41.34 lat (usec): min=55, max=3191, avg=256.00, stdev=44.74 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 163], 10.00th=[ 175], 20.00th=[ 191], | 30.00th=[ 205], 40.00th=[ 217], 50.00th=[ 229], 60.00th=[ 241], | 70.00th=[ 251], 80.00th=[ 266], 90.00th=[ 282], 95.00th=[ 298], | 99.00th=[ 322], 99.50th=[ 334], 99.90th=[ 354], 99.95th=[ 366], | 99.99th=[ 510] bw (KB /s): min=117592, max=205848, per=100.00%, avg=123447.72, stdev=2353.87 lat (usec) : 50=0.01%, 100=0.01%, 250=68.86%, 500=31.13%, 750=0.01% lat (usec) : 1000=0.01% lat (msec) : 2=0.01%, 4=0.01% cpu : usr=7.85%, sys=91.94%, ctx=70117, majf=0, minf=27 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=111105643/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=680070MB, aggrb=193441KB/s, minb=193441KB/s, maxb=193441KB/s, mint=3600002msec, maxt=3600002msec WRITE: io=434006MB, aggrb=123450KB/s, minb=123450KB/s, maxb=123450KB/s, mint=3600001msec, maxt=3600001msec Disk stats (read/write): dm-0: ios=174097797/111094033, merge=0/0, ticks=27933146/7434715, in_queue=35142212, util=100.00%, aggrios=87048898/55552821, aggrmerge=0/0, aggrticks=13252485/3409469, aggrin_queue=16653255, aggrutil=99.94% sdc: ios=87067038/55534682, merge=0/0, ticks=13249985/3412910, in_queue=16655047, util=99.94% sdd: ios=87030759/55570961, merge=0/0, ticks=13254985/3406029, in_queue=16651464, util=99.94%