readtest: (groupid=0, jobs=1): err= 0: pid=14108: Thu Dec 5 04:24:15 2013 read : io=1110.3GB, bw=323318KB/s, iops=80829, runt=3600001msec slat (usec): min=5, max=187, avg=10.26, stdev= 1.31 clat (usec): min=50, max=22347, avg=384.21, stdev=212.78 lat (usec): min=64, max=22360, avg=394.66, stdev=212.78 clat percentiles (usec): | 1.00th=[ 247], 5.00th=[ 290], 10.00th=[ 306], 20.00th=[ 326], | 30.00th=[ 338], 40.00th=[ 354], 50.00th=[ 370], 60.00th=[ 382], | 70.00th=[ 394], 80.00th=[ 402], 90.00th=[ 418], 95.00th=[ 430], | 99.00th=[ 1240], 99.50th=[ 2024], 99.90th=[ 2800], 99.95th=[ 2992], | 99.99th=[ 6944] bw (KB /s): min=44880, max=325512, per=100.00%, avg=323321.84, stdev=5201.68 lat (usec) : 100=0.03%, 250=1.07%, 500=97.02%, 750=0.44%, 1000=0.25% lat (msec) : 2=0.67%, 4=0.48%, 10=0.03%, 20=0.01%, 50=0.01% cpu : usr=16.30%, sys=83.49%, ctx=59528, majf=0, minf=58 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0% issued : total=r=290986050/w=0/d=0, short=r=0/w=0/d=0 writetest: (groupid=0, jobs=1): err= 0: pid=14109: Thu Dec 5 04:24:15 2013 write: io=259812MB, bw=73902KB/s, iops=18475, runt=3600001msec slat (usec): min=5, max=710, avg=45.66, stdev=32.54 clat (usec): min=40, max=8642, avg=1680.49, stdev=81.22 lat (usec): min=57, max=8658, avg=1726.90, stdev=82.32 clat percentiles (usec): | 1.00th=[ 1512], 5.00th=[ 1560], 10.00th=[ 1592], 20.00th=[ 1624], | 30.00th=[ 1640], 40.00th=[ 1656], 50.00th=[ 1688], 60.00th=[ 1704], | 70.00th=[ 1720], 80.00th=[ 1736], 90.00th=[ 1768], 95.00th=[ 1800], | 99.00th=[ 1864], 99.50th=[ 1896], 99.90th=[ 2096], 99.95th=[ 2128], | 99.99th=[ 2224] bw (KB /s): min=72808, max=182296, per=100.00%, avg=73898.46, stdev=1743.82 lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.09% lat (usec) : 1000=0.03% lat (msec) : 2=99.69%, 4=0.19%, 10=0.01% cpu : usr=4.90%, sys=94.24%, ctx=1328378, majf=0, minf=27 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0% issued : total=r=0/w=66511759/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=1110.3GB, aggrb=323317KB/s, minb=323317KB/s, maxb=323317KB/s, mint=3600001msec, maxt=3600001msec WRITE: io=259812MB, aggrb=73901KB/s, minb=73901KB/s, maxb=73901KB/s, mint=3600001msec, maxt=3600001msec Disk stats (read/write): dm-0: ios=290986050/66499093, merge=0/0, ticks=44179690/5395486, in_queue=49285007, util=100.00%, aggrios=145493025/33255879, aggrmerge=0/0, aggrticks=20625174/2379162, aggrin_queue=22987217, aggrutil=100.00% sdc: ios=145716473/33032431, merge=0/0, ticks=20649428/2366693, in_queue=23000407, util=100.00% sdd: ios=145269577/33479328, merge=0/0, ticks=20600920/2391631, in_queue=22974027, util=100.00%