readtest: (groupid=0, jobs=1): err= 0: pid=13175: Thu Dec 5 01:17:41 2013 read : io=321457MB, bw=91437KB/s, iops=22859, runt=3600001msec slat (usec): min=7, max=5765, avg=12.12, stdev= 3.70 clat (usec): min=1, max=16865, avg=161.07, stdev=284.68 lat (usec): min=62, max=16878, avg=173.39, stdev=284.75 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 62], 10.00th=[ 63], 20.00th=[ 67], | 30.00th=[ 76], 40.00th=[ 125], 50.00th=[ 129], 60.00th=[ 139], | 70.00th=[ 145], 80.00th=[ 149], 90.00th=[ 159], 95.00th=[ 199], | 99.00th=[ 1816], 99.50th=[ 2256], 99.90th=[ 2672], 99.95th=[ 2832], | 99.99th=[ 6688] bw (KB /s): min=77616, max=116064, per=100.00%, avg=91444.39, stdev=2238.65 lat (usec) : 2=0.01%, 4=0.01%, 50=0.01%, 100=34.46%, 250=61.45% lat (usec) : 500=0.94%, 750=0.58%, 1000=0.41% lat (msec) : 2=1.37%, 4=0.75%, 10=0.03%, 20=0.01% cpu : usr=9.17%, sys=30.13%, ctx=56070117, majf=0, minf=30 IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=82292993/w=0/d=0, short=r=0/w=0/d=0 writetest: (groupid=0, jobs=1): err= 0: pid=13176: Thu Dec 5 01:17:41 2013 write: io=581245MB, bw=165332KB/s, iops=41332, runt=3600001msec slat (usec): min=8, max=463, avg=19.25, stdev=10.77 clat (usec): min=25, max=2381, avg=74.90, stdev=18.44 lat (usec): min=50, max=2390, avg=94.48, stdev=18.37 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 48], 10.00th=[ 51], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 70], 50.00th=[ 74], 60.00th=[ 79], | 70.00th=[ 84], 80.00th=[ 89], 90.00th=[ 98], 95.00th=[ 106], | 99.00th=[ 125], 99.50th=[ 135], 99.90th=[ 155], 99.95th=[ 165], | 99.99th=[ 193] bw (KB /s): min=145560, max=172768, per=100.00%, avg=165330.95, stdev=1249.19 lat (usec) : 50=7.53%, 100=83.65%, 250=8.82%, 500=0.01%, 750=0.01% lat (usec) : 1000=0.01% lat (msec) : 2=0.01%, 4=0.01% cpu : usr=10.44%, sys=87.26%, ctx=5663877, majf=0, minf=27 IO depths : 1=0.1%, 2=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=148798690/d=0, short=r=0/w=0/d=0 Run status group 0 (all jobs): READ: io=321457MB, aggrb=91436KB/s, minb=91436KB/s, maxb=91436KB/s, mint=3600001msec, maxt=3600001msec WRITE: io=581245MB, aggrb=165331KB/s, minb=165331KB/s, maxb=165331KB/s, mint=3600001msec, maxt=3600001msec Disk stats (read/write): dm-0: ios=82292993/148791627, merge=0/0, ticks=13964872/8953942, in_queue=22744220, util=100.00%, aggrios=41146496/74399345, aggrmerge=0/0, aggrticks=6669451/4200822, aggrin_queue=10869222, aggrutil=97.55% sdc: ios=40792278/74753563, merge=0/0, ticks=6606699/4232246, in_queue=10838450, util=97.35% sdd: ios=41500715/74045127, merge=0/0, ticks=6732203/4169399, in_queue=10899995, util=97.55%