切换到窄版

运维联盟俱乐部

 找回密码
 立即注册
运维联盟俱乐部»论坛 › 系统类 › linux › fio test
返回列表 发新帖
查看: 1423|回复: 0

fio test

[复制链接]
admin
  • TA的每日心情
    开心
    2023-8-9 11:05
    		•
    发表于 2022-7-26 11:41:21 | 显示全部楼层 |阅读模式
    目前主流的第三方IO测试工具有fio、iometer和Orion，这三种工具各有千秋。
    fio在Linux系统下使用比较方便，iometer在window系统下使用比较方便，Orion是oracle的IO测试软件，可在没有安装oracle数据库的情况下模拟oracle数据库场景的读写。
    100%随机，100%读， 4K
    fio -filename=/dev/emcpowerb -direct=1 -iodepth 1 -thread -rw=randread -ioengine=psync -bs=4k -size=1000G -numjobs=50 -runtime=180 -group_reporting -name=rand_100read_4k
      100%随机，100%写， 4K
    fio -filename=/dev/emcpowerb -direct=1 -iodepth 1 -thread -rw=randwrite -ioengine=psync -bs=4k -size=1000G -numjobs=50 -runtime=180 -group_reporting -name=rand_100write_4k
      100%顺序，100%读 ，4K
    fio -filename=/dev/emcpowerb -direct=1 -iodepth 1 -thread -rw=read -ioengine=psync -bs=4k -size=1000G -numjobs=50 -runtime=180 -group_reporting -name=sqe_100read_4k
      100%顺序，100%写 ，4K
    fio -filename=/dev/emcpowerb -direct=1 -iodepth 1 -thread -rw=write -ioengine=psync -bs=4k -size=1000G -numjobs=50 -runtime=180 -group_reporting -name=sqe_100write_4k
      100%随机，70%读，30%写 4K
    fio -filename=/dev/emcpowerb -direct=1 -iodepth 1 -thread -rw=randrw -rwmixread=70 -ioengine=psync -bs=4k -size=1000G -numjobs=50 -runtime=180 -group_reporting -name=randrw_70read_4k
    参数说明：
    filename=/dev/sdc        支持文件系统或者裸设备,压测多个磁盘 --filename=/dev/sda:/dev/sdb
    direct=1                 测试过程绕过机器自带的buffer，使测试结果更真实
    rw=randwread             测试随机读的I/O
    rw=randwrite             测试随机写的I/O
    rw=randrw                测试随机混合写和读的I/O
    rw=read                  测试顺序读的I/O
    rw=write                 测试顺序写的I/O
    rw=rw                    测试顺序混合写和读的I/O
    bs=4k                    单次io的块文件大小为4k
    bsrange=512-2048         同上，指定定数据块的大小范围
    size=50g                 本次的测试文件大小为50g，以每次4k的io进行测试
    numjobs=30               本次的测试线程为30
    runtime=1000             测试时间为1000秒，如果不写则一直将5g文件分4k每次写完为止
    ioengine=psync           io引擎使用pync方式，如果要使用libaio引擎，需要yum install libaio-devel包
    rwmixwrite=30            在混合读写的模式下，写占30%
    group_reporting          关于显示结果的，汇总每个进程的信息
    此外其他参数
    lockmem=1g               只使用1g内存进行测试
    zero_buffers             用0初始化系统buffer
    nrfiles=8                每个进程生成文件的数量

    磁盘读写常用测试点：
    1. Read=100% Ramdon=100% rw=randread (100%随机读)
    2. Read=100% Sequence=100% rw=read （100%顺序读）
    3. Write=100% Sequence=100% rw=write （100%顺序写）
    4. Write=100% Ramdon=100% rw=randwrite （100%随机写）
    5. Read=70% Sequence=100% rw=rw, rwmixread=70, rwmixwrite=30（70%顺序读，30%顺序写）
    6. Read=70% Ramdon=100% rw=randrw, rwmixread=70, rwmixwrite=30 (70%随机读，30%随机写)

    https://docs.oracle.com/en-us/iaas/Content/Block/References/samplefiocommandslinux.htm

    1.安装fio
    1. [root@vm1 ~]# yum install fio

    3. Installed:
    4.   fio.x86_64 0:3.7-2.el7                                                                                                                                                

    6. Dependency Installed:
    7.   boost-iostreams.x86_64 0:1.53.0-28.el7      boost-random.x86_64 0:1.53.0-28.el7      boost-system.x86_64 0:1.53.0-28.el7      boost-thread.x86_64 0:1.53.0-28.el7     
    8.   libibverbs.x86_64 0:22.4-6.el7_9            libpmem.x86_64 0:1.5.1-2.1.el7           libpmemblk.x86_64 0:1.5.1-2.1.el7        librados2.x86_64 1:10.2.5-4.el7         
    9.   librbd1.x86_64 1:10.2.5-4.el7               librdmacm.x86_64 0:22.4-6.el7_9          pciutils.x86_64 0:3.5.1-3.el7            rdma-core.x86_64 0:22.4-6.el7_9         

    11. Complete!
    复制代码
    2.IOPS Performance Tests
    2.1 随机读
    1. [root@vm1 ~]# sudo fio --filename=/dev/sda --direct=1 --rw=randread --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=iops-test-job --eta-newline=1 --readonly
    2. iops-test-job: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=256
    3. ...
    4. fio-3.7
    5. Starting 4 processes
    6. Jobs: 4 (f=4): [r(4)][2.5%][r=214MiB/s,w=0KiB/s][r=54.8k,w=0 IOPS][eta 01m:58s]
    7. Jobs: 4 (f=4): [r(4)][4.1%][r=215MiB/s,w=0KiB/s][r=55.0k,w=0 IOPS][eta 01m:56s]
    8. Jobs: 4 (f=4): [r(4)][5.0%][r=213MiB/s,w=0KiB/s][r=54.5k,w=0 IOPS][eta 01m:54s]
    9. Jobs: 4 (f=4): [r(4)][7.4%][r=208MiB/s,w=0KiB/s][r=53.2k,w=0 IOPS][eta 01m:52s]
    10. Jobs: 4 (f=4): [r(4)][9.1%][r=207MiB/s,w=0KiB/s][r=52.9k,w=0 IOPS][eta 01m:50s]
    11. Jobs: 4 (f=4): [r(4)][10.7%][r=208MiB/s,w=0KiB/s][r=53.1k,w=0 IOPS][eta 01m:48s]
    12. Jobs: 4 (f=4): [r(4)][11.6%][r=207MiB/s,w=0KiB/s][r=52.0k,w=0 IOPS][eta 01m:47s]
    13. Jobs: 4 (f=4): [r(4)][13.2%][r=201MiB/s,w=0KiB/s][r=51.4k,w=0 IOPS][eta 01m:45s]
    14. Jobs: 4 (f=4): [r(4)][14.2%][r=197MiB/s,w=0KiB/s][r=50.4k,w=0 IOPS][eta 01m:43s]
    15. Jobs: 4 (f=4): [r(4)][15.7%][r=188MiB/s,w=0KiB/s][r=48.1k,w=0 IOPS][eta 01m:42s]
    16. Jobs: 4 (f=4): [r(4)][16.5%][r=194MiB/s,w=0KiB/s][r=49.5k,w=0 IOPS][eta 01m:41s]
    17. Jobs: 4 (f=4): [r(4)][18.2%][r=197MiB/s,w=0KiB/s][r=50.5k,w=0 IOPS][eta 01m:39s]
    18. Jobs: 4 (f=4): [r(4)][19.8%][r=199MiB/s,w=0KiB/s][r=50.9k,w=0 IOPS][eta 01m:37s]
    19. Jobs: 4 (f=4): [r(4)][21.5%][r=194MiB/s,w=0KiB/s][r=49.6k,w=0 IOPS][eta 01m:35s]
    20. Jobs: 4 (f=4): [r(4)][23.1%][r=195MiB/s,w=0KiB/s][r=49.9k,w=0 IOPS][eta 01m:33s]
    21. Jobs: 4 (f=4): [r(4)][24.2%][r=195MiB/s,w=0KiB/s][r=49.9k,w=0 IOPS][eta 01m:31s]
    22. Jobs: 4 (f=4): [r(4)][25.6%][r=194MiB/s,w=0KiB/s][r=49.6k,w=0 IOPS][eta 01m:30s]
    23. Jobs: 4 (f=4): [r(4)][26.4%][r=192MiB/s,w=0KiB/s][r=49.2k,w=0 IOPS][eta 01m:29s]
    24. Jobs: 4 (f=4): [r(4)][27.5%][r=191MiB/s,w=0KiB/s][r=48.8k,w=0 IOPS][eta 01m:27s]
    25. Jobs: 4 (f=4): [r(4)][28.9%][r=193MiB/s,w=0KiB/s][r=49.4k,w=0 IOPS][eta 01m:26s]
    26. Jobs: 4 (f=4): [r(4)][30.6%][r=191MiB/s,w=0KiB/s][r=48.0k,w=0 IOPS][eta 01m:24s]
    27. Jobs: 4 (f=4): [r(4)][31.7%][r=194MiB/s,w=0KiB/s][r=49.7k,w=0 IOPS][eta 01m:22s]
    28. Jobs: 4 (f=4): [r(4)][32.5%][r=193MiB/s,w=0KiB/s][r=49.3k,w=0 IOPS][eta 01m:21s]
    29. Jobs: 4 (f=4): [r(4)][34.2%][r=194MiB/s,w=0KiB/s][r=49.8k,w=0 IOPS][eta 01m:19s]
    30. Jobs: 4 (f=4): [r(4)][35.8%][r=193MiB/s,w=0KiB/s][r=49.4k,w=0 IOPS][eta 01m:17s]
    31. Jobs: 4 (f=4): [r(4)][36.7%][r=193MiB/s,w=0KiB/s][r=49.5k,w=0 IOPS][eta 01m:16s]
    32. Jobs: 4 (f=4): [r(4)][38.3%][r=162MiB/s,w=0KiB/s][r=41.5k,w=0 IOPS][eta 01m:14s]
    33. Jobs: 4 (f=4): [r(4)][40.0%][r=173MiB/s,w=0KiB/s][r=44.3k,w=0 IOPS][eta 01m:12s]
    34. Jobs: 4 (f=4): [r(4)][41.7%][r=165MiB/s,w=0KiB/s][r=42.1k,w=0 IOPS][eta 01m:10s]
    35. Jobs: 4 (f=4): [r(4)][43.3%][r=162MiB/s,w=0KiB/s][r=41.5k,w=0 IOPS][eta 01m:08s]
    36. Jobs: 4 (f=4): [r(4)][45.0%][r=157MiB/s,w=0KiB/s][r=40.2k,w=0 IOPS][eta 01m:06s]
    37. Jobs: 4 (f=4): [r(4)][45.8%][r=152MiB/s,w=0KiB/s][r=38.9k,w=0 IOPS][eta 01m:05s]
    38. Jobs: 4 (f=4): [r(4)][47.5%][r=160MiB/s,w=0KiB/s][r=40.0k,w=0 IOPS][eta 01m:03s]
    39. Jobs: 4 (f=4): [r(4)][49.2%][r=156MiB/s,w=0KiB/s][r=39.8k,w=0 IOPS][eta 01m:01s]
    40. Jobs: 4 (f=4): [r(4)][50.0%][r=152MiB/s,w=0KiB/s][r=38.9k,w=0 IOPS][eta 01m:00s]
    41. Jobs: 4 (f=4): [r(4)][51.7%][r=122MiB/s,w=0KiB/s][r=31.3k,w=0 IOPS][eta 00m:58s]
    42. Jobs: 4 (f=4): [r(4)][53.3%][r=146MiB/s,w=0KiB/s][r=37.4k,w=0 IOPS][eta 00m:56s]
    43. Jobs: 4 (f=4): [r(4)][54.2%][r=147MiB/s,w=0KiB/s][r=37.5k,w=0 IOPS][eta 00m:55s]
    44. Jobs: 4 (f=4): [r(4)][55.8%][r=148MiB/s,w=0KiB/s][r=37.8k,w=0 IOPS][eta 00m:53s]
    45. Jobs: 4 (f=4): [r(4)][57.5%][r=148MiB/s,w=0KiB/s][r=37.9k,w=0 IOPS][eta 00m:51s]
    46. Jobs: 4 (f=4): [r(4)][58.3%][r=145MiB/s,w=0KiB/s][r=37.0k,w=0 IOPS][eta 00m:50s]
    47. Jobs: 4 (f=4): [r(4)][60.0%][r=148MiB/s,w=0KiB/s][r=37.9k,w=0 IOPS][eta 00m:48s]
    48. Jobs: 4 (f=4): [r(4)][60.8%][r=145MiB/s,w=0KiB/s][r=37.2k,w=0 IOPS][eta 00m:47s]
    49. Jobs: 4 (f=4): [r(4)][61.7%][r=145MiB/s,w=0KiB/s][r=37.1k,w=0 IOPS][eta 00m:46s]
    50. Jobs: 4 (f=4): [r(4)][62.5%][r=140MiB/s,w=0KiB/s][r=35.9k,w=0 IOPS][eta 00m:45s]
    51. Jobs: 4 (f=4): [r(4)][64.2%][r=140MiB/s,w=0KiB/s][r=35.8k,w=0 IOPS][eta 00m:43s]
    52. Jobs: 4 (f=4): [r(4)][65.8%][r=135MiB/s,w=0KiB/s][r=34.5k,w=0 IOPS][eta 00m:41s]
    53. Jobs: 4 (f=4): [r(4)][66.7%][r=130MiB/s,w=0KiB/s][r=33.2k,w=0 IOPS][eta 00m:40s]
    54. Jobs: 4 (f=4): [r(4)][68.3%][r=129MiB/s,w=0KiB/s][r=32.0k,w=0 IOPS][eta 00m:38s]
    55. Jobs: 4 (f=4): [r(4)][70.0%][r=144MiB/s,w=0KiB/s][r=36.0k,w=0 IOPS][eta 00m:36s]
    56. Jobs: 4 (f=4): [r(4)][70.8%][r=140MiB/s,w=0KiB/s][r=35.9k,w=0 IOPS][eta 00m:35s]
    57. Jobs: 4 (f=4): [r(4)][72.5%][r=129MiB/s,w=0KiB/s][r=32.0k,w=0 IOPS][eta 00m:33s]
    58. Jobs: 4 (f=4): [r(4)][73.3%][r=124MiB/s,w=0KiB/s][r=31.8k,w=0 IOPS][eta 00m:32s]
    59. Jobs: 4 (f=4): [r(4)][75.0%][r=112MiB/s,w=0KiB/s][r=28.6k,w=0 IOPS][eta 00m:30s]
    60. Jobs: 4 (f=4): [r(4)][75.8%][r=101MiB/s,w=0KiB/s][r=25.8k,w=0 IOPS][eta 00m:29s]
    61. Jobs: 4 (f=4): [r(4)][77.5%][r=93.0MiB/s,w=0KiB/s][r=23.8k,w=0 IOPS][eta 00m:27s]
    62. Jobs: 4 (f=4): [r(4)][79.2%][r=103MiB/s,w=0KiB/s][r=26.4k,w=0 IOPS][eta 00m:25s]
    63. Jobs: 4 (f=4): [r(4)][80.0%][r=111MiB/s,w=0KiB/s][r=28.3k,w=0 IOPS][eta 00m:24s]
    64. Jobs: 4 (f=4): [r(4)][80.8%][r=119MiB/s,w=0KiB/s][r=30.4k,w=0 IOPS][eta 00m:23s]
    65. Jobs: 4 (f=4): [r(4)][82.5%][r=117MiB/s,w=0KiB/s][r=29.8k,w=0 IOPS][eta 00m:21s]
    66. Jobs: 4 (f=4): [r(4)][83.3%][r=95.8MiB/s,w=0KiB/s][r=24.5k,w=0 IOPS][eta 00m:20s]
    67. Jobs: 4 (f=4): [r(4)][85.0%][r=108MiB/s,w=0KiB/s][r=27.6k,w=0 IOPS][eta 00m:18s]  
    68. Jobs: 4 (f=4): [r(4)][86.7%][r=111MiB/s,w=0KiB/s][r=28.4k,w=0 IOPS][eta 00m:16s]
    69. Jobs: 4 (f=4): [r(4)][87.5%][r=105MiB/s,w=0KiB/s][r=26.9k,w=0 IOPS][eta 00m:15s]
    70. Jobs: 4 (f=4): [r(4)][89.2%][r=104MiB/s,w=0KiB/s][r=26.7k,w=0 IOPS][eta 00m:13s]
    71. Jobs: 4 (f=4): [r(4)][90.8%][r=100MiB/s,w=0KiB/s][r=25.6k,w=0 IOPS][eta 00m:11s]
    72. Jobs: 4 (f=4): [r(4)][92.5%][r=91.4MiB/s,w=0KiB/s][r=23.4k,w=0 IOPS][eta 00m:09s]
    73. Jobs: 4 (f=4): [r(4)][93.3%][r=91.4MiB/s,w=0KiB/s][r=23.4k,w=0 IOPS][eta 00m:08s]
    74. Jobs: 4 (f=4): [r(4)][95.0%][r=91.0MiB/s,w=0KiB/s][r=23.5k,w=0 IOPS][eta 00m:06s]
    75. Jobs: 4 (f=4): [r(4)][96.7%][r=87.1MiB/s,w=0KiB/s][r=22.3k,w=0 IOPS][eta 00m:04s]
    76. Jobs: 4 (f=4): [r(4)][97.5%][r=83.5MiB/s,w=0KiB/s][r=21.4k,w=0 IOPS][eta 00m:03s]
    77. Jobs: 4 (f=4): [r(4)][99.2%][r=73.2MiB/s,w=0KiB/s][r=18.8k,w=0 IOPS][eta 00m:01s]
    78. Jobs: 4 (f=4): [r(4)][100.0%][r=64.4MiB/s,w=0KiB/s][r=16.5k,w=0 IOPS][eta 00m:00s]
    79. iops-test-job: (groupid=0, jobs=4): err= 0: pid=10509: Tue Jul 26 11:18:23 2022
    80.    read: IOPS=39.0k, BW=153MiB/s (160MB/s)(17.9GiB/120003msec)
    81.     slat (nsec): min=1330, max=73194k, avg=93753.02, stdev=823434.15
    82.     clat (usec): min=8, max=211596, avg=26111.13, stdev=17562.51
    83.      lat (usec): min=418, max=211700, avg=26205.41, stdev=17613.60
    84.     clat percentiles (msec):
    85.      |  1.00th=[    7],  5.00th=[    7], 10.00th=[    8], 20.00th=[   13],
    86.      | 30.00th=[   15], 40.00th=[   18], 50.00th=[   22], 60.00th=[   26],
    87.      | 70.00th=[   32], 80.00th=[   39], 90.00th=[   49], 95.00th=[   61],
    88.      | 99.00th=[   87], 99.50th=[   97], 99.90th=[  122], 99.95th=[  133],
    89.      | 99.99th=[  163]
    90.    bw (  KiB/s): min=10083, max=116792, per=24.85%, avg=38803.98, stdev=16341.03, samples=956
    91.    iops        : min= 2520, max=29198, avg=9700.67, stdev=4085.27, samples=956
    92.   lat (usec)   : 10=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    93.   lat (msec)   : 2=0.01%, 4=0.01%, 10=15.23%, 20=30.60%, 50=44.87%
    94.   lat (msec)   : 100=8.90%, 250=0.40%
    95.   cpu          : usr=1.23%, sys=44.62%, ctx=40436, majf=0, minf=1169
    96.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    97.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    98.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
    99.      issued rwts: total=4685150,0,0,0 short=0,0,0,0 dropped=0,0,0,0
    100.      latency   : target=0, window=0, percentile=100.00%, depth=256

    102. Run status group 0 (all jobs):
    103.    READ: bw=153MiB/s (160MB/s), 153MiB/s-153MiB/s (160MB/s-160MB/s), io=17.9GiB (19.2GB), run=120003-120003msec

    105. Disk stats (read/write):
    106.   sda: ios=4682667/157, merge=3/10, ticks=2734007/121, in_queue=2732223, util=100.00%
    复制代码
    2.2 文件随机读写
    1. [root@vm1 ~]# sudo fio --filename=/app/fio --size=10GB --direct=1 --rw=randrw --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=iops-test-job --eta-newline=1
    2. iops-test-job: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=256
    3. ...
    4. fio-3.7
    5. Starting 4 processes
    6. iops-test-job: Laying out IO file (1 file / 10240MiB)
    7. Jobs: 4 (f=4): [m(4)][2.5%][r=63.3MiB/s,w=63.5MiB/s][r=16.2k,w=16.3k IOPS][eta 01m:57s]
    8. Jobs: 4 (f=4): [m(4)][4.2%][r=63.0MiB/s,w=62.0MiB/s][r=16.1k,w=16.1k IOPS][eta 01m:55s]
    9. Jobs: 4 (f=4): [m(4)][5.0%][r=63.8MiB/s,w=63.8MiB/s][r=16.3k,w=16.3k IOPS][eta 01m:54s]
    10. Jobs: 4 (f=4): [m(4)][6.7%][r=63.1MiB/s,w=63.3MiB/s][r=16.2k,w=16.2k IOPS][eta 01m:52s]
    11. Jobs: 4 (f=4): [m(4)][8.3%][r=64.1MiB/s,w=62.5MiB/s][r=16.4k,w=16.0k IOPS][eta 01m:50s]
    12. Jobs: 4 (f=4): [m(4)][10.0%][r=62.3MiB/s,w=62.4MiB/s][r=15.9k,w=15.0k IOPS][eta 01m:48s]
    13. Jobs: 4 (f=4): [m(4)][11.7%][r=63.1MiB/s,w=62.7MiB/s][r=16.1k,w=16.1k IOPS][eta 01m:46s]
    14. Jobs: 4 (f=4): [m(4)][13.3%][r=62.6MiB/s,w=61.3MiB/s][r=16.0k,w=15.7k IOPS][eta 01m:44s]
    15. Jobs: 4 (f=4): [m(4)][15.0%][r=60.4MiB/s,w=60.3MiB/s][r=15.5k,w=15.4k IOPS][eta 01m:42s]
    16. Jobs: 4 (f=4): [m(4)][15.8%][r=60.8MiB/s,w=61.6MiB/s][r=15.6k,w=15.8k IOPS][eta 01m:41s]
    17. Jobs: 4 (f=4): [m(4)][17.5%][r=60.7MiB/s,w=60.9MiB/s][r=15.5k,w=15.6k IOPS][eta 01m:39s]
    18. Jobs: 4 (f=4): [m(4)][19.2%][r=59.1MiB/s,w=59.0MiB/s][r=15.1k,w=15.1k IOPS][eta 01m:37s]
    19. Jobs: 4 (f=4): [m(4)][20.8%][r=58.2MiB/s,w=58.2MiB/s][r=14.9k,w=14.9k IOPS][eta 01m:35s]
    20. Jobs: 4 (f=4): [m(4)][22.5%][r=60.0MiB/s,w=59.0MiB/s][r=15.4k,w=15.1k IOPS][eta 01m:33s]
    21. Jobs: 4 (f=4): [m(4)][24.2%][r=57.8MiB/s,w=57.8MiB/s][r=14.8k,w=14.8k IOPS][eta 01m:31s]
    22. Jobs: 4 (f=4): [m(4)][25.8%][r=59.4MiB/s,w=59.5MiB/s][r=15.2k,w=15.2k IOPS][eta 01m:29s]
    23. Jobs: 4 (f=4): [m(4)][27.5%][r=57.6MiB/s,w=59.1MiB/s][r=14.7k,w=15.1k IOPS][eta 01m:27s]
    24. Jobs: 4 (f=4): [m(4)][29.2%][r=57.4MiB/s,w=56.9MiB/s][r=14.7k,w=14.6k IOPS][eta 01m:25s]
    25. Jobs: 4 (f=4): [m(4)][30.8%][r=59.5MiB/s,w=59.4MiB/s][r=15.2k,w=15.2k IOPS][eta 01m:23s]
    26. Jobs: 4 (f=4): [m(4)][31.7%][r=58.7MiB/s,w=59.0MiB/s][r=15.0k,w=15.1k IOPS][eta 01m:22s]
    27. Jobs: 4 (f=4): [m(4)][33.3%][r=55.2MiB/s,w=54.6MiB/s][r=14.1k,w=13.0k IOPS][eta 01m:20s]
    28. Jobs: 4 (f=4): [m(4)][35.0%][r=52.9MiB/s,w=51.9MiB/s][r=13.5k,w=13.3k IOPS][eta 01m:18s]
    29. Jobs: 4 (f=4): [m(4)][36.7%][r=51.9MiB/s,w=51.8MiB/s][r=13.3k,w=13.3k IOPS][eta 01m:16s]
    30. Jobs: 4 (f=4): [m(4)][38.3%][r=51.3MiB/s,w=51.4MiB/s][r=13.1k,w=13.2k IOPS][eta 01m:14s]
    31. Jobs: 4 (f=4): [m(4)][40.0%][r=53.0MiB/s,w=51.8MiB/s][r=13.6k,w=13.3k IOPS][eta 01m:12s]
    32. Jobs: 4 (f=4): [m(4)][41.7%][r=50.3MiB/s,w=51.1MiB/s][r=12.9k,w=13.1k IOPS][eta 01m:10s]
    33. Jobs: 4 (f=4): [m(4)][43.3%][r=48.9MiB/s,w=50.2MiB/s][r=12.5k,w=12.9k IOPS][eta 01m:08s]
    34. Jobs: 4 (f=4): [m(4)][45.0%][r=48.6MiB/s,w=47.5MiB/s][r=12.4k,w=12.1k IOPS][eta 01m:06s]
    35. Jobs: 4 (f=4): [m(4)][46.7%][r=45.8MiB/s,w=45.4MiB/s][r=11.7k,w=11.6k IOPS][eta 01m:04s]
    36. Jobs: 4 (f=4): [m(4)][48.3%][r=44.7MiB/s,w=44.3MiB/s][r=11.4k,w=11.3k IOPS][eta 01m:02s]
    37. Jobs: 4 (f=4): [m(4)][50.0%][r=45.7MiB/s,w=46.1MiB/s][r=11.7k,w=11.8k IOPS][eta 01m:00s]
    38. Jobs: 4 (f=4): [m(4)][51.7%][r=44.0MiB/s,w=44.8MiB/s][r=11.5k,w=11.5k IOPS][eta 00m:58s]
    39. Jobs: 4 (f=4): [m(4)][53.3%][r=49.1MiB/s,w=48.4MiB/s][r=12.6k,w=12.4k IOPS][eta 00m:56s]
    40. Jobs: 4 (f=4): [m(4)][55.0%][r=42.1MiB/s,w=42.5MiB/s][r=10.8k,w=10.9k IOPS][eta 00m:54s]
    41. Jobs: 4 (f=4): [m(4)][56.7%][r=42.2MiB/s,w=42.9MiB/s][r=10.8k,w=10.0k IOPS][eta 00m:52s]
    42. Jobs: 4 (f=4): [m(4)][58.3%][r=41.6MiB/s,w=42.3MiB/s][r=10.6k,w=10.8k IOPS][eta 00m:50s]
    43. Jobs: 4 (f=4): [m(4)][59.2%][r=39.9MiB/s,w=40.0MiB/s][r=10.2k,w=10.2k IOPS][eta 00m:49s]
    44. Jobs: 4 (f=4): [m(4)][60.8%][r=38.9MiB/s,w=39.8MiB/s][r=9959,w=10.2k IOPS][eta 00m:47s]
    45. Jobs: 4 (f=4): [m(4)][62.5%][r=37.6MiB/s,w=37.6MiB/s][r=9614,w=9618 IOPS][eta 00m:45s]   
    46. Jobs: 4 (f=4): [m(4)][64.2%][r=42.1MiB/s,w=41.0MiB/s][r=10.8k,w=10.5k IOPS][eta 00m:43s]
    47. Jobs: 4 (f=4): [m(4)][65.8%][r=41.6MiB/s,w=41.3MiB/s][r=10.7k,w=10.6k IOPS][eta 00m:41s]
    48. Jobs: 4 (f=4): [m(4)][67.5%][r=38.2MiB/s,w=37.6MiB/s][r=9786,w=9634 IOPS][eta 00m:39s]   
    49. Jobs: 4 (f=4): [m(4)][69.2%][r=34.2MiB/s,w=33.2MiB/s][r=8763,w=8493 IOPS][eta 00m:37s]
    50. Jobs: 4 (f=4): [m(4)][70.8%][r=23.0MiB/s,w=23.9MiB/s][r=6143,w=6126 IOPS][eta 00m:35s]
    51. Jobs: 4 (f=4): [m(4)][72.5%][r=36.4MiB/s,w=36.2MiB/s][r=9314,w=9272 IOPS][eta 00m:33s]
    52. Jobs: 4 (f=4): [m(4)][74.2%][r=36.8MiB/s,w=36.3MiB/s][r=9408,w=9295 IOPS][eta 00m:31s]
    53. Jobs: 4 (f=4): [m(4)][75.8%][r=36.4MiB/s,w=36.0MiB/s][r=9310,w=9219 IOPS][eta 00m:29s]
    54. Jobs: 4 (f=4): [m(4)][77.5%][r=33.6MiB/s,w=33.6MiB/s][r=8606,w=8608 IOPS][eta 00m:27s]
    55. Jobs: 4 (f=4): [m(4)][79.2%][r=34.7MiB/s,w=33.9MiB/s][r=8890,w=8681 IOPS][eta 00m:25s]
    56. Jobs: 4 (f=4): [m(4)][80.8%][r=34.0MiB/s,w=33.5MiB/s][r=8710,w=8564 IOPS][eta 00m:23s]
    57. Jobs: 4 (f=4): [m(4)][82.5%][r=31.8MiB/s,w=31.3MiB/s][r=8142,w=8019 IOPS][eta 00m:21s]
    58. Jobs: 4 (f=4): [m(4)][84.2%][r=31.4MiB/s,w=31.3MiB/s][r=8045,w=8022 IOPS][eta 00m:19s]
    59. Jobs: 4 (f=4): [m(4)][85.8%][r=30.0MiB/s,w=31.1MiB/s][r=7933,w=7963 IOPS][eta 00m:17s]
    60. Jobs: 4 (f=4): [m(4)][86.7%][r=29.4MiB/s,w=28.6MiB/s][r=7533,w=7317 IOPS][eta 00m:16s]
    61. Jobs: 4 (f=4): [m(4)][88.3%][r=28.5MiB/s,w=28.0MiB/s][r=7286,w=7415 IOPS][eta 00m:14s]
    62. Jobs: 4 (f=4): [m(4)][90.0%][r=23.0MiB/s,w=24.5MiB/s][r=6136,w=6271 IOPS][eta 00m:12s]
    63. Jobs: 4 (f=4): [m(4)][91.7%][r=24.1MiB/s,w=24.2MiB/s][r=6161,w=6201 IOPS][eta 00m:10s]
    64. Jobs: 4 (f=4): [m(4)][93.3%][r=26.1MiB/s,w=26.0MiB/s][r=6686,w=6665 IOPS][eta 00m:08s]
    65. Jobs: 4 (f=4): [m(4)][95.0%][r=25.5MiB/s,w=25.6MiB/s][r=6536,w=6549 IOPS][eta 00m:06s]
    66. Jobs: 4 (f=4): [m(4)][96.7%][r=24.3MiB/s,w=24.1MiB/s][r=6224,w=6167 IOPS][eta 00m:04s]
    67. Jobs: 4 (f=4): [m(4)][98.3%][r=21.7MiB/s,w=22.2MiB/s][r=5567,w=5686 IOPS][eta 00m:02s]
    68. Jobs: 4 (f=4): [m(4)][100.0%][r=21.8MiB/s,w=22.1MiB/s][r=5593,w=5651 IOPS][eta 00m:00s]
    69. iops-test-job: (groupid=0, jobs=4): err= 0: pid=15955: Tue Jul 26 11:30:17 2022
    70.    read: IOPS=11.6k, BW=45.2MiB/s (47.4MB/s)(5428MiB/120005msec)
    71.     slat (nsec): min=1805, max=64962k, avg=135084.14, stdev=633735.09
    72.     clat (usec): min=266, max=201859, avg=43959.32, stdev=16345.61
    73.      lat (usec): min=345, max=201925, avg=44094.87, stdev=16391.37
    74.     clat percentiles (msec):
    75.      |  1.00th=[   22],  5.00th=[   26], 10.00th=[   29], 20.00th=[   32],
    76.      | 30.00th=[   35], 40.00th=[   37], 50.00th=[   40], 60.00th=[   43],
    77.      | 70.00th=[   48], 80.00th=[   55], 90.00th=[   67], 95.00th=[   79],
    78.      | 99.00th=[   96], 99.50th=[  103], 99.90th=[  122], 99.95th=[  138],
    79.      | 99.99th=[  188]
    80.    bw (  KiB/s): min= 4134, max=18048, per=24.99%, avg=11576.08, stdev=3416.91, samples=959
    81.    iops        : min= 1033, max= 4512, avg=2893.94, stdev=854.25, samples=959
    82.   write: IOPS=11.6k, BW=45.2MiB/s (47.4MB/s)(5429MiB/120005msec)
    83.     slat (usec): min=2, max=51335, avg=197.77, stdev=727.42
    84.     clat (usec): min=6, max=200588, avg=44095.02, stdev=16439.35
    85.      lat (usec): min=231, max=201897, avg=44293.40, stdev=16500.81
    86.     clat percentiles (msec):
    87.      |  1.00th=[   22],  5.00th=[   26], 10.00th=[   29], 20.00th=[   32],
    88.      | 30.00th=[   35], 40.00th=[   37], 50.00th=[   40], 60.00th=[   44],
    89.      | 70.00th=[   48], 80.00th=[   55], 90.00th=[   67], 95.00th=[   79],
    90.      | 99.00th=[   96], 99.50th=[  103], 99.90th=[  124], 99.95th=[  144],
    91.      | 99.99th=[  188]
    92.    bw (  KiB/s): min= 4468, max=17776, per=24.99%, avg=11578.11, stdev=3430.21, samples=959
    93.    iops        : min= 1117, max= 4444, avg=2894.44, stdev=857.57, samples=959
    94.   lat (usec)   : 10=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
    95.   lat (msec)   : 2=0.01%, 4=0.01%, 10=0.09%, 20=0.53%, 50=72.54%
    96.   lat (msec)   : 100=26.19%, 250=0.64%
    97.   cpu          : usr=1.69%, sys=28.76%, ctx=2496870, majf=0, minf=133
    98.   IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
    99.      submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    100.      complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
    101.      issued rwts: total=1389668,1389930,0,0 short=0,0,0,0 dropped=0,0,0,0
    102.      latency   : target=0, window=0, percentile=100.00%, depth=256

    104. Run status group 0 (all jobs):
    105.    READ: bw=45.2MiB/s (47.4MB/s), 45.2MiB/s-45.2MiB/s (47.4MB/s-47.4MB/s), io=5428MiB (5692MB), run=120005-120005msec
    106.   WRITE: bw=45.2MiB/s (47.4MB/s), 45.2MiB/s-45.2MiB/s (47.4MB/s-47.4MB/s), io=5429MiB (5693MB), run=120005-120005msec

    108. Disk stats (read/write):
    109.     dm-2: ios=1388779/1389063, merge=0/0, ticks=2476155/1879075, in_queue=4358558, util=98.85%, aggrios=1389737/1390083, aggrmerge=5/15, aggrticks=2436837/1823174, aggrin_queue=4259155, aggrutil=98.73%
    110.   sda: ios=1389737/1390083, merge=5/15, ticks=2436837/1823174, in_queue=4259155, util=98.73%
    复制代码




    回复

    使用道具 举报

    返回列表 发新帖
    高级模式
    B Color Image Link Quote Code Smilies
    您需要登录后才可以回帖 登录 | 立即注册

    本版积分规则

    运维联盟俱乐部 ( 冀ICP备19036648号 )

    GMT+8, 2024-5-12 11:50 , Processed in 0.049062 second(s), 21 queries , Gzip On.

    Powered by Discuz! X3.4

    © 2001-2023 Discuz! Team.

    快速回复 返回顶部 返回列表