<div dir="ltr">We have a very simple GlusterFS setup as our mail server files storage. We are facing problem with the performance, you can see I/O wait if very high. We are quite new to GlusterFS, could someone helps? Thank a lot.<div>
<br></div><div>=========version=============</div><div><div>[root@g1 ~]# glusterfsd --version</div><div>glusterfs 3.5.0 built on Apr 23 2014 12:53:55</div></div><div><br></div><div><div>[root@g2 ~]# glusterfsd --version</div>
<div>glusterfs 3.5.0 built on Apr 23 2014 12:53:55</div></div><div><br></div><div><br></div><div>==========volume info==========</div><div><div>[root@g1 ~]# gluster volume info</div><div><br></div><div>Volume Name: GFSv1-data</div>
<div>Type: Replicate</div><div>Volume ID: c8902563-fb57-4549-9bfe-fb49c1f4182d</div><div>Status: Started</div><div>Number of Bricks: 1 x 2 = 2</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: g1.i-admin.com:/GlusterFS/data</div>
<div>Brick2: g2.i-admin.com:/GlusterFS/data</div><div>Options Reconfigured:</div><div>auth.allow: 192.168.3.*</div></div><div><br></div><div><br></div><div><div>[root@g2 ~]# gluster volume info</div><div><br></div><div>Volume Name: GFSv1-data</div>
<div>Type: Replicate</div><div>Volume ID: c8902563-fb57-4549-9bfe-fb49c1f4182d</div><div>Status: Started</div><div>Number of Bricks: 1 x 2 = 2</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: g1.i-admin.com:/GlusterFS/data</div>
<div>Brick2: g2.i-admin.com:/GlusterFS/data</div><div>Options Reconfigured:</div><div>auth.allow: 192.168.3.*</div></div><div><br></div><div><br></div><div>==========I/O wait - g1 ==============</div><div><br></div><div><div>
top - 14:20:39 up 122 days, 3:02, 3 users, load average: 17.31, 16.13, 14.51</div><div>Tasks: 117 total, 2 running, 115 sleeping, 0 stopped, 0 zombie</div><div>Cpu(s): 0.2%us, 0.3%sy, 0.0%ni, 0.0%id, 99.5%wa, 0.0%hi, 0.0%si, 0.0%st</div>
<div>Mem: 3802844k total, 3598252k used, 204592k free, 1844472k buffers</div><div>Swap: 3948536k total, 696k used, 3947840k free, 1048028k cached</div><div><br></div><div> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND</div>
<div>12583 root 20 0 1162m 39m 2912 S 1.0 1.1 23:20.09 glusterfsd</div><div> 12 root 20 0 0 0 0 R 0.3 0.0 2:32.30 events/1</div><div> 1 root 20 0 19232 608 432 S 0.0 0.0 0:00.48 init</div>
<div> 2 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kthreadd</div><div> 3 root RT 0 0 0 0 S 0.0 0.0 0:00.30 migration/0</div></div><div><br></div><div><br></div><div><br></div><div>==========I/O wait - g2 ==============<br>
</div><div><br></div><div><div><div>top - 14:14:00 up 121 days, 21:24, 3 users, load average: 10.93, 9.45, 9.09</div><div>Tasks: 117 total, 1 running, 116 sleeping, 0 stopped, 0 zombie</div><div>Cpu(s): 6.0%us, 6.7%sy, 0.0%ni, 0.2%id, 87.1%wa, 0.0%hi, 0.0%si, 0.0%st</div>
<div>Mem: 3737300k total, 3506328k used, 230972k free, 1597872k buffers</div><div>Swap: 3948536k total, 936k used, 3947600k free, 1183916k cached</div><div><br></div><div> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND</div>
<div> 4841 root 20 0 1166m 45m 2968 S 26.0 1.2 9:49.25 glusterfsd</div><div> 22 root 20 0 0 0 0 S 0.3 0.0 1:12.73 kblockd/0</div><div> 1 root 20 0 19232 700 516 S 0.0 0.0 0:00.80 init</div>
<div> 2 root 20 0 0 0 0 S 0.0 0.0 0:00.06 kthreadd</div><div> 3 root RT 0 0 0 0 S 0.0 0.0 0:00.34 migration/0</div></div></div><div><br></div></div>