Hello all,<div><br></div><div>I've configured 4 bricks over a GigE network, however I'm getting very slow performance for writing to my gluster share. </div><div><br></div><div>Just set this up this week, and here's what I'm seeing: </div>
<div><br></div><div><div>[root@vm-container-0-0 ~]# gluster --version | head -1</div><div>glusterfs 3.2.2 built on Jul 14 2011 13:34:25</div></div><div><br></div><div><div>[root@vm-container-0-0 pifs]# gluster volume info</div>
<div><br></div><div>Volume Name: pifs</div><div>Type: Distributed-Replicate</div><div>Status: Started</div><div>Number of Bricks: 2 x 2 = 4</div><div>Transport-type: tcp</div><div>Bricks:</div><div>Brick1: vm-container-0-0:/gluster</div>
<div>Brick2: vm-container-0-1:/gluster</div><div>Brick3: vm-container-0-2:/gluster</div><div>Brick4: vm-container-0-3:/gluster</div></div><div><br></div><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div>
The 4 systems, are each storage bricks and storage clients, mounting gluster like so:</div><div><br></div><div><div>[root@vm-container-0-1 ~]# df -h /pifs/</div><div>Filesystem Size Used Avail Use% Mounted on</div>
<div>glusterfs#127.0.0.1:pifs</div><div> 1.8T 848M 1.7T 1% /pifs</div></div></div><div><br></div><div>iperf show's network through put looking good:</div><div><br></div><div><div>[root@vm-container-0-0 pifs]# iperf -c vm-container-0-1</div>
<div>------------------------------------------------------------</div><div>Client connecting to vm-container-0-1, TCP port 5001</div><div>TCP window size: 16.0 KByte (default)</div><div>------------------------------------------------------------</div>
<div>[ 3] local 10.19.127.254 port 53441 connected with 10.19.127.253 port 5001</div><div>[ ID] Interval Transfer Bandwidth</div><div>[ 3] 0.0-10.0 sec 1.10 GBytes 941 Mbits/sec</div></div><div><br></div>
<div><br></div><div>Then, writing to the local disk is pretty fast:</div><div><br></div><div><div>[root@vm-container-0-0 pifs]# dd if=/dev/zero of=/root/dd_test.img bs=1M count=2000</div><div>2000+0 records in</div><div>2000+0 records out</div>
<div>2097152000 bytes (2.1 GB) copied, 4.8066 seconds, 436 MB/s</div></div><div><br></div><div>However, writes to the gluster share, are abysmally slow:</div><div><br></div><div><div>[root@vm-container-0-0 pifs]# dd if=/dev/zero of=/pifs/dd_test.img bs=1M count=2000</div>
<div>2000+0 records in</div><div>2000+0 records out</div><div>2097152000 bytes (2.1 GB) copied, 241.866 seconds, 8.7 MB/s</div></div><div><br></div><div>Other than the fact that it's quite slow, it seems to be very stable. </div>
<div><br></div><div>iozone testing shows about the same results. </div><div><br></div><div>Any help troubleshooting would be much appreciated. Thanks!</div><div><br></div><div> --joey</div><div><br></div><div><br></div>
<div><br></div><div><br></div>