<div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial"><div>Hi guys,</div>
<div>I have spent many days on debuging read/write performance of glusterfs with samba-gluster-vfs plugin recently. The write performance is okay, but the read speed is always dispirited.</div>
<div>The testing environment is like this:</div>
<div> <strong> OS: </strong>centos 6.4</div>
<div> <strong>hosts</strong>: two hosts, one for samba server which glusterfs with samba-glusterfs-vfs runs on it, the other for samba client</div>
<div> <strong>glusterfs version</strong>: 3.4.2</div>
<div> <strong>samba-glusterfs-vfs</strong>: git://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs.git.</div>
<div> <strong>gluster volume type </strong>: Distributed </div>
<div> <strong>smb.conf: </strong><br> large readwrite = yes<br> aio read size = 262144<br> aio write size = 262144<br> aio write behind = true<br> ;min receivefile size = 262144<br> ;write cache size = 268435456 <br> read raw = yes<br> write raw = yes<br> max xmit = 262144<br> socket options = TCP_NODELAY IPTOS_LOWDELAY SO_RCVBUF=262144 SO_SNDBUF=262144<br> kernel oplocks = no<br> stat cache = no</div>
<div> </div>
<div> [gluster]<br> vfs objects = glusterfs<br> glusterfs:volume = test<br> glusterfs:volfile_server = localhost <br> browseable = yes<br> guest ok = yes<br> read only = no<br> writable = yes<br> path = /<br> public = yes<br> comment = For samba export of volume test<br> write list = <br> valid users = a2</div>
<div><strong>Firstly, i mount the shared on client with command like this:</strong></div>
<div># mount -t cifs -o username=a2 //192.168.102.189/gluster /mnt</div>
<div><strong>And then test read performance with dd command like this:</strong></div>
<div># dd if=/dev/zero of=/mnt/d1 bs=128k count=10240</div>
<div><strong>the write speed : 350 - 420 MB</strong></div>
<div># dd if=/mnt/d1 of=/dev/null bs=128k count=10240</div>
<div><strong>the read speed : 19 - 20 MB</strong></div>
<div>The read speed is unbelievably slow. </div>
<div>When i modified the smb.conf to exporting glusterfs fuse mount directory directly without using samba-glusterfs-vfs plugin, I got the performance results as follows:</div>
<div>
<div><strong>the write speed : 150 - 180 MB</strong></div>
<div><strong>the read speed : 62 - 64MB</strong></div>
<div>In contrast with the result with samba-gluster-vfs, it looks like our plugin reduced the read speed through CIFS. </div>
<div>Why is there such a situation? Where is the problem? Any reply will be appreciated. Thanks very much!</div>
<div>with best regards!</div>
<div>lou.chen </div>
<div> </div></div>
<div> </div></div><br><br><span title="neteasefooter"><span id="netease_mail_footer"></span></span>