<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=us-ascii" http-equiv=Content-Type>
<STYLE>
BLOCKQUOTE {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
P {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
BODY {
LINE-HEIGHT: 1.5; FONT-FAMILY: 宋体; COLOR: #000000; FONT-SIZE: 10.5pt
}
</STYLE>
<META name=GENERATOR content="MSHTML 8.00.6001.19328"></HEAD>
<BODY style="MARGIN: 10px">
<DIV>Hello folks,</DIV>
<DIV> </DIV>
<DIV>We test samba performance with local ext4 and glusterfs backends, it
shows performance is very different.</DIV>
<DIV>The samba server has 4 1Gbps NICs and bond with mode 6, backend storage is
raid0 with 12 SAS disks.</DIV>
<DIV>A LUN is created over all disks, make as EXT4 file system, and used as
glusterfs brick.</DIV>
<DIV> </DIV>
<DIV>On the samba server, use dd test local ext4 and
glusterfs, write bandwidth are 477MB/s and 357MB/s, details as
follow.</DIV>
<DIV>When mount cifs on Centos 6.0, write bandwidth downgrade to 184MB/s and
117MB/s, very different.</DIV>
<DIV>Using 4 win7 clients to test with SANergy/Iometer, cifs over ext4
aggregate throughput can get about 391 MB/s.</DIV>
<DIV>However, cifs over glusterfs aggregate throughput only can get
about 180 MB/s.</DIV>
<DIV> </DIV>
<DIV>Why CIFS performance is so slow over glusterfs backend? </DIV>
<DIV>Anybody meet such issues and how to resolve(samba and glusterfs
parameters)? </DIV>
<DIV>thanks a lot in advance.</DIV>
<DIV> </DIV>
<DIV>#test local ext4</DIV>
<DIV>[root@pana53 5f4554cf-3b56-43e5-847e-cb409b0edc30]# dd if=/dev/zero
of=dd.dat bs=1MB count=10k<BR>10240+0 records in<BR>10240+0 records
out<BR>10240000000 bytes (10 GB) copied, 21.4764 s, 477 MB/s</DIV>
<DIV> </DIV>
<DIV>#test local glusterfs</DIV>
<DIV>
<DIV>[root@pana53 61659a17-69bd-4704-81fe-0853f1c891cd]# dd if=/dev/zero of=dd.dat bs=1MB count=10k </DIV>
<DIV>10240+0 records in</DIV>
<DIV>10240+0 records out</DIV>
<DIV>10240000000 bytes (10 GB) copied, 28.7148 s, 357 MB/s</DIV>
<DIV> </DIV>
<DIV>#test cifs over ext4</DIV>
<DIV>[root@pana53 ext4-share]# dd if=/dev/zero of=dd.dat bs=1MB
count=10k<BR>10240+0 records in<BR>10240+0 records out<BR>10240000000 bytes (10
GB) copied, 55.5549 s, 184 MB/s</DIV>
<DIV> </DIV>
<DIV>#test cifs over glusterfs</DIV>
<DIV>
<DIV>[root@pana53 glusterfs-share]# dd if=/dev/zero of=dd.dat bs=1MB count=10k</DIV>
<DIV>10240+0 records in</DIV>
<DIV>10240+0 records out</DIV>
<DIV>10240000000 bytes (10 GB) copied, 87.4899 s, 117 MB/s</DIV></DIV>
<DIV> </DIV></DIV>
<DIV> </DIV>
<DIV>here is smb.conf:</DIV>
<DIV>[global]<BR> server string =
samba server<BR> map to guest = Bad
Password<BR> log file =
/var/log/samba/log.%m<BR> max log size
= 50<BR> max protocol =
SMB2<BR> socket options = TCP_NODELAY
IPTOS_LOWDELAY<BR> idmap config * :
backend = tdb<BR> aio read size =
16384<BR> aio write size =
16384<BR> use sendfile =
Yes<BR> posix locking = No</DIV>
<DIV> </DIV>
<DIV>[ext4-share]<BR> comment =
None<BR> path =
/data/5f4554cf-3b56-43e5-847e-cb409b0edc30<BR>
read only = No<BR> guest ok =
Yes</DIV>
<DIV> </DIV>
<DIV>[glusterfs-share]<BR> comment =
None<BR> path =
/reexport/61659a17-69bd-4704-81fe-0853f1c891cd<BR>
read only = No<BR> guest ok =
Yes </DIV>
<DIV> </DIV>
<DIV>here is gluster volume info:</DIV>
<DIV>
<DIV>[root@pana53 glusterfs-share]# gluster volume info </DIV>
<DIV>Volume Name: vol1</DIV>
<DIV>Type: Distribute</DIV>
<DIV>Status: Started</DIV>
<DIV>Number of Bricks: 1</DIV>
<DIV>Transport-type: tcp</DIV>
<DIV>Bricks:</DIV>
<DIV>Brick1: pana53:/data/5f4554cf-3b56-43e5-847e-cb409b0edc30</DIV>
<DIV>Options Reconfigured:</DIV>
<DIV>auth.allow: *,192.168.1.*</DIV>
<DIV>features.quota: on</DIV>
<DIV>nfs.disable: on</DIV></DIV>
<DIV> </DIV>
<DIV>BR,</DIV>
<DIV>liuben</DIV>
<DIV>
<HR style="WIDTH: 210px; HEIGHT: 1px" align=left color=#b5c4df SIZE=1>
</DIV>
<DIV><SPAN><A
href="mailto:nuaa_liuben@sina.com">nuaa_liuben@sina.com</A></SPAN></DIV></BODY></HTML>