<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.6000.16809" name=GENERATOR>
<STYLE>@font-face {
font-family: 宋体;
}
@font-face {
font-family: Verdana;
}
@font-face {
font-family: @宋体;
}
@page Section1 {size: 595.3pt 841.9pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; layout-grid: 15.6pt; }
P.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
LI.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
DIV.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
FONT-WEIGHT: normal; COLOR: windowtext; FONT-STYLE: normal; FONT-FAMILY: Verdana; TEXT-DECORATION: none; mso-style-type: personal-compose
}
DIV.Section1 {
page: Section1
}
UNKNOWN {
FONT-SIZE: 10pt
}
BLOCKQUOTE {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</STYLE>
</HEAD>
<BODY style="FONT-SIZE: 10pt; MARGIN: 10px; FONT-FAMILY: verdana">
<DIV><FONT face=Verdana color=#000080 size=2>Hello everybody:</FONT></DIV>
<DIV><FONT color=#000080> I have some problem with
performance of 1client+2server application. </FONT></DIV>
<DIV><FONT color=#000080> </FONT></DIV>
<DIV><FONT color=#000080> The system is AS5.2,
2.6.18-92.el5PAE kernel.</FONT></DIV>
<DIV><FONT color=#000080> GFS
is 1.3.9 built on Feb 11 2009 16:07:40
,Repository revision: glusterfs--mainline--2.5--patch-770</FONT></DIV>
<DIV><FONT color=#000080> FUSE is fuse-2.7.3glfs10
</FONT></DIV>
<DIV>======================================================</DIV>
<DIV><FONT color=#000080> GFS server has 4G memory , no raid ,PC
server </FONT><FONT color=#000080> </FONT></DIV>
<DIV><FONT color=#000080>172.20.22.0
<DIV>/dev/sda10 665G 198M 631G 1% /opt</DIV>
<DIV>/dev/sda8 24G 373M 23G 2% /var</DIV>
<DIV>/dev/sda7 26G 2.6G 22G 11% /usr</DIV>
<DIV>/dev/sda9 116G 191M 109G 1% /usr/local</DIV>
<DIV>/dev/sda6 22G 173M 21G 1% /tmp</DIV>
<DIV>/dev/sda5 28G 173M 26G 1% /home</DIV>
<DIV>/dev/sda1 114M 13M 96M 12% /boot</DIV>
<DIV>/dev/sdb1 917G 1.8G 869G 1% /disk1</DIV>
<DIV>/dev/sdc1 917G 1.7G 869G 1% /disk2</DIV>
<DIV>tmpfs 2.0G 0 2.0G 0% /dev/shm</DIV>
<DIV> </DIV>
<DIV>172.20.22.9</DIV>
<DIV>
<DIV>/dev/hda9 510G 199M 483G 1% /opt</DIV>
<DIV>/dev/hda5 45G 383M 42G 1% /var</DIV>
<DIV>/dev/hda3 25G 2.5G 21G 11% /usr</DIV>
<DIV>/dev/hda6 282G 194M 268G 1% /usr/local</DIV>
<DIV>/dev/hda2 20G 173M 19G 1% /home</DIV>
<DIV>/dev/hda1 99M 13M 81M 14% /boot</DIV>
<DIV>tmpfs 2.0G 0 2.0G 0% /dev/shm</DIV>
<DIV>/dev/hdc1 917G 1.8G 869G 1% /disk1</DIV>
<DIV>/dev/hdd1 917G 1.7G 869G 1% /disk2</DIV>
<DIV>======================================================</DIV>
<DIV>GFS client has 4G memory , virtual terminal </DIV>
<DIV>
<DIV>Filesystem Size Used Avail Use% Mounted on</DIV>
<DIV>/dev/sda3 141G 5.6G 128G 5% /</DIV>
<DIV>/dev/sda1 190M 12M 169M 7% /boot</DIV>
<DIV>tmpfs 948M 0 948M 0% /dev/shm</DIV>
<DIV>glusterfs 1.8T 3.4G 1.7T 1% /data1
</DIV></DIV>
<DIV>======================================================</DIV>
<DIV>server configure </DIV>
<DIV>
<DIV>volume disk1</DIV>
<DIV> type storage/posix # POSIX FS translator</DIV>
<DIV> option directory /disk1/data # Export this directory</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume disk2</DIV>
<DIV> type storage/posix # POSIX FS translator</DIV>
<DIV> option directory /disk2/data # Export this directory</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume ns</DIV>
<DIV> type storage/posix # POSIX FS translator</DIV>
<DIV> option directory /disk1/export-ns # Export this directory</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume iot1</DIV>
<DIV> type performance/io-threads</DIV>
<DIV> subvolumes disk1 </DIV>
<DIV> option thread-count 16 # default value is 1</DIV>
<DIV> option cache-size 4MB # default is 64MB (This is per thread, so configure it according to your RAM size and thread-count.</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume iot2</DIV>
<DIV> type performance/io-threads</DIV>
<DIV> subvolumes disk2</DIV>
<DIV> option thread-count 16 # default value is 1</DIV>
<DIV> option cache-size 4MB # default is 64MB (This is per thread, so configure it according to your RAM size and thread-count.</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV></DIV>
<DIV>volume server</DIV>
<DIV> type protocol/server</DIV>
<DIV> option transport-type tcp/server # For TCP/IP transport</DIV>
<DIV> subvolumes disk1 disk2 iot1 iot2 ns</DIV>
<DIV> option auth.ip.disk1.allow * # Allow access to "disk1" volume</DIV>
<DIV> option auth.ip.disk2.allow * # Allow access to "disk2" volume</DIV>
<DIV> option auth.ip.ns.allow * # Allow access to "ns" volume</DIV>
<DIV> option auth.ip.iot1.allow * # Allow access to "disk2" volume</DIV>
<DIV> option auth.ip.iot2.allow * # Allow access to "disk2" volume</DIV>
<DIV>end-volume</DIV></DIV>
<DIV>=====================================================</DIV>
<DIV>client configure</DIV>
<DIV> </DIV>
<DIV>
<DIV>volume client1</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.0 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume iot1 # name of the remote volume</DIV>
<DIV> option transport-timeout 20 </DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume client2</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.0 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume iot2</DIV>
<DIV> option transport-timeout 20</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume client3</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.9 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume iot1</DIV>
<DIV> option transport-timeout 20</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume client4</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.9 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume iot2</DIV>
<DIV> option transport-timeout 20</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume ns1</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.0 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume ns</DIV>
<DIV>option transport-timeout 20</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV></DIV>
<DIV>volume ns2</DIV>
<DIV> type protocol/client</DIV>
<DIV> option transport-type tcp/client # for TCP/IP transport</DIV>
<DIV> option remote-host 172.20.22.9 # IP address of the remote brick</DIV>
<DIV> option remote-subvolume ns</DIV>
<DIV> option transport-timeout 20</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume afr1</DIV>
<DIV> type cluster/afr</DIV>
<DIV> subvolumes client1 client3 </DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume afr2</DIV>
<DIV> type cluster/afr</DIV>
<DIV> subvolumes client2 client4</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV></DIV>
<DIV>volume afr-ns</DIV>
<DIV> type cluster/afr</DIV>
<DIV> subvolumes ns1 ns2</DIV>
<DIV>end-volume</DIV>
<DIV> </DIV>
<DIV></DIV>
<DIV>volume unify</DIV>
<DIV> type cluster/unify</DIV>
<DIV> option namespace afr-ns</DIV>
<DIV> option scheduler rr</DIV>
<DIV> subvolumes afr1 afr2 </DIV>
<DIV>end-volume</DIV>
<DIV> </DIV></DIV></DIV></FONT></DIV>
<DIV><FONT face=Verdana color=#000080 size=2>
<DIV>volume iot</DIV>
<DIV> type performance/io-threads</DIV>
<DIV> option thread-count 32</DIV>
<DIV> option cache-size 4MB</DIV>
<DIV> subvolumes unify </DIV>
<DIV>end-volume</DIV>
<DIV>=======================================================</DIV>
<DIV>When i writed some data into gluster directory /data1 by
using dozen dd commands , </DIV>
<DIV>i use "time ll -h " in /data1 with
result : </DIV>
<DIV>real 0m8.388s</DIV>
<DIV>user 0m0.000s</DIV>
<DIV>sys 0m0.000s</DIV>
<DIV> </DIV>
<DIV>How could i improve my performance ? what should i do ? waiting for
your return ,thanks a lot </DIV>
<DIV> </DIV>
<DIV>Could some tell me what your GFS configure?</DIV></FONT></DIV>
<DIV><FONT face=Verdana color=#c0c0c0 size=2>2009-02-17 </FONT></DIV><FONT
face=Verdana color=#000080 size=2>
<HR style="WIDTH: 100px" align=left color=#b5c4df SIZE=1>
</FONT>
<DIV><FONT face=Verdana color=#c0c0c0 size=2><SPAN>eagleeyes</SPAN>
</FONT></DIV></BODY></HTML>