<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=iso-8859-1" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 9.00.8112.16421">
<STYLE>@font-face {
font-family: 宋体;
}
@font-face {
font-family: Verdana;
}
@font-face {
font-family: @宋体;
}
@page Section1 {size: 595.3pt 841.9pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; layout-grid: 15.6pt; }
P.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
LI.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
DIV.MsoNormal {
TEXT-JUSTIFY: inter-ideograph; TEXT-ALIGN: justify; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; FONT-SIZE: 10.5pt
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
FONT-STYLE: normal; FONT-FAMILY: Verdana; COLOR: windowtext; FONT-WEIGHT: normal; TEXT-DECORATION: none; mso-style-type: personal-compose
}
DIV.Section1 {
page: Section1
}
UNKNOWN {
FONT-SIZE: 10pt
}
BLOCKQUOTE {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</STYLE>
</HEAD>
<BODY style="MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt">
<DIV><FONT color=#000080 size=3 face=Verdana>Avg. files size is between 2 ~ 6KB,
both text and binary files.</FONT></DIV>
<DIV><FONT color=#000080 size=3>1) about 30 MB/s for singel client, this can be
realized?</FONT></DIV>
<DIV><FONT color=#000080 size=3>2) dd with 4KB can get about 30 -
40MB/s</FONT></DIV>
<DIV><FONT color=#000080 size=3>3) multiple clients can near linearly
increase performance </FONT></DIV>
<DIV><FONT color=#000080 size=3>4) only use single thread for
testing</FONT></DIV>
<DIV><FONT color=#000080 size=3></FONT> </DIV>
<DIV><FONT color=#000080 size=3>BR,</FONT></DIV>
<DIV><FONT color=#000080 size=3>liuben</FONT></DIV>
<DIV><FONT color=#c0c0c0 size=2 face=Verdana></FONT> </DIV>
<DIV><FONT size=2 face=Verdana><STRONG>>From:</STRONG> Mohit Anchlia
</FONT></DIV>
<DIV><FONT size=2 face=Verdana><STRONG>>Send Time:
</STRONG> 2011-05-18 09:54:45 </FONT></DIV>
<DIV><FONT size=2 face=Verdana><STRONG>>TO:</STRONG> nuaa_liuben
</FONT></DIV>
<DIV><FONT size=2 face=Verdana><STRONG>>CC: </STRONG> gluster-users
</FONT></DIV>
<DIV><FONT size=2 face=Verdana><STRONG>>Subject:</STRONG> Re: [Gluster-users]
Gluster 3.2 for lots of small files </FONT></DIV>
<DIV><FONT size=2 face=Verdana></FONT></DIV>
<DIV><FONT size=2 face=Verdana><STRONG>> </STRONG>
<DIV>You will find difficult to tune when using small files. But what you</DIV>
<DIV>are seeing is really low. Is your average file size 10k? Are these</DIV>
<DIV>text files?</DIV>
<DIV></DIV>
<DIV>1) of all what's your throughput requirements??</DIV>
<DIV></DIV>
<DIV>2) try running "dd" tests with oflag/iflag=direct</DIV>
<DIV></DIV>
<DIV>3) run multiple clients from separate hosts and see if you add a</DIV>
<DIV>client does it linearly increase the performance.</DIV>
<DIV></DIV>
<DIV>4) when using small files increasing number of parallel threads from</DIV>
<DIV>same client will not increase performance. lower the threads and see</DIV>
<DIV>if that helps.</DIV>
<DIV></DIV>
<DIV>Post results.</DIV>
<DIV></DIV>
<DIV></DIV>
<DIV>On Tue, May 17, 2011 at 6:23 PM, nuaa_liuben <nuaa_liuben@sina.com> wrote:</DIV>
<DIV>> Hi,</DIV>
<DIV>></DIV>
<DIV>> I am testing gluster 3.2 for LOSF (lots of small files) scenario recently,</DIV>
<DIV>> with iozne and postmark benchmark tools. And the results show that LOSF</DIV>
<DIV>> performance is really bad, random read/write rate is just only about 2 ~</DIV>
<DIV>> 4MB/s. I tried RAID0, RAID1, RAID10, and it's the same result. And create</DIV>
<DIV>> ops with postmark is 100 ~ 400 per second.</DIV>
<DIV>></DIV>
<DIV>> I deployed 4 bricks servers: Dell R510, 4 1TB SATA disks, 1 GiE NIC, 8GB</DIV>
<DIV>> Mem, and test machine is also R510 with 2 SAS disks and 16GB memory.</DIV>
<DIV>></DIV>
<DIV>> Any good ideas on gluster3.2 tunning for LOSF?</DIV>
<DIV>> Why dbd translator is removed from gluster 3.2?</DIV>
<DIV>> thanks in advance.</DIV>
<DIV>></DIV>
<DIV>></DIV>
<DIV>> BR,</DIV>
<DIV>> liuben</DIV>
<DIV>> _______________________________________________</DIV>
<DIV>> Gluster-users mailing list</DIV>
<DIV>> Gluster-users@gluster.org</DIV>
<DIV>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</DIV>
<DIV>></DIV>
<DIV>></DIV>
<DIV></DIV></FONT></DIV></BODY></HTML>