<div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br>I need &nbsp;high random read and write iops in use &nbsp; small files&nbsp;, it means high 4k random read and write iops,not big files read and write high speed.<div>I want to find a way use more pc servers ,more &nbsp;harddisks , more &nbsp;nics to improve&nbsp;performance.<div>I think there is many way to choose :<br>raid or no raid？&nbsp;<br>Is more stripe &nbsp;more&nbsp;

performance&nbsp;?</div><div>How to balance data safe and&nbsp;

performance ?&nbsp;</div><div>I test 2 weeks, &nbsp;choose diffenrent servers ,stripe group , raid and no raid ...</div><div>be&nbsp;honest , I have not find a goog way &nbsp;, i get stuck ,can you offer me some suggestions ? tks<br><div>&nbsp;<br><br><br><div></div><div id="divNeteaseMailCard"></div><br><pre><br>在&nbsp;2012-11-09&nbsp;06:58:17，"Brian&nbsp;Foster"&nbsp;&lt;bfoster@redhat.com&gt;&nbsp;写道：

&gt;On&nbsp;11/07/2012&nbsp;09:06&nbsp;PM,&nbsp;肖力&nbsp;wrote:

&gt;&gt;&nbsp;Hi&nbsp;,I&nbsp;have&nbsp;4&nbsp;dell&nbsp;2970&nbsp;server&nbsp;,&nbsp;three&nbsp;server&nbsp;&nbsp;harddisk&nbsp;is&nbsp;146Gx6&nbsp;,one&nbsp;hard&nbsp;disk&nbsp;is&nbsp;72Gx6:

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;I&nbsp;Want&nbsp;to&nbsp;test&nbsp;different&nbsp;stripe&nbsp;iops,&nbsp;and&nbsp;i&nbsp;test&nbsp;result&nbsp;is&nbsp;:

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;----------------------------------------------------------------------

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;no&nbsp;stripe&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;gluster&nbsp;volume&nbsp;create&nbsp;test-volume&nbsp;&nbsp;&nbsp;transport&nbsp;tcp&nbsp;\

&gt;&gt;&nbsp;172.16.20.231:/exp2&nbsp;&nbsp;\

&gt;&gt;&nbsp;172.16.20.232:/exp2&nbsp;\

&gt;&gt;&nbsp;172.16.20.233:/exp2&nbsp;&nbsp;\

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;write&nbsp;&nbsp;288

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;read&nbsp;&nbsp;264

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;----------------------------------------------------------------------

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;2&nbsp;stripe

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;gluster&nbsp;volume&nbsp;create&nbsp;test-volume&nbsp;&nbsp;&nbsp;transport&nbsp;tcp&nbsp;\

&gt;&gt;&nbsp;172.16.20.231:/exp2&nbsp;&nbsp;\

&gt;&gt;&nbsp;172.16.20.232:/exp2&nbsp;\

&gt;&gt;&nbsp;172.16.20.233:/exp2&nbsp;&nbsp;\

&gt;&gt;&nbsp;

&gt;

&gt;This&nbsp;looks&nbsp;the&nbsp;same&nbsp;as&nbsp;the&nbsp;"no&nbsp;stripe"&nbsp;case.&nbsp;Given&nbsp;your&nbsp;numbers&nbsp;differ,

&gt;I&nbsp;presume&nbsp;a&nbsp;copy/paste&nbsp;error?</pre><pre>i check my record ,it is correct , I can test it again if i have time.

&gt;

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;write&nbsp;&nbsp;439

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;read&nbsp;&nbsp;241

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;----------------------------------------------------------------------

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;6&nbsp;stripe

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;gluster&nbsp;volume&nbsp;create&nbsp;test-volume3&nbsp;stripe&nbsp;6&nbsp;transport&nbsp;tcp&nbsp;\

&gt;&gt;&nbsp;172.16.20.231:/exp5&nbsp;172.16.20.231:/exp6&nbsp;\

&gt;&gt;&nbsp;172.16.20.232:/exp5&nbsp;172.16.20.232:/exp6&nbsp;\

&gt;&gt;&nbsp;172.16.20.233:/exp5&nbsp;172.16.20.233:/exp6&nbsp;\

&gt;&gt;&nbsp;

&gt;

&gt;Are&nbsp;you&nbsp;adding&nbsp;bricks&nbsp;on&nbsp;the&nbsp;same&nbsp;spindle(s)&nbsp;here?&nbsp;For&nbsp;example,&nbsp;are

&gt;172.16.20.231:/exp{5,6}&nbsp;on&nbsp;the&nbsp;same&nbsp;set&nbsp;of&nbsp;drives?&nbsp;If&nbsp;so,&nbsp;the&nbsp;extra

&gt;bricks&nbsp;might&nbsp;not&nbsp;be&nbsp;buying&nbsp;you&nbsp;anything.

&gt;</pre><pre>That's not clear , i use default cmd ,i don't know how gulster control it.</pre><pre>

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;write&nbsp;&nbsp;683

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;4k&nbsp;100&nbsp;%&nbsp;random&nbsp;read&nbsp;&nbsp;151

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;----------------------------------------------------------------------

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;My&nbsp;question&nbsp;is&nbsp;why&nbsp;more&nbsp;stripes&nbsp;more&nbsp;write&nbsp;good&nbsp;iops&nbsp;and&nbsp;more&nbsp;poor&nbsp;read&nbsp;iops?

&gt;&gt;&nbsp;

&gt;

&gt;I&nbsp;don't&nbsp;have&nbsp;a&nbsp;specific&nbsp;answer,&nbsp;but&nbsp;I&nbsp;ran&nbsp;a&nbsp;few&nbsp;similar&nbsp;random&nbsp;read

&gt;tests&nbsp;to&nbsp;remind&nbsp;myself&nbsp;of&nbsp;the&nbsp;behavior&nbsp;here.&nbsp;One&nbsp;thing&nbsp;our&nbsp;performance

&gt;guys&nbsp;have&nbsp;pointed&nbsp;out&nbsp;is&nbsp;that&nbsp;you'll&nbsp;want&nbsp;to&nbsp;run&nbsp;multiple&nbsp;threads

&gt;against&nbsp;a&nbsp;gluster&nbsp;native&nbsp;client&nbsp;to&nbsp;maximize&nbsp;iops.&nbsp;Perhaps&nbsp;you're&nbsp;doing

&gt;that,&nbsp;but&nbsp;you&nbsp;haven't&nbsp;provided&nbsp;much&nbsp;detail&nbsp;about&nbsp;the&nbsp;actual&nbsp;test&nbsp;you're

&gt;running.

&gt;

&gt;Along&nbsp;with&nbsp;that,&nbsp;there&nbsp;is&nbsp;a&nbsp;known&nbsp;bottleneck&nbsp;in&nbsp;the&nbsp;client&nbsp;that&nbsp;is

&gt;alleviated&nbsp;by&nbsp;using&nbsp;the&nbsp;'gid-timeout'&nbsp;mount&nbsp;option&nbsp;(i.e.,&nbsp;-o

&gt;gid-timeout=1').</pre><pre>Ok, i test gid-timeout=1  thks<br>

&gt;

&gt;Brian

&gt;

&gt;&gt;&nbsp;thks

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;xiao&nbsp;li

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;

&gt;&gt;&nbsp;_______________________________________________

&gt;&gt;&nbsp;Gluster-users&nbsp;mailing&nbsp;list

&gt;&gt;&nbsp;Gluster-users@gluster.org

&gt;&gt;&nbsp;http://supercolony.gluster.org/mailman/listinfo/gluster-users

&gt;&gt;&nbsp;

&gt;

</pre></div></div></div></div><br><br><span title="neteasefooter"><span id="netease_mail_footer"></span></span>