<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Georgia;
panose-1:2 4 5 2 5 4 5 2 3 3;}
@font-face
{font-family:"Times New Roman \, serif";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">I have not tried to use NFS.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"> Santosh Pradhan [mailto:spradhan@redhat.com]
<br>
<b>Sent:</b> Friday, June 13, 2014 9:22 AM<br>
<b>To:</b> Aronesty, Erik; Pranith Kumar Karampuri; gluster-users@gluster.org<br>
<b>Subject:</b> Re: [Gluster-users] performance due to network?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Erik,<br>
Could you just turn the DRC off and retry your test case?<br>
<br>
1. Turn the DRC off:<br>
gluster volume set <volume name> nfs.drc off<br>
<br>
2. Restart all the gluster processes<br>
a. killall glusterd glusterfs glusterfsd<br>
b. glusterd<br>
<br>
2.b should bring back all the gluster proc's.<br>
<br>
3. Retry your large copy test.<br>
<br>
Thanks,<br>
Santosh<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 06/13/2014 05:16 PM, Aronesty, Erik wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span style="color:#1F497D">glusterfs 3.5.0 built on Apr 24 2014 01:38:34</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"> Pranith Kumar Karampuri [<a href="mailto:pkarampu@redhat.com">mailto:pkarampu@redhat.com</a>]
<br>
<b>Sent:</b> Friday, June 13, 2014 1:21 AM<br>
<b>To:</b> Aronesty, Erik; <a href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br>
<b>Subject:</b> Re: [Gluster-users] performance due to network?</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Erik,<br>
What version of glusterfs are you using?<br>
<br>
Pranith<o:p></o:p></p>
<div>
<p class="MsoNormal">On 06/13/2014 02:09 AM, Aronesty, Erik wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">I suspect I'm having performance issues because of network speeds.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><i>Supposedly</i> I have 10gbit connections on all my NAS devices, however, it seems to me that the fastest I can write is 1Gbit. When I'm copying very large files, etc, I see 'D' as the cp waits to I/O, but when I go the gluster servers,
I don't see glusterfsd waiting (D) to write to the bricks themselves. I have 4 nodes, each with 10Gbit connection, each has 2 Areca RAID controllers with 12 disk raid5, and the 2 controllers stripped into 1 large volume. Pretty sure there's plenty of i/o
left on the bricks themselves.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Is it possible that "one big file" isn't the right test… should I try 20 big files, and see how saturated my network can get?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:8.0pt;font-family:"Arial","sans-serif"">Erik Aronesty
<br>
Senior Bioinformatics Architect</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:10.0pt;font-family:"Georgia","serif";color:#5F6062">EA | Quintiles<br>
</span></b><b><i><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#D31145">Genomic Services</span></i></b><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Arial","sans-serif"">4820 Emperor Boulevard</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Arial","sans-serif"">Durham, NC 27703 USA</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><span style="font-size:8.0pt;font-family:"Arial","sans-serif"">Office: + 919.287.4011<br>
</span><a href="mailto:kmichailo@expressionanalysis.com"><span style="font-size:8.0pt">erik.aronesty@quintiles.com</span></a><span style="font-size:8.0pt;color:#1B4579"><br>
</span><span style="font-size:5.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><a href="http://www.quintiles.com/"><span style="font-size:8.0pt">www.quintiles.com</span></a><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#1B4579"> </span><span style="font-size:5.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><a href="http://www.expressionanalysis.com/"><span style="font-size:8.0pt">www.expressionanalysis.com</span></a><span style="font-size:8.0pt;color:#1B4579"><br>
</span><a href="https://www.twitter.com/simulx"><span style="color:windowtext;text-decoration:none"><img border="0" width="16" height="16" id="Picture_x0020_1" src="cid:image001.jpg@01CF86E8.F5AA0A10" alt="cid:image001.jpg@01CDEF4B.84C3E9F0"></span></a><span style="color:#1C467A"> </span><a href="http://www.facebook.com/aronesty"><span style="color:windowtext;text-decoration:none"><img border="0" width="16" height="16" id="Picture_x0020_2" src="cid:image002.jpg@01CF86E8.F5AA0A10" alt="cid:image002.jpg@01CDEF4B.84C3E9F0"></span></a><span style="color:#1C467A"> </span><a href="http://www.linkedin.com/in/earonesty"><span style="color:windowtext;text-decoration:none"><img border="0" width="16" height="16" id="Picture_x0020_3" src="cid:image003.jpg@01CF86E8.F5AA0A10" alt="cid:image003.jpg@01CDEF4B.84C3E9F0"></span></a><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman , serif","serif""><br>
<br>
<br>
<br>
</span><o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Gluster-users mailing list<o:p></o:p></pre>
<pre><a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><o:p></o:p></pre>
<pre><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman , serif","serif""> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif""><br>
<br>
<br>
<o:p></o:p></span></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Gluster-users mailing list<o:p></o:p></pre>
<pre><a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><o:p></o:p></pre>
<pre><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman","serif""><o:p> </o:p></span></p>
</div>
</body>
</html>