<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi Erik,<br>
Could you just turn the DRC off and retry your test case?<br>
<br>
1. Turn the DRC off:<br>
gluster volume set <volume name> nfs.drc off<br>
<br>
2. Restart all the gluster processes<br>
a. killall glusterd glusterfs glusterfsd<br>
b. glusterd<br>
<br>
2.b should bring back all the gluster proc's.<br>
<br>
3. Retry your large copy test.<br>
<br>
Thanks,<br>
Santosh<br>
<br>
<br>
<div class="moz-cite-prefix">On 06/13/2014 05:16 PM, Aronesty, Erik
wrote:<br>
</div>
<blockquote
cite="mid:0E99B9B12F6C224BA3CCD2E5697F64C304424C05@EA-EXCHANGE3.ExpressionAnalysis.local"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<meta name="Generator" content="Microsoft Word 12 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Georgia;
panose-1:2 4 5 2 5 4 5 2 3 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
color:black;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">glusterfs 3.5.0
built on Apr 24 2014 01:38:34<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
Pranith Kumar Karampuri [<a class="moz-txt-link-freetext" href="mailto:pkarampu@redhat.com">mailto:pkarampu@redhat.com</a>]
<br>
<b>Sent:</b> Friday, June 13, 2014 1:21 AM<br>
<b>To:</b> Aronesty, Erik; <a class="moz-txt-link-abbreviated" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br>
<b>Subject:</b> Re: [Gluster-users] performance due to
network?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Erik,<br>
What version of glusterfs are you using?<br>
<br>
Pranith<o:p></o:p></p>
<div>
<p class="MsoNormal">On 06/13/2014 02:09 AM, Aronesty, Erik
wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">I suspect I'm having performance issues
because of network speeds.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><i>Supposedly</i> I have 10gbit
connections on all my NAS devices, however, it seems to me
that the fastest I can write is 1Gbit. When I'm copying
very large files, etc, I see 'D' as the cp waits to I/O, but
when I go the gluster servers, I don't see glusterfsd
waiting (D) to write to the bricks themselves. I have 4
nodes, each with 10Gbit connection, each has 2 Areca RAID
controllers with 12 disk raid5, and the 2 controllers
stripped into 1 large volume. Pretty sure there's plenty
of i/o left on the bricks themselves.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Is it possible that "one big file" isn't
the right test… should I try 20 big files, and see how
saturated my network can get?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span
style="font-size:8.0pt;font-family:"Arial","sans-serif"">Erik
Aronesty
<br>
Senior Bioinformatics Architect</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span
style="font-size:10.0pt;font-family:"Georgia","serif";color:#5F6062">EA
| Quintiles<br>
</span></b><b><i><span
style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#D31145">Genomic
Services</span></i></b><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:8.0pt;font-family:"Arial","sans-serif"">4820
Emperor Boulevard</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:8.0pt;font-family:"Arial","sans-serif"">Durham,
NC 27703 USA</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span
style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><span
style="font-size:8.0pt;font-family:"Arial","sans-serif"">Office:
+ 919.287.4011<br>
</span><a moz-do-not-send="true"
href="mailto:kmichailo@expressionanalysis.com"><span
style="font-size:8.0pt">erik.aronesty@quintiles.com</span></a><span
style="font-size:8.0pt;color:#1B4579"><br>
</span><span
style="font-size:5.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><a moz-do-not-send="true"
href="http://www.quintiles.com/"><span
style="font-size:8.0pt">www.quintiles.com</span></a><span
style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#1B4579">
</span><span
style="font-size:5.0pt;font-family:"Arial","sans-serif";color:#1B4579"><br>
</span><a moz-do-not-send="true"
href="http://www.expressionanalysis.com/"><span
style="font-size:8.0pt">www.expressionanalysis.com</span></a><span
style="font-size:8.0pt;color:#1B4579"><br>
</span><a moz-do-not-send="true"
href="https://www.twitter.com/simulx"><span
style="color:windowtext;text-decoration:none"><img
id="Picture_x0020_1"
src="cid:part4.05090906.07020400@redhat.com"
alt="cid:image001.jpg@01CDEF4B.84C3E9F0" height="16"
border="0" width="16"></span></a><span
style="color:#1C467A"> </span><a moz-do-not-send="true"
href="http://www.facebook.com/aronesty"><span
style="color:windowtext;text-decoration:none"><img
id="Picture_x0020_2"
src="cid:part6.00090405.05090107@redhat.com"
alt="cid:image002.jpg@01CDEF4B.84C3E9F0" height="16"
border="0" width="16"></span></a><span
style="color:#1C467A"> </span><a moz-do-not-send="true"
href="http://www.linkedin.com/in/earonesty"><span
style="color:windowtext;text-decoration:none"><img
id="Picture_x0020_3"
src="cid:part8.01060707.04050309@redhat.com"
alt="cid:image003.jpg@01CDEF4B.84C3E9F0" height="16"
border="0" width="16"></span></a><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:12.0pt;font-family:"Times New
Roman","serif""><br>
<br>
<br>
<o:p></o:p></span></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Gluster-users mailing list<o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><o:p></o:p></pre>
<pre><a moz-do-not-send="true" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><span
style="font-size:12.0pt;font-family:"Times New
Roman","serif""><o:p> </o:p></span></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>