<div dir="ltr"><div>I use the same Centos and Gluster versions and also see high load averages. I'm not sure I can help but I can relate since I have similar problems.</div><div><br></div>How many virtual machine images do you have on one brick?<div>
<br></div><div>I started out putting several VM images on a single gluster volume and have since started creating a dedicated volume for each VM. My thinking was that each brick gets a single process on each peer and that having separate processes would prevent VMs from having to compete for slices of a single brick process. I have not experienced a noticeable difference between the setups so it is quite possible that my hypothesis was incorrect.</div>
<div><br><div><br></div><div>What is the underlying hardware setup?</div></div><div><br></div><div>I noticed significant VM performance improvements when I reconfigured the LVM LVs that backend my VM images from raid 1 to raid 10. High load average did not go away but VMs behave normally now instead of really slowly.</div>
<div><br></div><div>How many CPU cores do you have? On my system, which is is a pair of ~5 year old supermicro servers with 8 cores and 8 GB of memory I consistently see load averages in the mid-20s. It's higher than I would like but the VMs that use the storage are still running well.</div>
<div><br></div><div>-Mark</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Dec 2, 2013 at 5:30 AM, gandalf istari <span dir="ltr"><<a href="mailto:erestor.elensar@gmail.com" target="_blank">erestor.elensar@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>I'm running version glusterfs 3.4.1 on a Centos 6.4</div><div><br></div><div>now Load average: 3.37 3.41 3.29 </div>
<div><br></div><div><br></div><div> the program that uses the most cpu: </div>
<div>/usr/sbin/glusterfsd but several instances.</div></div><div><br></div><div>The logs are not showing any errors.</div><div><br></div><div><br></div><div>I have never used atop, but this looks like a problem</div><div>
<p style="margin:0px;font-size:13px;font-family:Monaco;color:rgb(195,55,32);background-color:rgb(0,0,0)">LVM<span style="color:rgb(255,255,255)"> | </span>s02-LogVol00<span style="color:rgb(255,255,255)"> | </span>busy 80%<span style="color:rgb(255,255,255)"> | </span>read 0<span style="color:rgb(255,255,255)"> | </span>write 1166</p>
</div><div><br></div><div>gr</div><div><br></div><div><br></div>hi<br>which version of gluster<br>on which OS system version<br>Did you run "top" (or even better "atop") to see which programm uses up how much resources (IO,RAM,CPU)?<br>
anything unusual in the logfiles?<br><br><br>Am 02.12.2013 14:57:32, schrieb gandalf istari:<br><blockquote><div dir="ltr">Hi, I have two glusterfs server in replicated mode.<div>brick one has my virtual machines and brick two server receives only the replicated parts.</div>
<div><br><div>Now for the last 3 day's I get following message from my monitoring system.</div>
<div><pre>WARNING - load average: 6.04, 6.55, 6.07</pre><pre><span style="font-family:arial">And the load sometime goes on for about 16 hours.</span><br></pre><pre><span style="font-family:arial">For me this seems not to be normal, anyone some advice on this ?</span></pre>
<pre><span style="font-family:arial">The load on brick one is not more the 1.8</span></pre><pre><span style="font-family:arial"><br></span></pre><pre><span style="font-family:arial">Thanks</span></pre></div></div></div>
_______________________________________________<br>Gluster-users mailing list<br><a>Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></blockquote><br><br><br><span>-- <br>
<div style>
<table border="0" cellpadding="0" cellspacing="5">
<tbody><tr>
<td colspan="2" style="vertical-align:middle;text-align:center;color:rgb(255,255,255)" valign="center" align="center">
<hr style="min-height:2px;background-color:rgb(111,112,114);color:rgb(111,112,114);border-width:0px">
</td>
</tr>
<tr>
<td style="text-align:center;color:rgb(24,41,131)" align="center">
<img alt="*Ecologic Institute*" height="120" width="129">
</td>
<td style="padding-right:10px;white-space:nowrap" align="left">
<font face="sans-serif" color="black">
<small>
<b>Bernhard Glomm</b><br>
IT Administration<br><br>
</small>
<small><small>
<table border="0" cellpadding="0" cellspacing="0">
<tbody><tr>
<td><small><small>
Phone:
</small></small></td>
<td style="padding-left:5px"><small><small>
<a href="tel:%2B49%20%2830%29%2086880%20134" value="+493086880134" target="_blank">+49 (30) 86880 134</a>
</small></small></td>
</tr>
<tr>
<td><small><small>
Fax:
</small></small></td>
<td style="padding-left:5px"><small><small>
<a href="tel:%2B49%20%2830%29%2086880%20100" value="+493086880100" target="_blank">+49 (30) 86880 100</a>
</small></small></td>
</tr>
<tr>
<td><small><small>
Skype:
</small></small></td>
<td style="padding-left:5px"><small><small>
bernhard.glomm.ecologic
</small></small></td>
</tr>
</tbody></table>
</small></small>
</font>
</td>
</tr>
<tr>
<td colspan="2" style="vertical-align:middle;text-align:center;background-color:rgb(111,112,114);color:rgb(255,255,255);white-space:nowrap" valign="center" align="center">
<a href="http://ecologic.eu" target="_blank"><img title="Visit our website" alt="Website:" height="36" width="36"></a>
<a href="http://www.youtube.com/v/hZtiK04A9Yo" target="_blank"><img title="Watch our video" alt="| Video:" height="36" width="36"></a>
<a href="http://ecologic.eu/newsletter/subscribe" target="_blank"><img title="Subscribe to our newsletter" alt="| Newsletter:" height="36" width="36"></a>
<a href="http://www.facebook.com/Ecologic.Institute" target="_blank"><img title="Visit us on Facebook" alt="| Facebook:" height="36" width="36"></a>
<a href="http://www.linkedin.com/company/ecologic-institute-berlin-germany" target="_blank"><img title="Visit us on Linkedin" alt="| Linkedin:" height="36" width="36"></a>
<a href="http://twitter.com/EcologicBerlin" target="_blank"><img title="Visit us on Twitter" alt="| Twitter:" height="36" width="36"></a>
<a href="http://www.youtube.com/user/EcologicInstitute" target="_blank"><img title="Visit us on YouTube" alt="| YouTube:" height="36" width="36"></a>
<a href="http://plus.google.com/113756356645020994482" target="_blank"><img title="Visit us on Google+" alt="| Google+:" height="36" width="36"></a>
</td>
</tr>
<tr>
<td colspan="2" style="vertical-align:middle;padding-left:5px;padding-right:5px;white-space:nowrap" valign="center" align="left">
<small><small>
Ecologic Institut gemeinnützige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | Germany<br>
GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: DE811963464<br>
Ecologic™ is a Trade Mark (TM) of Ecologic Institut gemeinnützige GmbH
</small></small>
</td>
</tr>
<tr>
<td colspan="2" style="vertical-align:middle;text-align:center;color:rgb(255,255,255)" valign="center" align="center">
<br></td></tr></tbody></table></div></span></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>