<div dir="ltr">the workload : copying 21,000 1KB files.... small files, into gluster. <div>The CPU is spiked the whole time and it takes a long time to do the copying. </div><div><br></div><div>There are some other moving parts, but Im pretty sure gluster shouldnt spike so high for just 21 MB of data, right?</div>
<div><br></div><div>there might be an error in my numbers above, so dont lose sleep - i still am trying to reproduce this "bug"... if thats what it is.<br><div class="gmail_extra"><br><br><div class="gmail_quote">
On Tue, Jan 28, 2014 at 7:11 PM, Paul Robert Marino <span dir="ltr"><<a href="mailto:prmarino1@gmail.com" target="_blank">prmarino1@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Well what do you mean by %100 CPU do you mean just 1 core or multiple also what's your IO wait percentage on your gluster servers.<br><br>Its not uncommon for gluster to spike up to use more than a whole core.<br><br>
You may simply be exhausting the effective write cache on the gluster servers in which case unless you are striping your data across many raids you may just be hitting the limits of your hardware.<br><br>You may also have client(s) that are asymetricly connecting to only one or a small subset of servers due to a connectivity issue which would cause that one node or group of nodes to bear the brunt of replicating the entire workload via constant self heal.<br>
<br>To help you I would rather know more about your configuration before giving advice.<br><br><br><span style="font-family:Prelude,Verdana,san-serif"><br><br></span><span><div style="font-family:arial,sans-serif;font-size:12px;color:#999999">
-- Sent from my HP Pre3</div><br></span><span style="color:navy;font-family:Prelude,Verdana,san-serif"><hr align="left" style="width:75%"><div><div class="h5">On Jan 28, 2014 14:08, Harshavardhana <<a href="mailto:harsha@harshavardhana.net" target="_blank">harsha@harshavardhana.net</a>> wrote: <br>
<br></div></div></span><div class="HOEnZb"><div class="h5">You should take a 'gluster' statedump of the process - and open a
<br>bugzilla for analysis with logs.
<br>
<br>On Tue, Jan 28, 2014 at 10:30 AM, Jay Vyas <<a href="mailto:jayunit100@gmail.com" target="_blank">jayunit100@gmail.com</a>> wrote:
<br>> Hi folks :
<br>>
<br>> Im running mahout on top of gluster using the GlusterFileSystem hadoop
<br>> plugin.
<br>>
<br>> It works well, but Im noticing that glusterfsd is at 100% CPU, and a copy
<br>> action seems to be stalling after a long workload.
<br>>
<br>> Any ways to rescue the system? or should i restart it ?
<br>>
<br>> --
<br>> Jay Vyas
<br>> <a href="http://jayunit100.blogspot.com" target="_blank">http://jayunit100.blogspot.com</a>
<br>>
<br>> _______________________________________________
<br>> Gluster-users mailing list
<br>> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<br>> <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a>
<br>
<br>
<br>
<br>--
<br>Religious confuse piety with mere ritual, the virtuous confuse
<br>regulation with outcomes
<br>_______________________________________________
<br>Gluster-users mailing list
<br><a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<br><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a>
<br></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Jay Vyas<br><a href="http://jayunit100.blogspot.com" target="_blank">http://jayunit100.blogspot.com</a>
</div></div></div>