<html><body><div style="font-family: garamond,new york,times,serif; font-size: 12pt; color: #000000"><div><br></div><div><br></div><hr id="zwchr"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Kyle Harris" <kyle.harris98@gmail.com><br><b>To: </b>gluster-users@gluster.org<br><b>Sent: </b>Thursday, December 18, 2014 4:47:35 AM<br><b>Subject: </b>[Gluster-users] glusterfs and glusterfsd process utilization extremely high<br><div><br></div><div dir="ltr"><div>This is an extenuation of a problem that I posted about last month that I am still experiencing. The original post with more detail can be found at <a href="http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019587.html" target="_blank" data-mce-href="http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019587.html">http://supercolony.gluster.org/pipermail/gluster-users/2014-November/019587.html</a>. To sum up my problem, I have a freshly created 3 node replicated cluster. It contains roughly 135 GB of files, many of which are small. It is home to several web sites hosted with Apache. I am using Gluster version 3.6.1-1 installed from RPMs mounted from the server via the Fuse client (I have tried NFS but it makes no difference).</div><div><br></div><div>When I posted last about the problem of extreme processor utilization, the solution I was given by Parnith was to utilize another file system other than EXT4 and to turn off cluster.entry-self-heal. I am now using XFS and cluster.entry-self-heal is turned off and I even turned off cluster.self-heal-daemon but it made absolutely no difference. All is fine during the entire time the cluster is loaded via rsync however the minute I point Apache traffic at the sites hosted on the cluster, glusterfs and glusterfsd begin to climb to levels so high that in a matter of minutes it is not even possible to log on to the system. No modification have been made to any of the other Gluster settings.</div><div><br></div><div>Any additional help resolving this matter would be greatly appreciated.</div></div></blockquote><div>Hello,</div><div><br></div><div>First of all, do the logs suggest anything useful?</div><div><br></div><div>Could you perform the following steps while the I/O is going on (this is assuming the nodes are not thrashed to the extent that it is impossible to execute these commands):</div><div><br></div><div>1) On the shell, on one of the nodes in the cluster, execute `gluster volume profile <volname> start`</div><div> Wait for a minute or two. And then execute `gluster volume profile <volname> info` and collect its output.</div><div> Wait for another minute or so. And execute `gluster volume profile <volname> info` and collect its output too, and share them?</div><div> You can stop the profiling once you are done using `gluster volume profile <volname> stop`.</div><div>2) Assuming it is the brick processes (glusterfsd) that are showing high CPU utilisation, is it possible to get the core of the processes when this is happening?</div><div><br></div><div>-Krutika</div><div><br></div><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><div dir="ltr">-- <div>Regards,</div><div><br><div class="gmail_signature"><div dir="ltr">Kyle <div><div><br></div></div></div></div></div></div><br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://supercolony.gluster.org/mailman/listinfo/gluster-users</blockquote><div><br></div></div></body></html>