<div dir="ltr">Hi Bryan,<div><br></div><div style>We have 1G nics on all our servers.</div><div style>Do you think that changing our design to distribute-replicate will improve the performance?</div><div style><br></div><div style>
Anything in the gluster performance settings that you think I should change?</div><div style><br></div><div style>thanks!</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Apr 9, 2013 at 6:00 AM, Bryan Whitehead <span dir="ltr">&lt;<a href="mailto:driver@megahappy.net" target="_blank">driver@megahappy.net</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">This looks like you are replicating every file to all bricks?<br>
<br>
What is tcp running on? 1G nics? 10G? IPoIB (40-80G)?<br>
<br>
I think you want to have Distribute-Replicate. So 4 bricks with replica = 2.<br>
<br>
Unless you are running at least 10G nics you are going to have serious<br>
IO issues in your KVM/qcow2 VM&#39;s.<br>
<div><div class="h5"><br>
On Mon, Apr 8, 2013 at 7:11 AM, Eyal Marantenboim<br>
&lt;<a href="mailto:eyal@theserverteam.com">eyal@theserverteam.com</a>&gt; wrote:<br>
&gt; Hi,<br>
&gt;<br>
&gt;<br>
&gt; We have a set of 4 gluster nodes, all in replicated (design?)<br>
&gt;<br>
&gt; We use it to store our qcow2 images for kvm. These images have a variable<br>
&gt; IO, though most of them are for reading only.<br>
&gt;<br>
&gt;<br>
&gt; I tried to find some documentation re. performance optimization, but it&#39;s<br>
&gt; either unclear to me, or I couldn&#39;t find much.. so I&#39;d copied from the<br>
&gt; internet and tried to adjust the config to our needs, but I&#39;m sure it&#39;s not<br>
&gt; optimized.<br>
&gt;<br>
&gt;<br>
&gt; We&#39;re using 3.3.1 on top of XFS.<br>
&gt;<br>
&gt; The qcow images are about 30GB (a couple of 100GB).<br>
&gt;<br>
&gt;<br>
&gt; Can someone please tell what would be the best paramenter for performance to<br>
&gt; look at?<br>
&gt;<br>
&gt;<br>
&gt; here is volume info:<br>
&gt;<br>
&gt;<br>
&gt; Volume Name: images<br>
&gt;<br>
&gt; Type: Replicate<br>
&gt;<br>
&gt; Volume ID:<br>
&gt;<br>
&gt; Status: Started<br>
&gt;<br>
&gt; Number of Bricks: 1 x 4 = 4<br>
&gt;<br>
&gt; Transport-type: tcp<br>
&gt;<br>
&gt; Bricks:<br>
&gt;<br>
&gt; Brick1: vmhost2:/exports/1<br>
&gt;<br>
&gt; Brick2: vmhost3:/exports/1<br>
&gt;<br>
&gt; Brick3: vmhost5:/exports/1<br>
&gt;<br>
&gt; Brick4: vmhost6:/exports/1<br>
&gt;<br>
&gt; Options Reconfigured:<br>
&gt;<br>
&gt; performance.cache-max-file-size: 1GB<br>
&gt;<br>
&gt; nfs.disable: on<br>
&gt;<br>
&gt; performance.cache-size: 4GB<br>
&gt;<br>
&gt; performance.cache-refresh-timeout: 1<br>
&gt;<br>
&gt; performance.write-behind-window-size: 2MB<br>
&gt;<br>
&gt; performance.read-ahead: on<br>
&gt;<br>
&gt; performance.write-behind: on<br>
&gt;<br>
&gt; performance.io-cache: on<br>
&gt;<br>
&gt; performance.stat-prefetch: on<br>
&gt;<br>
&gt; performance.quick-read: on<br>
&gt;<br>
&gt; performance.io-thread-count: 64<br>
&gt;<br>
&gt; performance.flush-behind: on<br>
&gt;<br>
&gt; features.quota-timeout: 1800<br>
&gt;<br>
&gt; features.quota: off<br>
&gt;<br>
&gt;<br>
&gt; Thanks in advanced.<br>
&gt;<br>
&gt;<br>
</div></div>&gt; _______________________________________________<br>
&gt; Gluster-users mailing list<br>
&gt; <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
&gt; <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br></div>