Justice,<br><br> can you try variable block sizes?, just in case we will be able to see the issue in a <br>broader sense.<br><br>Regards<br>--<br clear="all">Harshavardhana<br>Z Research Inc <a href="http://www.zresearch.com/">http://www.zresearch.com/</a><br>
<br><br><div class="gmail_quote">On Fri, Jul 10, 2009 at 8:39 PM, Justice London <span dir="ltr"><<a href="mailto:jlondon@lawinfo.com">jlondon@lawinfo.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div link="blue" vlink="blue" lang="EN-US">
<div>
<p><font color="navy" face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial; color: navy;">It is fuse 2.8.0-pre3 that I tried with
the patch you mentioned. When I tested I used 1M block sizes for a count of 100
and got 1.4MB/s when that was done over NFS. That was using both standard NFS
with direct-io disabled and unfs3 with direct-io enabled. </span></font></p>
<p><font color="navy" face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial; color: navy;"> </span></font></p>
<p><font color="navy" face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial; color: navy;">The same test of 1M blocks for a count of
100 made for 45MB/s on the same filesystem, but the local gluster mount instead
of over NFS. When using NFS to one of the same machines as well, but local-disk
mount I get around 50MB/s.</span></font></p><div class="im">
<p><font color="navy" face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial; color: navy;"> </span></font></p>
<div>
<p><font color="navy" face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial; color: navy;">Justice London<br>
E-mail: <a href="mailto:jlondon@lawinfo.com" target="_blank">jlondon@lawinfo.com</a><br>
<br>
</span></font></p>
</div>
</div><div>
<div style="text-align: center;" align="center"><font face="Times New Roman" size="3"><span style="font-size: 12pt;">
<hr align="center" size="2" width="100%">
</span></font></div>
<p><b><font face="Tahoma" size="2"><span style="font-size: 10pt; font-family: Tahoma; font-weight: bold;">From:</span></font></b><font face="Tahoma" size="2"><span style="font-size: 10pt; font-family: Tahoma;">
<a href="mailto:harshavardhanacool@gmail.com" target="_blank">harshavardhanacool@gmail.com</a> [mailto:<a href="mailto:harshavardhanacool@gmail.com" target="_blank">harshavardhanacool@gmail.com</a>] <b><span style="font-weight: bold;">On Behalf Of </span></b>Harshavardhana<br>
<b><span style="font-weight: bold;">Sent:</span></b> Thursday, July 09, 2009 9:22
PM<br>
<b><span style="font-weight: bold;">To:</span></b> Justice London<br>
<b><span style="font-weight: bold;">Cc:</span></b> Anand Avati; gluster-users<div><div></div><div class="h5"><br>
<b><span style="font-weight: bold;">Subject:</span></b> Re: [Gluster-users]
Gluster (2.0.1 -> git) with fuse 2.8 crashes NFS</div></div></span></font></p>
</div><div><div></div><div class="h5">
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;"> </span></font></p>
<p style="margin-bottom: 12pt;"><font face="Times New Roman" size="3"><span style="font-size: 12pt;">Justice,<br>
<br>
which is the libfuse version being used with
glusterfs?. Just wanted to know what are the metrics you observed while
testing?, block size in which writes/read were measured during testing?.
etc, <br>
<br>
Regards<br>
--<br>
Harshavardhana<br>
Z Research Inc <a href="http://www.zresearch.com/" target="_blank">http://www.zresearch.com/</a><br>
<br>
</span></font></p>
<div>
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;">On Thu, Jul 9, 2009 at 11:45 PM, Justice London <<a href="mailto:jlondon@lawinfo.com" target="_blank">jlondon@lawinfo.com</a>> wrote:</span></font></p>
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;">Well, mostly it seems to be on the throughput. I haven't really
measured for<br>
metadata improvements yet.<br>
<br>
Of note, is that NFS is now working, but it appears to be EXTREMELY slow. I<br>
was only able to manage about 1-2MB/s<br>
<font color="#888888"><span style="color: rgb(136, 136, 136);"><br>
Justice London<br>
E-mail: <a href="mailto:jlondon@lawinfo.com" target="_blank">jlondon@lawinfo.com</a></span></font></span></font></p>
<div>
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;"><br>
-----Original Message-----<br>
From: <a href="mailto:anand.avati@gmail.com" target="_blank">anand.avati@gmail.com</a> [mailto:<a href="mailto:anand.avati@gmail.com" target="_blank">anand.avati@gmail.com</a>] On Behalf Of<br>
Anand Avati</span></font></p>
</div>
<div>
<p style="margin-bottom: 12pt;"><font face="Times New Roman" size="3"><span style="font-size: 12pt;">Sent: Tuesday, July 07,
2009 4:02 PM<br>
To: Justice London<br>
Cc: gluster-users; Harshavardhana<br>
Subject: Re: [Gluster-users] Gluster (2.0.1 -> git) with fuse 2.8 crashes<br>
NFS</span></font></p>
</div>
<div>
<div>
<p style="margin-bottom: 12pt;"><font face="Times New Roman" size="3"><span style="font-size: 12pt;">> The 2.0.3 release of
gluster appears so far to have fixed the crash issue<br>
I<br>
> was experiencing. What was the specific patch that fixed for it I was<br>
> wondering?<br>
<br>
It was <a href="http://patches.gluster.com/patch/664/" target="_blank">http://patches.gluster.com/patch/664/</a>.
A less ugly fix is lined<br>
up for 2.1<br>
<br>
<br>
> Great job either way! It appears that with fuse 2.8 and newer kernels that<br>
> gluster absolutely flies. With a replication environment between two<br>
crummy<br>
> testbed machines it's probably about twice as fast as 2.7.4 based fuse!<br>
<br>
Just curious, are the observed performance improvements in terms of IO<br>
throughput or metadata latency?<br>
<br>
Avati</span></font></p>
</div>
</div>
<div>
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;">Checked by AVG - <a href="http://www.avg.com" target="_blank">www.avg.com</a></span></font></p>
</div>
<div>
<div>
<p style="margin-bottom: 12pt;"><font face="Times New Roman" size="3"><span style="font-size: 12pt;">Version: 8.5.375 / Virus
Database: 270.13.8/2224 - Release Date: 07/08/09<br>
05:53:00<br>
<br>
</span></font></p>
</div>
</div>
</div>
<p><font face="Times New Roman" size="3"><span style="font-size: 12pt;"> </span></font></p>
</div></div><p><font face="Arial" size="2"><span style="font-size: 10pt; font-family: Arial;"><div><div></div><div class="h5">Checked
by AVG - <a href="http://www.avg.com" target="_blank">www.avg.com</a><br></div></div>
Version: 8.5.375 / Virus Database: 270.13.8/2227 - Release Date: 07/09/09
05:55:00</span></font></p>
</div>
</div>
</blockquote></div><br>