<br><br><div class="gmail_quote">On Fri, Feb 15, 2013 at 6:37 AM, Brian Foster <span dir="ltr"><<a href="mailto:bfoster@redhat.com" target="_blank">bfoster@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On 02/01/2013 08:27 AM, Jeff Darcy wrote:<br>
</div><div class="im">> As we all know, directory-listing performance (or lack thereof) is a bit<br>
> of a sore spot for many GlusterFS users, because it's one of the few<br>
> places where FUSE really does make a difference.<br>
<br>
</div>Hey Jeff,<br>
<br>
Just an update on this topic... I slapped some prototype code together<br>
to play around with directory prefetching [1] and ran a few basic tests.<br>
The results could probably still be considered slow, but there is a nice<br>
bump in performance. I'm seeing roughly 50% improvement in single large<br>
directory read tests (numbers at [1]). I think this is mostly from using<br>
larger requests.<br>
<br>
There are still some interesting tests to run (I'd like to try Avati's<br>
updates to support native fuse readdirp, compare results from increasing<br>
the fuse readdirp buffer, and perhaps create a libgfapi driver to factor<br>
the fuse overhead), but wanted throw this out there for reference.<br>
Thoughts and ideas appreciated.<br>
<br>
Brian<br>
<br>
[1] - <a href="http://review.gluster.org/4519" target="_blank">http://review.gluster.org/4519</a><br>
<div class="HOEnZb"><div class="h5"><br></div></div></blockquote><div><br></div><div>I only glanced through the patch without going through in detail. But it certainly looks promising in terms of what it is doing! There is lot of potential and opportunities to increase readdir performance in general as the consistency requirements are much weaker than file I/O, and this is certainly a step in the right direction. I can also see how this translator and native fuse readdirplus can together work better in a complementary manner.</div>
<div><br></div><div>In any case we should "polish" it into a minor feature for the next release as the patch is already so much ready.</div><div><br></div><div>Avati</div><div> </div></div>