<div dir="ltr"><div><div>>> To Liam:</div><div><br></div><div>>I had about 100 million files in Gluster and it was unbelievably painfully slow. We had to ditch it for other technology.</div><div><br></div><div>Has slow down occurred on writing file?, listing files, or both?<br>
</div><div><br></div><div>In our application, path of the data is managed in database.</div><div>"ls" is slow, but not influence to my application, but writing file slow down is critical.</div><div><br></div><div>
>> To All:</div>
<div><br></div><div>I uploaded a statistics when writing test(32kbyte x 10 million, 6 bricks).</div><div><br></div><div> <a href="http://gss.iijgio.com/gluster/gfs-profile_d03r2.txt" target="_blank">http://gss.iijgio.com/gluster/gfs-profile_d03r2.txt</a><br>
</div><div><br></div><div>Line 15, average-latency value is about 30 ms.</div><div>I cannot judge this value is a normal(ordinary?) performance or not.</div><div><br></div><div>Is it slow?</div><div><br></div><div>Thanks,</div>
<div>--Michika Terada</div>
</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-04-15 16:05 GMT+09:00 Franco Broi <span dir="ltr"><<a href="mailto:franco.broi@iongeo.com" target="_blank">franco.broi@iongeo.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
My bug report is here<br>
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1067256" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1067256</a><br>
<div><div class="h5"><br>
On Mon, 2014-04-14 at 23:51 -0700, Joe Julian wrote:<br>
> If you experience pain using any filesystem, you should see your<br>
> doctor.<br>
><br>
> If you're not actually experiencing pain, perhaps you should avoid<br>
> hyperbole and instead talk about what version you tried, what your<br>
> tests were, how you tried to fix it, and what the results were.<br>
><br>
> If you're using a current version with a kernel that has readdirplus<br>
> support for fuse it shouldn't be that bad. If it is, file a bug report<br>
> - especially if you have the skills to help diagnose the problem.<br>
><br>
> On April 14, 2014 11:30:26 PM PDT, Liam Slusser <<a href="mailto:lslusser@gmail.com">lslusser@gmail.com</a>><br>
> wrote:<br>
><br>
> I had about 100 million files in Gluster and it was<br>
> unbelievably painfully slow. We had to ditch it for other<br>
> technology.<br>
><br>
><br>
> On Mon, Apr 14, 2014 at 11:24 PM, Franco Broi<br>
> <<a href="mailto:franco.broi@iongeo.com">franco.broi@iongeo.com</a>> wrote:<br>
><br>
> I seriously doubt this is the right filesystem for<br>
> you, we have problems<br>
> listing directories with a few hundred files, never<br>
> mind millions.<br>
><br>
> On Tue, 2014-04-15 at 10:45 +0900, Terada Michitaka<br>
> wrote:<br>
> > Dear All,<br>
> ><br>
> ><br>
> ><br>
> > I have a problem with slow writing when there are 10<br>
> million files.<br>
> > (Top level directories are 2,500.)<br>
> ><br>
> ><br>
> > I configured GlusterFS distributed cluster(3 nodes).<br>
> > Each node's spec is below.<br>
> ><br>
> ><br>
> > CPU: Xeon E5-2620 (2.00GHz 6 Core)<br>
> > HDD: SATA 7200rpm 4TB*12 (RAID 6)<br>
> > NW: 10GBEth<br>
> > GlusterFS : glusterfs 3.4.2 built on Jan 3 2014<br>
> 12:38:06<br>
> ><br>
> > This cluster(volume) is mounted on CentOS via FUSE<br>
> client.<br>
> > This volume is storage of our application and I want<br>
> to store 3<br>
> > hundred million to 5 billion files.<br>
> ><br>
> ><br>
> > I performed a writing test, writing 32KByte file ×<br>
> 10 million to this<br>
> > volume, and encountered a problem.<br>
> ><br>
> ><br>
> > (1) Writing is so slow and slow down as number of<br>
> files increases.<br>
> > In non clustering situation(one node), this node's<br>
> writing speed is<br>
> > 40 MByte/sec at random,<br>
> > But writing speed is 3.6MByte/sec on that cluster.<br>
> > (2) ls command is very slow.<br>
> > About 20 second. Directory creation takes about 10<br>
> seconds at<br>
> > lowest.<br>
> ><br>
> ><br>
> > Question:<br>
> ><br>
> > 1)5 Billion files are possible to store in<br>
> GlusterFS?<br>
> > Has someone succeeded to store billion files to<br>
> GlusterFS?<br>
> ><br>
> > 2) Could you give me a link for a tuning guide or<br>
> some information of<br>
> > tuning?<br>
> ><br>
> > Thanks.<br>
> ><br>
> ><br>
> > -- Michitaka Terada<br>
><br>
> > _______________________________________________<br>
> > Gluster-users mailing list<br>
> > <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> ><br>
> <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
><br>
><br>
> _______________________________________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
><br>
><br>
><br>
><br>
</div></div>> ______________________________________________________________<br>
<div class="HOEnZb"><div class="h5">><br>
><br>
><br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
><br>
<br>
<br>
</div></div></blockquote></div><br></div>