<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>Hi Hans !<br><br>Do you think that an hexadecimal way could do fine ?<br><br>a/b/c/d/e/f/0/1/2...<br><br>That way : 16 subfolders per directory.<br><br>Will that be fine (performance wise) ?<br><br>Many thanks !<br><br>Regards,<br><br>Alain <br><div><div id="SkyDrivePlaceholder"></div>> Date: Wed, 8 May 2013 10:10:21 +0200<br>> From: hans@shapeways.com<br>> To: deco33@hotmail.fr<br>> CC: gluster-users@gluster.org<br>> Subject: Re: [Gluster-users] How many subfolders in parent folders ?<br>> <br>> Hi Alain,<br>> <br>> alain meunier wrote on 20130507:<br>> > I will have a lot (many hundreds of millions) of subdirectories inside a directory, named with md5 hashes.<br>> > I thought of a subdividivision abcd/efgh/... or maybe a/b/c/...<br>> > But it will create a bunch of subfolders.<br>> > Will gluster handler those files without problems ?<br>> <br>> Yes, but slow. Very slow IMO :-/ To give you an idea : a recursive walk<br>> through my Distributed-Replicate 14 x 2 filesystem (2M directories, max<br>> 100 per subdirectory) takes several days.<br>> <br>> > One last thing : hardlinks will be involved to point the files and often deleted.<br>> > Does someone has any experience of the troubleshooting I will have to face ?<br>> <br>> Should be fine. Try to avoid filename renames as that causes a DHT miss<br>> penalty.<br>> <br>> My advice : first build a test setup.<br>> <br>> -- Hans<br>> -- <br>> Hans Lambermont | Senior Architect<br>> (t) +31407370104 (w) www.shapeways.com<br></div>                                            </div></body>
</html>