<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">some years ago I had a similar tasks.<div>I did:</div><div>- We had disk arrays with 24 slots, with optional 4 JBODS (each 24 slots) stacked on top, dual LWL controller 4GB (costs ;-) </div><div>- creating raids (6) with not more than 7 disks each</div><div>- as far as I remember I had one hot spare per each 4 raids</div><div>- connecting as many of this raid bricks together with striped glusterfs as needed</div><div>- as for replication, I was planing for an offside duplicate of this architecture and</div><div>because losing data was REALLY not an option, writing it all off at a second offside location onto LTFS tapes.</div><div>As the original version for the LTFS library edition was far to expensive for us </div><div>I found an alternative solution that does the same thing</div><div>but fort a much reasonable prize. LTFS is still a big thing in digital Archiving.</div><div>Give me a note if you like more details on that.</div><div><br></div><div>- This way I could fsck all (not to big) raids in parallel (sped things up)</div><div>- proper robustness against disk failure</div><div>- space that could grow infinite in size (add more and bigger disks) and keep up with access speed (ad more server) at a pretty foreseeable prize</div><div>- LTFS in the vault provided just the finishing having data accessible even if two out three sides are down, </div><div>reasonable prize, (for instance no heat problem at the tape location)</div><div>Nowadays I would go for the same approach except zfs raidz3 bricks (at least do a thorough test on it) </div><div>instead of (small) hardware raid bricks. </div><div>As for simplicity and robustness I wouldn't like to end up with several hundred glusterfs bricks, each on one individual disk,</div><div>but rather leaving disk failure prevention either to hardware raid or zfs and using gluster to connect this bricks into the</div><div>fs size I need( - and for mirroring the whole thing to a second side if needed)</div><div>hth</div><div>Bernhard</div><div><br></div><div><br></div><div><br></div><div><div apple-content-edited="true"><div style="background-color:#FFFFFF; color:#000000;"><table border="0" cellpadding="0" cellspacing="5" style="position: static; z-index: auto; "><tbody>
<tr>
<td align="center" style="text-align:center; background-color:#FFFFFF; color:#182983;">
<img alt="*Ecologic Institute*" src="data:image/png;base64,/9j/4AAQSkZJRgABAQEBKwErAAD/2wBDAAEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEB
AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQH/2wBDAQEBAQEBAQEBAQEBAQEBAQEBAQEB
AQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQEBAQH/wAARCAB4AIEDASIA
AhEBAxEB/8QAHwAAAQMFAQEBAAAAAAAAAAAAAAUJCgQGBwgLAwEC/8QAVhAAAAUDAQIFCBUJBwUB
AAAAAQIDBAUABgcICRESFCExUQoTFTVBcXSRFxgaMzlTVFVYYXKTlJixs7jR0tbhFkJzeJensrfX
IjJSgaHB8DpHSFZjd//EABwBAQABBQEBAAAAAAAAAAAAAAAEAgMFBgcIAf/EADgRAAICAgECBAMC
DAcAAAAAAAECAwQABREGEhMhMUEHFBUiUQgWFyMyVVZhlJbT1CQ0cbHB0fD/2gAMAwEAAhEDEQA/
AJ/FeRlDBv3EMPeKI/IHyb6FD8ESB0mKHjMAf87/AE7q9aYygM5UDfuRXHvIHH/YK/PG1fU7n4Mp
9VKNFMYncbV9Tufgyn1UcbV9Tufgyn1Uo0UxidxtX1O5+DKfVRxtX1O5+DKfVSjRTGJ3G1fU7n4M
p9VHG1fU7n4Mp9VKNFMYncbV9Tufgyn1UcbV9Tufgyn1Uo0UxidxtX1O5+DKfVXiaUSIcU1D9bUA
QAyahQIcOEACG8ph4QbwEBDeHKAgIAICFK9Ns5o1NxtkZzu+w13yaS8Me3AOkKnBMXslasFLE3hv
5N5X5Te2BgHu8rGONpOk1ADcYDd4Q3h3/H0AHt1VAICG8K1axjldrdCKKibgqnDAohuOA8/L/i7v
Jv727nrZhkuCyZTAO8DBv9rm5w9ro5uQQ6KYyuooopjKF0bcoiH/AN0A8ahA/wBvFVdSc789b+Et
vnApRpjE2ZmYi3YmTn5+Uj4SDhWLqUmJiWeN4+Lio1iidy9kJF+6USasmTNumou6dOFU0G6KZ1VT
kIUxgUCnIcoGIYDFMUDFMHMYogAgYB5hAQEBAQ5NwgPdrSzaTAA7PLXQBgAQHSHqMAQHmHfiO7ai
o7CrbynssLO0W63ruOraB+x9vYKz/cTwxlbUUHrbSMxrlOSdKCK1rqB1ttZ98OFBcW6vwIK4xcQT
hhK230Dp/wCHe66o6U3XUukU3ZdDdjhu6qOMtalpyVvHa3T4J8eSuQ3i1QviPF9uEu6GJ8Ta29el
frUrJ8NbURaOcnhFkD9gjk5/RD+zk8BuA3APcJwdFeSKpFiFUTORQhyEUIomYDpnIoUDJnTOURKc
hyiBinKIgYBAQEQEKty8b3s/HsC8um+rngrQtxgAccm7jlGcRGIGMBhImZ29WRRFZQCHBJApjLqi
UwJJnEN1c/8ATMtl0UVr9jPVbptzLNKW5izNuOb5uBMqp+wkBc0c6lVSoEMosLZgZVNy76ymQ6qw
NU1hSSIdU4FTKYwZ1fSDGLZuZGTeNY+PZN1Xb1++cItGLJqgQVF3Lt24Omg3boplMdVZZQiaZCiY
5igG+mMrKK1hhtaek24bvZ2DBahMVS15SMk3ho+32F2xrh6/lXbgjVrHsuAqKLp06cqJt2qSCpzO
FlCJpcM5ygOcL1v6ycbwLm6L/uu3rMt1oYqbiauWWZQ8cRU5TnTQB0+WRTUXUImoZNukJ11CkMJE
jAU25jLuorXnG+rPTPl+aG3MZZyxpek/vEE4WFumNXlHBi7+ERoxUVScPFCgAmMm1IsoBAMcS8Eo
jWwwcvLTGFQr9pXnGWtjal6h7SbvVEm0Y5w2CaQKbil47gXFkifk38m87s5ublERqahUATazrKF2
x+qIoGEC8bwMABvHnNpuw2O/vh9fTTGSHtEGQHs7Gxhl1zH4ZERETGEfzS7+73d49Hd376e2t1UV
WSBhHfvKTn5+UPw6Omo9GzzUMMVFbxHzpEeURH80g93v/L01IPtTte29wn8hqYy76KKKYxOd+et/
CW3zgUo0nO/PW/hLb5wKUaYzSraS+h566P1RNRf8pLtrkjkKUUibwAf7Bd+/m/uhz9Af87o7+txt
JfQ89dH6omov+Ul21AJ2N+xsyLtH75b5EyAjNWDpDsiVSQvC+iJKsZXJcuzEqjjHeM1FUuC4cFAE
07vu0oGjrVaLFatzvLhcoMUPX34PHUOo6W6J613e7tpT19Pa02kkbgySuaTCOvXi5DT2Zm+xDCnL
Ox9lDMvP+rali9s9dWrRmSWSu4AHoo8U8u7eioo82Y+QH7+BkiXqZHVXrSzZhi78W5itSYvXTXh5
FC38QahLlfKoTLGVanbkc4TRXfFO5yHDW1HLlfR0ukod3YDQW9oyUg8jV7ai7fyztBswWBeO0Vsb
E+olhf8AcunDCdlR91SOObChZO4nd53rPMjyqB5aHjHTNc8IIOYJtIPCqAoRhHPocFE05s5k5B2L
MW4+wnjy0MUYptKFsXHdhQbO3LStO32hGUVDxLIo9aRQSLvOqusqdZ2/euDqvZKQcu5GQcOXzpw4
Uaj1u4M1DYt1T4819aXrLXyhMQNrBYWW8XRoLLzdxWwBnaJHcZGtgNIyibpo8SbOCQqb2XjZGJgJ
MkW9jm8lwPNnWe+odT9Ubfea7UV9HU2FhpYaFcny8gpsTcExLbtsDYtCuscAnkfsVmLSybjrastK
jXqz2HtSQoFaVh9x5CJ5dxjj8lTvLN2gckDhVbc1n5U0gXha9l3zo8wNlLDOoPGN32/OWvMWngV7
jOJlIZk6A75hMK26CbY7yPUTZykPJnYqyCSjJeMI4I0k3IBuDtCso3xqFmdBuk+OmpWx4bU+2ta9
8trsgUj3rlnIGh2jK3xRULuBozdBdMi5jniR0FJZnbSjhuok0WbrbBtdpnli9VYO2MZ6CtSy99SL
6PYTBLytuRhbStXjLlFF++fTSEWdd4yjiHUMJ5JG1iKgUDKLICAomvbaP6UcmZjb4iz1p74qpqA0
3XIrctqwztZu1SvSBWdxsk/t8HLpVu1CUbPohu7hyO3DZu7ReTcWLlstJoOm+rn1APl6+rc8HgcH
y9PMe/l5nJvt9/p7ccjy5/8AensffNkbK0LaRMex9ntLX094taPLDkIWbtu5XFpRb69Gk9b7ls+j
J9e9HiC9zvZpJ80QeKyDyVWWXXKPXRMkIpU1ledntdeu1SvzDmW3D+UwPpRs+OkUcdA9dNYm6bkf
sLWfiaRRbLIHM1kZG5BNMLkODh1G2wxhgUIxk3HB2cx3tKMk3POWJjy5dCupm3MkT10WxbN29dtK
VTse128rMMoycu1SccQ/ZQISEaOHM8oi6h0ECMmxkFJsEijJDj/UxhfPumbWKGvLThjt/mq3L4th
Cz8+4lt8VTXW8aoNYlgnPQTJui7fSBzoQNvKt3ETHyr6JfRavHYleGkZFwkHPJ59eOB5+5444Pn7
c8f74PoOPTken3D92Vu0b0IYDjtNl55lw5j61MK5WwTCmyBat1YvhY+x1XTG2jpvZOGlm9vIx7SQ
FWPSUWhZNdEZaGmG7JZo+KwXlY+S3q0O5jnM+6UMJZWugQPc1y2gkhcjgC8Er2ft589tqZkSEER4
BJKRh3L8hBERKRyUomMICYWxtQGo/Uxr3sR3po086Vcx4vjsinZQmUcp5qglrTt61rYByi5nI1u4
MmZitx1BEyLsSvlZ59H8bYRNunfO03Dd4fAOH4PAOGccYbtxVRzFY+taNt9N8sQE15N23SBSTlly
AIlI4lpNV5IrlKPBBVycA5Ar4f0Rz6kkjz9j/wBn/nA9fL044/dz5ceX+nv92Zfrn/7Wn0ZHVF4Z
gX6NmG66AFc//a0+jI6ovDMC/Rsw3VOVY99s8u1UV+hR/hTqQnana5t7hP5DVHs2eXaqK/Qo/wAK
dSE7U7XNvcJ/IamMu+iiimMTnfnrfwlt84FKNJzvz1v4S2+cClGmM1a1xP7KitGGrGUyTbcreOPI
3Tjmh/fdpQUz+Tk1dFns8d3C4uW3om4OLu+wcjMw6byPZy/FnAxzhwm8BI4ogUWdrv2zOC9FWzT0
P6mcfaRpaKxNnhZSwbBwhad6W7ADjONgYO5JNLjEua3V2Mz14tuLAuoixbu3Tx+d88cuFzLqKOt7
SL0PXXL+qNqK/lLdtQk9oMYC9T7bHgxhApS5DuQxjGHcUACy8niIiI8gAABvER5g5a7p8LeltP1N
T09Tcw2bVW11/Brp6yXrteB60vS24uP+ZrzxRrOZ6VYiyqiwI0aFZRFI6NrO7u2Kcth67Ijx6l5l
cxRuwdb1aMfadGJXslcFOewkhiO4KQ5z5roxT7CLJX7ZLS+51A9Vz4pHk8pFkr9slpfc6mgcXbLf
Sbpw0lYz1lbVjM+U8exmeGqMhg3TbgVhCHy/dMU8Ypy0dL3BI3NFTLOKTUhnDKYl4wkYwJb7GUim
0rcKE67ThDrMrsuNGGtDTdlrUBsnMxZnua/8BRCtx5S0qah2NvLZKfW8i0dPzSNgy1rQ8Ig+Wds4
6RGAj1W04ncEmxcQvZeJlVo9g87M/Q/wFSaQt0/ujqotj9Jl6kE/Up6ci2IsCoa77UXfCCLbIqvd
CnXpYPhNbVh5a59T6o7R/i63jtF44p9tL5sxdgkDeB4fdyY/tiPnxSvJEfHGOyea5sU+wiyX+2W0
/wDezt1fR6rnxSP/AIRZK/bJaX3OpgTZi7MmztXVg5q1Xanctu8BaI9OTQVsh5Dh2rZzdd3y6Uej
LOrasc0gzkmDdVmxeRZFpU8PcCz2am4e3IOClpVy5Ix3O07aAtjdtDMsQWGdHeftWmLcmMJpCWkb
M1BNrCVTy3jOHXKreSmMJyEtZJOCyDGQJXs+gynW8wyUaMTF7BA3K9fx93a9A/ArUWtrXm6b31qL
Qqn13Ya6Xqa9rdPI8K2FgvW4LrKkwgeOWdYllFSOVXuNXXkrTBtep50gdblVGtf5WKZaUU1gBgnd
EjRglSwKoSVMhDCIOeBj7Ginqk7DOr7UZZeA5TT/ADGC2N3MrjeK5Lv/ADJZ35LQY2/CupdNB8Ve
DhEjKyZ2wMWgGkkBFwqTggqbcmbGmoTqpHD+Cs65dwuz0rXdkdpivINzWK1v+2MyWeFu3kjbsitH
p3HCdZtqRTCMlCpcZaAnIPC9ZULucK/3qjnWPs1MLXPtrZ3ZsvbxyajhiLyXelmIXg2kLWDJh462
8XO73ZOFpBW1VLXF4rKoFauTktYiBmBjFSbpORBcMT4z2Xt7akdppnPQXgCXct7Ww9mHMluTeTr6
6y7LZ2JsW32+tILvus0O0i2snPyHBiY5hExLSOCYn5IvF0I6IbSLuOtr8Lvgquznu2EtV9OnROu6
oajat7eGvWoXbNgx7Z9iNgbTTzRx/LNrO1ghRHiDSy9uVfW+ozCkSFGsHZS0hKkddneWOOPmDwvC
7Ailu/xuQT3EEhV5EijzXNinkHykWSt4cw+TJaXJ3P8A07o5Px5afl2Xe0Xt/ab4Au/PVt4snMRM
bSzBP4iWtufuaOup49dwNl4/vJSbSkYyMikEWrlG/kGBGZ2xlk1Y1ZcyxiOEyJwnMq4U6n3wncl0
4Ql87a78sZDs0svbs9mnGbPF5MVqX/DprtHDeBhX1pOXj620ZtAWbxZCQmSlKm4BhcMgiCT48hfq
UoEQ2eubQbGOZsGtjJQNjK7gVM3DCWnYETKgUAKChk+CJwKHB4QjwQANwBo3xL6G+H+u6DudQdMd
Lb/SW4b+ojr2919ZrpbqX2m/OVYNjbmV1dIwziWGKxCHjLRp4i85PTbPazbSOpdvVbMbRWC8db5d
jHJEE8pGijUggseO1ijEMASF8pN1c/8A2tPoyOqLwzAv0bMN10AK5/8AtafRkdUXhmBfo2Ybry7m
7Y99s8u1UV+hR/hTqQnana5t7hP5DVHs2eXaqK/Qo/wp1ITtTtc29wn8hqYy76KKKYxOd+et/CW3
zgUo0nO/PW/hLb5wKUaYzSzaReh665f1RtRX8pbtqEptBDop9T87HVRy1F82TyNcKjhkAgAvECWb
k4yzQBMIFAXKYGR3mEADh8o7qm17SP0PTXMPRpF1FD4sSXbXMey7rzzLm3R/pu0V3bB46Z4n0vy7
udx7MQEJcDK/JF4/i52KWJdsw+uuTg5JuDe4Xp0yRVtQahVk2xjKnImdNX1V+D7pru0pV7VRYzDp
OvKm0vF5PDZav4sbijzEOOZJPHuwDsBUhCz8/Z4Oj9V2Y4JXSQnus6qSCLheQZPnq0vDfcOyNjyf
fge+Pf8AVKjCYyRE7OXU7Yqy1xaabu0xp2zZNwxIHXtmEuuQWh7sVSVVT3to55eFqrwBWCRgKo+T
sKRREoGiQJSB1LtB3JbepnUvqJmHSltYBxXpnuVnlG9pRRRhaTKQdT8FcsYL+RU4LJRaCt+17qmn
RAOdaNjjncHImm7KY7aOkDa26mNJGLX2n48BiTUXpwfPF35MEakLNVyDY8G8dOTPHLq0zoSsPMW6
od2os9SZIyDmCQkHLmQThuOrGXpZ1UbYXUpqUw66032xZWEdLOnWTXI4uPEWmWx3Fgw17HIqmuBb
4lHkxNS86iosk3F3HtXETDyJGbEsnFvTtSKj2P8AE3q1OjZ/hilHWNqJpLFFOq22ABTRWdpJfeST
S/K+O+7jryPXVFnFJ7QW21sAsma79RoHYrujLOJ1WOU0RF62o4FiCix39vyxZQ5JXxAnMYj9DjtG
O41fUd1NXqqt7ThEO3UvZGrO58m35jyBaHUuEuOGmaLayckweRLIplwLb+P3MNdajApDh2NtNwk2
KqdMiQtXbCnFuTsl7UDS6+x1DSz5lje9Vcg5Cl2KC/Y23rDgYp8ScdTj8hQasW8gLxtCtEnaiQyE
pJMo1sVV27QQPZ2zazFtJtNK2Ts96D7SyBeVnQq9u2xm+EgrGdZNsOQM9QkZG2W97Wa1TcvBccXQ
lSxc9Epspdkgu7aN5Rsm7Eij9+zc1PbUzWjq8xawlsFWXpC0w2HejHK2pKRxVp3fad7VvmOsxq/k
Y6EvW57pM9ua53ExKOEkhgmc4aNVA7iRlmSbFiuuhA3ybXpDUfE+jUm6at6jczbrctsL+8MGx1E+
409eG5rburSpPLetMIozqESxC9r5ivHM0SlTl2oYL9jSyut2OxWWvXEUVbvhsLXnYxyxzmRBEn2j
8wSjBOx2Xk5g7En/AFXV3/8A73lX6PslWyuysuCJc7Vzbt4hiphnBZkytcGf/IneLLFSfKr2zmLK
rKZUjQHcdRSGkrvtSVdJI71TNw4wJDJM1DpsPZ/1+y2JtsVn/XbpqJZl2uITPGTHWOHV5x8tNWXc
sMeFf4yJPrMIWateWcxs3EJrz0KKUvHrJkeMVHJTgRVufRaU1XZrW1U3TrLta5hxpnW58t3dmkJ/
HgvYZlAXfes3Jzs23gWr9/LuiW8spMSEYMPLyEwm7hXCsbKKyKKy4qyJfh5tuoNWIpHioRX/AIUd
H9PwyT8tJBvNNsDt/Bt1e3v+U8Ra8NkglijToqd6jmhdtBUnLANK0W92FtgvkGrWIRX7o3Pl4nHe
U58ue0k8E5ga4bTubH0/MWFfMJJWxetnybu2LptuaQUazENcMMueOlI1+2WAFiumz5usicRAwKiU
FCGOQ5TD0AOpQ/Q7sze1rRyIA9ID5B2nTkEO4PSA1HTltvzmW8U/yiyhos2f2U8zBFHijZwvDBUm
rekgZRmLLszNt4+8mUW+nU0xAzd0xSiWDYySBG8YkiiCRpGvUqDpR/s+85PlipEVfa3cnPVSIE62
gRR3hXTw4ORFPebraJDKCVJPhG4BAKXhDu3jgvjle39z4Y7Ab7RQaaaHbaMK1baw7OC3M0s/zDwd
kEEsNdCqGI2VSZxIVeJDGWeV0zFVj3UXytl7CtBa5DwNC0ahU7A5LsrOeWDdhKgryGIYcSaq5/8A
tafRkdUXhmBfo2YbroAVz/8Aa0+jI6ovDMC/Rsw3XhbOnY99s8u1UV+hR/hTqQnana5t7hP5DVHs
2eXaqK/Qo/wp1ITtTtc29wn8hqYy76KKKYxOd+et/CW3zgUo0nO/PW/hLb5wKUaYyy8j48s/LePr
4xXkOHLcVhZItK4bFvSAM+kows1at1xLuDn4o0lDPI6XYBIRb501F5FyDKQbAr15m7buCJqkaQDq
ebY+AAAGkLcAAAAHk/aoOYOQP+9dPR0Vm9V1L1Hoo5YtJ1Bu9NFYdZJ49Vtb+ujmkVe1XlSpPCsj
qpKqzhmC+QIGRp6dO0VazVrWGQEKZ4IpioJ5IUyIxUE+ZA4BOMu+Z59j77EP9/2qD+tdHmefY++x
D/f9qg/rXT0VFZX8ofX/AO3PWH8zbr+9yx9J1X6s1/8ABVv6eN8abdlrom0gSr+W0046yLiA8u7R
fzsVa+prVJ+StxvWrRVizd3PZcnmiQtC5XDFosqiwWnoOROxKcwtDIm/tVn/AD1pYw5qYtN7YmYm
uR5uzJRoePmrYtnO+dsYwlwRyqQJLR1yR+Lck2Y3uOPcEABcsZwkg1cqB15dFRb+3WxFFYafqDfW
r6bW1u9vZ2kZUx7KfZXJr8ZTgIUuSTNYUoAApWQFeBxxwMkLUqpEYErV0gPIMKwxrEQfUGMKEPPv
yPPGXQ6nn2PgcgaQ/wB/2qD+tdHmefY++xD/AH/aoP6109FRWZ/KH1/+3PWH8zbr+9yP9J1X6s1/
8FW/p4y75nn2PvsQ/wB/2qD+tdOC6UNG2m7Q/juaxPpdxx5GFgXDekjkOYgPyvvy9eOXhLQduW3I
THZXId0XbNN+MQtpW+y7HtZFCLS7H8ZQZJu3b1dzs7RUDZdXdV7mqaW36n6h2tNnSRqmy3WyvVWk
jJMchr2rMsRdCSUYp3KSSpGXYaFGu/iV6VSCQAgSQ1oYnAPqO9EVuD7jng++Fc//AGtPoyOqLwzA
v0bMN10AKgCbWdFQ22P1RGAoiXjeBhAdw85dN2Gw3d8fr6K17JePc7PLtVFfoUf4U6kJ2p2ube4T
+Q1R8NnmmYIqK3gPnSIcoCH5pA7ve+XoqQfana9t7hP5DUxl30UUUxiTKgbrCgkMYpwABKYoiUxT
F5SmKYOUBAdwgIbhDdvAd9Nl6rprKbGKkDWlft9W+qCanWzwF1T8SoQdw7hKePkG5iiG7kEohu6Q
p0Jyn1wggPMIbh3c/wDzl/06d1YByNjltcjZZNREqnXCmDlLvDcID7Q8nLu5x593NTGQzc/5N15N
Zl6S39V2qiHRBVQCJxOe8sxyZQ4XIBSM7sRKHJzAAByc1afL5c2kQKDwdaWsoA3jyBqVzWUA9rkv
Tl3c3+VS9r00aQ826WWPGpGE5jCIikA8ojv6Pb6OisYH0GQJjCPYtH/JD6gDvf5UxkVLyXNpJ7NL
WX8ZfNf31o8lzaSezS1l/GXzX99alVeUKgvWxL3j8KPKFQXrYl7x+FMZFV8lzaSezS1l/GXzX99a
PJc2kns0tZfxl81/fWpVXlCoL1sS94/CjyhUF62Je8fhTGRVfJc2kns0tZfxl81/fWjyXNpJ7NLW
X8ZfNf31qVV5QqC9bEvePwo8oVBetiXvH4UxkVXyXNpJ7NLWX8ZfNf31o8lzaSezS1l/GXzX99al
VeUKgvWxL3j8KPKFQXrYl7x+FMZFYTy5tI+GG/WlrL3d3fqVzWbk735aD46VbExJl3ImSHGQcp3N
e2Rr5nV40Z29L+uGbvC7JkYuOZQ0b2WuO4XkjMSQx8PHMIpjxx6txSNYs2LfrbVsgkSUmXQXAgIC
MWl7x+Hc56vy1dFMLFOUliRiReCYOUEQDmEN3cDn+qmMx1ogx+9go2MKugYnAIiAgYoh+aXf3O5u
Hp7u/dT21upCkyQKIbtxSc/PyB+PT01gDGOKGtroopptyp8ACgG4gBzcn+Hucm/v7+etmGSAIplK
AbgKG72ubmD2ujn5ADppjK6iiimMBDfyDVMo2IoHKAG5+QQAeX/nRu79FFMZQHiG5xERRIO/u7i7
/wDUBry7BtPSCeIn2KKKYw7BtPSCeIn2KOwbT0gniJ9iiimMOwbT0gniJ9ijsG09IJ4ifYoopjDs
G09IJ4ifYo7BtPSCeIn2KKKYw7BtPSCeIn2KOwbT0gniJ9iiimMOwbT0gniJ9iv2WHbF3bkScggP
MXud4oc1FFMZXpNU0wDcUC94A3j3/F0iHtVVAAAG4KKKYz7RRRTGf//Z" height="120" width="129">
</td>
<td align="left" style="text-align:left; padding-right:10px; white-space:nowrap;">
<font face="sans-serif" color="black">
<small>
<b>Bernhard Glomm</b><br>
IT Administration<br><br>
</small>
<small><small>
<table border="0" cellpadding="0" cellspacing="0">
<tbody><tr>
<td style="white-space:nowrap;"><small><small>
Phone:
</small></small></td>
<td style="padding-left:5px; white-space:nowrap;"><small><small>
+49 (30) 86880 134
</small></small></td>
</tr>
<tr>
<td style="white-space:nowrap;"><small><small>
Fax:
</small></small></td>
<td style="padding-left:5px; white-space:nowrap;"><small><small>
+49 (30) 86880 100
</small></small></td>
</tr>
<!--
<tr>
<td style="white-space:nowrap;"><small><small>
Cell:
</td>
<td style="padding-left:5px; white-space:nowrap;"><small><small>
+49 (170) 3217628
</small></small></td>
</tr>
-->
<tr>
<td style="white-space:nowrap;"><small><small>
Skype:
</small></small></td>
<td style="padding-left:5px; white-space:nowrap;"><small><small>
bernhard.glomm.ecologic
</small></small></td>
</tr>
</tbody></table>
</small></small>
</font>
</td>
</tr>
<tr>
<td colspan="2" valign="center" align="center" style="vertical-align:middle; text-align:center; background-color:#6f7072; color:#FFFFFF; white-space:nowrap;">
<a href="http://ecologic.eu"><img title="Visit our website" alt="Website:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAAOwwAADsMBx2+oZAAAAAd0SU1FB9wMBAoOC+d8fXIAAAKjSURBVFjD
7ZfNS5VBFMaf8WMRejWktIWEiyDQokITJY2E6C+oZWFC/0DtatcuMiGiZR+6itB/oIKghe36kFLK
W5lkEYGF5r2m6a9Fj/T6Yqb3vlaL+2zmnXnPmXnOzJlzzkgFFFDAxiLkowwUSyqXVOqheUnZEMLc
hjMHiiLfO4EzwF3gC7DIT0wBg8B5YN9KukmT2gxcAKb5hQlgFvgKjLIcV4HqjSLTAIx4oaduh4Aa
IA28MOEn/jfodhxoTvSYgD3AZyALdAA3vFir/78BxvzdBCxYptl6GWB/IscHbAWGTaAXaLevXIzI
pIFXkf4lH2sLcNm6o0BNErvU7QnvAN8i/jEAdJrgB/tSK3AUuBmRWwQe+LsnXzL1nqjf/fYVHHfW
iy74aKJ4DRwGioDbHqvPh9BZT9LifhXwDrgGVJpgFzBpX+kCjgB1QB/wFqi0bovnOpcrmVLfosdA
RWSHADpjsmkgHRs7FTMm5bkeASW/W3c1jy+TtFvS/RDClMeK3T5bg01j0WwQQpiWNCipQdKmdacO
YIukT5JmJL23bIWkavczJrgoabvVxm3kgqSUpBpJHyVN+3+tJCTVhhAm17tD+WIhZjQmX5JTDnXU
XXZVgUMea1qDD3VY9kBk7IpDRyoXH5qxrxwEymNW71qDTTuiOkCZpFZJw5Ky6yYUQpiXdEtSox1R
kp5LmpDU7mvfBpyQVCWpCjjuuFMnqc0+NRIxolHSQAjhe76BcSBy7V/Ggt9cJDBmNzQw/iF19AMn
7VdLqaMNOAZcjxFLJnUsXf/Irqw1uXZbpgXoiezWtqTKj72uDJfKj95Vyo9GH2Gfy49J57jmRKvH
WIE29E8KtP+9hI0X+aeBezFyGeBhPkV+Es+gVOwZlPkrz6ACCiggR/wAnDhVsuP7eLUAAAAASUVO
RK5CYII=" height="36" width="36"></a>
<a href="http://www.youtube.com/v/hZtiK04A9Yo"><img title="Watch our video" alt="| Video:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAALEwAACxMBAJqcGAAAAAd0SU1FB9wMBAoOGGPCPKwAAAB6SURBVFjD
7ZU5DsAgDAS9KP//LFS4cJo0iRJycMRIOzVaDIyNCCGEkB24W2Bm9igIQIuCwqiNhmEbrfKCtwOG
aaSueYYz7455V252v6Gc8yvHlt7Cu3Aoxvi587o4VDNI2fYsSEQkpeRzMJYyfpEaAFR17q+DEEKI
d1aawEGkmN8D6QAAAABJRU5ErkJggg==" height="36" width="36"></a>
<a href="http://ecologic.eu/newsletter/subscribe"><img title="Subscribe to our newsletter" alt="| Newsletter:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAALEwAACxMBAJqcGAAAAAd0SU1FB9wMBAoMMRNGxkIAAAChSURBVFjD
7ZaxDsMgDERxFf7/g/I1DLciFiQGJHdq1SFNUmoSotybkBDG5s4WzhFCyMAAUGsA6Nqd8m1DVbVn
sSKyePfUerCVrUIfo9nkPgnFGOeXkUMIaqL1P8b+7KyUku6Nex/Jcs7vdSnFnS5Za9zJcoZYzKyf
ErIekpcwtalkS9RanfdeKBkTGsbUvT9qu19IRARAj2/xIc1BCCGtPAEkwLgtYjzXqwAAAABJRU5E
rkJggg==" height="36" width="36"></a>
<a href="http://www.facebook.com/Ecologic.Institute"><img title="Visit us on Facebook" alt="| Facebook:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAADigAAA4oBp4z1HwAAAAd0SU1FB9wEFwgCHldMsUsAAADmSURBVFjD
7Zc9CsJAEIXfhKBYqGCj4B0s9AQewQN4CBuPaWlhrYWIlYKR/DybFcIaC7NxF2U+GJLZYvL2zSxJ
AEVRlLBIU4VIjgFEzxTAUURS7zsiOSB5IHkrxZXkpE692FHMEMC+ok5W1/3I0aBFSQzNNTdB7w4B
GJkHi4ktgKVxaBdCEK3WrERk41LQtWXpt07tp8M85SuFlc98OpSbOXnnzh3A2aeguGL+yqeqDeAS
onVrq01z15quQ92x8m5oQY2jglTQ3wlyfblmABJz3wJQBP2EJdkD0C8tnUQk0T8DRVF+mQc9yneK
ZNh8QAAAAABJRU5ErkJggg==" height="36" width="36"></a>
<a href="http://www.linkedin.com/company/ecologic-institute-berlin-germany"><img title="Visit us on Linkedin" alt="| Linkedin:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAADigAAA4oBp4z1HwAAAAd0SU1FB9wEFwgDLmiOsKYAAAEQSURBVFjD
7Za9SsRAFEbP7G6ziqyIlYUiNhY+gC+wvoU+g80+g41PY2UhaGclFnZiZWMrrGjw79hMII6FCe5m
V5gDYb7ce5P7MckNgUwmk8k0Rx2op+qVujdrMwtq4Xd2ptWvU6NmBbByAOzPcoe66l2yQ8vz8B6N
1CN19T8Owa56qG5P4+aL/mQr5m6S+FC9TWKP6sGkp2ycNNmMuctK7C2un8lasj6pKatLr6LvgVCZ
SoCztg0BXIcQOiGEDeA4mipZUwdtGxqWIoQwSnJdYKlNQ09A8UtNaNNQqNOw7UdGNjQvhro14r0G
36k/FX0AJ0A/nveB56gvgIeoC+A9ufYcGEf9Crzk391MJpNpyBfHBeoJLzEVJwAAAABJRU5ErkJg
gg==" height="36" width="36"></a>
<a href="http://twitter.com/EcologicBerlin"><img title="Visit us on Twitter" alt="| Twitter:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAADigAAA4oBp4z1HwAAAAd0SU1FB9wEFwgEKbmrs8IAAAEeSURBVFjD
7ZaxSsRAFEXv1RUERW0WBLuFBa2t/A/9gG38B4v9BTt/wsbCxm7Z2k4LZWtFQcsVFdFjYYQQEyVs
MtmVORBeMZO8Oy93Zp4UiUQiMwawCGxMi5g2cAc8A1dAp2lBp3zxkcSjqnPMlZy/nkQncbtpQT+K
9u8FtSZ8fxM4KVjY0PZh3aY+pxwjoBXyl/1FV9LSNAj69taDpJeQHnqSNEodA2luJR3Yfg0p6NL2
DjCfHbD93sQu25okeRUeyiZeBXpAZV50yW2/J+k4Y15LupZ0k1ngWFLf9kWd59AC8Ji6XItIj3fr
Phx3c5L+xlmINqRXUI28Ku2H6o1WgAEwThq2vGdY9upwBcKWJa3lfOvN9n1s+iORyKzxCQPwTJ5S
Bf6EAAAAAElFTkSuQmCC" height="36" width="36"></a>
<a href="http://www.youtube.com/user/EcologicInstitute"><img title="Visit us on YouTube" alt="| YouTube:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAADigAAA4oBp4z1HwAAAAd0SU1FB9wEFwgFIjdiWwsAAAHTSURBVFjD
7Za7a1RREMZ/c3ddTdIn4APBysLYKmqRwkoE7VIoFj4bC/8AwUKsbCwsrG1sVBAsFJLKFBaCVqYz
8YGgVsEku25ifhbOwhoEsyt3NXA/GO55wJzvzplv5kCFChUqbDKoI+rOHI+qo/+a0Jg/0VDfqhf/
hyhNq9dVc35cHVeH1X3qLnX7IAkdzCjdUc+qa+qiOqG+VG+qV/vxXfTJ6TXQBKaAE8AEsAzUgVXg
e9rACK0CAivA7iTX7tqPfqNf/OXt1YFnQAMYSSKNJBqDJBTAcNpTYAb4DLwC9gBngK/9Ou41oYfy
R5oZjQJoATVga4470SsiYrkUQmoNeAgcBoYyh/7kuwU8iYhTZUj9stpS36jz6gd/xfuUfzc68/Nl
5NABYA64AkwCj9bt71+ntE6UBHaUldR7gdPAoSR1P2vRN2ABuJuqW8rEvj0Ila1k0ZsHHgDTwEdg
G3ABeAzcAm4AL3otkPUSOkuRkj+XJAdGyDw8frNey+tsAlvKurLOwWvZOsaBe8A7ILLeHMtieRK4
lt/SOvyllPAXda5L2otpC+qsupTrz9V2r7KPHklNAUc2UBS7/c9ExNEyW8dYtoyNoB0Rn6qHf4UK
FTYTfgDpBClAXl8czQAAAABJRU5ErkJggg==" height="36" width="36"></a>
<a href="http://plus.google.com/113756356645020994482"><img title="Visit us on Google+" alt="| Google+:" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACQAAAAkCAYAAADhAJiYAAAAAXNSR0IArs4c6QAAAAZiS0dEAP8A
/wD/oL2nkwAAAAlwSFlzAAADigAAA4oBp4z1HwAAAAd0SU1FB9wGEwowOnAZEbIAAAGZSURBVFjD
7Ze9Sx1REMVnnoqiWOhDIliIWPlRRBAtLIRA1D/AwkIkjYW2tvZW1vYmEAtBsLSxsQkhASEkFlYK
IlqIIIpEz89mxFUerxDfXYQ9ze7OXuaePffM3LtmBQoUKJAv/C2SAB1A07PE7gZ4qVQ6SvY1kiYl
nQBIugduJN0Ad8C1pP6UZFaDyHyoNAhcRmw76TpLGpcEsPFi6foISPr0mtylVxnPfdHdzcwOXsT/
mdnfeJxNRsjMRuJarmDwn3Fbl5LQXkw+XUG9NsDcfSuZh4ABnrCWiXeFf3aA+qTGBqaAK+Ae+AXs
BpnN3Loq0CLpo6QlSUTlDeXe7oHPmSX8LqkxTzKjkr5k+g/AKdCarMqAXmArtohldx80sxkz+xb9
6cNjJaZQpPtRDKC9wvuFjFKzNSUjqQ74EwYerkJ6JUit1lqdRuA4CHVXGVcOFedqTagBOAxC+1XG
rUs6S+WhiUzP+R0VNgb0AJPAV0nnQGfKUi8DP6JT30q6A/7HoWwxtyMs0Gxm5dhMr9z9ovgrKFCg
wHvHAwOPpj4eVQaJAAAAAElFTkSuQmCC" height="36" width="36"></a>
</td>
</tr>
<tr>
<td colspan="2" valign="center" align="left" style="vertical-align:middle; text-align:left; background-color:#FFFFFF; color:#000000; padding-left:5px; padding-right:5px; white-space:nowrap;">
<small><small>
Ecologic Institut gemeinnützige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | Germany<br>
GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: DE811963464<br>
Ecologic™ is a Trade Mark (TM) of Ecologic Institut gemeinnützige GmbH
</small></small>
</td>
</tr>
<tr>
<td colspan="2" valign="center" align="center" style="vertical-align:middle; text-align:center; background-color:#FFFFFF; color:#FFFFFF;">
<hr style="height:2px; background-color:#6f7072; color:#6f7072; border-width:0;">
</td>
</tr>
</tbody></table>
</div>
</div>
<br><div><div>On Dec 25, 2013, at 8:47 PM, Fredrik Häll <<a href="mailto:hall.fredrik@gmail.com">hall.fredrik@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div dir="ltr"><span style="font-family:arial,sans-serif;font-size:13px">I am new to Gluster, but so far it seems very attractive for my needs. I am trying to assess its suitability for a cost-efficient storage problem I am tackling. Hopefully someone can help me find how to best solve my problem. </span><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">Capacity: </div><div style="font-family:arial,sans-serif;font-size:13px">Start with around 0.5PB usable</div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">Redundancy: </div><div style="font-family:arial,sans-serif;font-size:13px">2 replicas with non-RAID is not sufficient. Either 3 replicas with non-raid or some combination of 2 replicas and RAID?</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">File types: </div><div style="font-family:arial,sans-serif;font-size:13px">Large files, around 400-1500MB each. </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">Usage pattern: </div><div style="font-family:arial,sans-serif;font-size:13px">Archive (not sure if this matches nearline or not..) with files being added at around 200-300GB/day (3-400 files/day). Very few reads, order of 10 file accesses per day. Concurrent reads highly unlikely. </div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">The main two factors for me are cost and redundancy. Losing data is not an option, being an archive solution. Cost/usable TB is the other key factor, as we see growth estimates of 100-500TB/year.</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">Looking just at $/TB, a RAID-based approach to me sounds more efficient. But RAID rebuild times with large arrays of large capacity drives sound really scary. Not sure if something smart can be done since we will still have a replica left during the rebuild?</div>
<div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">So, any suggestions on what would be possible and cost-efficient solutions? </div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">- Any experience on dense servers, what is advisable? 24/36/50/60 slots?</div><div style="font-family:arial,sans-serif;font-size:13px">- SAS expanders/storage pods?</div>
<div style="font-family:arial,sans-serif;font-size:13px">- RAID vs non-RAID?</div><div style="font-family:arial,sans-serif;font-size:13px">- Number of replicas etc? </div><div style="font-family:arial,sans-serif;font-size:13px">
<br></div><div style="font-family:arial,sans-serif;font-size:13px">Best, </div><div style="font-family:arial,sans-serif;font-size:13px"><br></div><div style="font-family:arial,sans-serif;font-size:13px">Fredrik</div></div>
_______________________________________________<br>Gluster-users mailing list<br><a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>http://supercolony.gluster.org/mailman/listinfo/gluster-users</blockquote></div><br></div></body></html>