<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from rtf -->
<style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<font face="Verdana" size="2"><span style="font-size:10pt;">
<div>Hi,</div>
<div>&nbsp;</div>
<div>Can anyone help.</div>
<div>&nbsp;</div>
<div>I have at distibuted volume on 2 node and 4 bricks (two bricks on each node). I lost network connection to  one of the nodes and now I fail to write to volume</div>
<div>&nbsp;</div>
<div>Is this by design when using distributed?</div>
<div><font face="Calibri" size="2"><span style="font-size:11pt;">&nbsp;</span></font></div>
<div>Here is some logging</div>
<div>[2014-05-15 09:13:10.684326] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-firmware-depot-client-2: changing port to 49164 (from 0)</div>
<div>[2014-05-15 09:13:10.684405] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-2: readv failed (No data available)</div>
<div>[2014-05-15 09:13:10.690559] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-firmware-depot-client-3: changing port to 49165 (from 0)</div>
<div>[2014-05-15 09:13:10.690647] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-3: readv failed (No data available)</div>
<div>[2014-05-15 09:13:10.696681] I [client-handshake.c:1659:select_server_supported_programs] 0-firmware-depot-client-2: Using Program G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; lusterFS 3.3, Num (1298437), Version (330)</div>
<div>[2014-05-15 09:13:10.696835] I [client-handshake.c:1659:select_server_supported_programs] 0-firmware-depot-client-3: Using Program G&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; lusterFS 3.3, Num (1298437), Version (330)</div>
<div>[2014-05-15 09:13:10.697113] I [client-handshake.c:1456:client_setvolume_cbk] 0-firmware-depot-client-2: Connected to 10.101.13.202:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 49164, attached to remote volume '/bricks/brick1/firmware-depot'.</div>
<div>[2014-05-15 09:13:10.697176] I [client-handshake.c:1468:client_setvolume_cbk] 0-firmware-depot-client-2: Server and Client lk-versio&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; n numbers are not same, reopening the fds</div>
<div>[2014-05-15 09:13:10.697382] I [client-handshake.c:1456:client_setvolume_cbk] 0-firmware-depot-client-3: Connected to 10.101.13.202:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 49165, attached to remote volume '/bricks/brick2/firmware-depot'.</div>
<div>[2014-05-15 09:13:10.711718] I [client-handshake.c:1468:client_setvolume_cbk] 0-firmware-depot-client-3: Server and Client lk-versio&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; n numbers are not same, reopening the fds</div>
<div>[2014-05-15 09:13:10.711961] I [client-handshake.c:450:client_set_lk_version_cbk] 0-firmware-depot-client-3: Server lk version = 1</div>
<div>[2014-05-15 09:13:10.712032] I [client-handshake.c:450:client_set_lk_version_cbk] 0-firmware-depot-client-2: Server lk version = 1</div>
<div>[2014-05-15 09:14:13.661184] E [socket.c:2157:socket_connect_finish] 0-firmware-depot-client-0: connection to 10.101.154.101:24007 failed (Connection timed out)</div>
<div>[2014-05-15 09:14:13.661287] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-0: readv failed (No data available)</div>
<div>[2014-05-15 09:14:13.667178] E [socket.c:2157:socket_connect_finish] 0-firmware-depot-client-1: connection to 10.101.154.101:24007 failed (Connection timed out)</div>
<div>[2014-05-15 09:14:13.672873] I [fuse-bridge.c:4769:fuse_graph_setup] 0-fuse: switched to graph 0</div>
<div>[2014-05-15 09:14:13.675164] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-1: readv failed (No data available)</div>
<div>[2014-05-15 09:14:13.675355] I [fuse-bridge.c:3724:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13</div>
<div>[2014-05-15 09:14:13.676456] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0</div>
<div>[2014-05-15 09:14:13.676506] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing</div>
<div>[2014-05-15 09:14:13.678907] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing</div>
<div>[2014-05-15 09:14:13.678961] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /</div>
<div>[2014-05-15 09:14:13.679010] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing</div>
<div>[2014-05-15 09:14:13.679031] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /</div>
<div>[2014-05-15 09:14:13.679449] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0</div>
<div>[2014-05-15 09:14:13.679491] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing</div>
<div>[2014-05-15 09:14:17.995517] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing</div>
<div>[2014-05-15 09:14:17.995583] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /</div>
<div>[2014-05-15 09:14:17.995632] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing</div>
<div>[2014-05-15 09:14:17.995654] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /</div>
<div>[2014-05-15 09:14:17.996097] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0</div>
<div>[2014-05-15 09:14:17.996187] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing</div>
<div><font face="Calibri" size="2"><span style="font-size:11pt;">&nbsp;</span></font></div>
<div>Regards</div>
<div>Jesper</div>
<div><font face="Calibri" size="2"><span style="font-size:11pt;">&nbsp;</span></font></div>
<div><font face="Calibri" size="2"><span style="font-size:11pt;">&nbsp;</span></font></div>
</span></font>
</body>
</html>