<br><br><div class="gmail_quote">On Sun, Aug 19, 2012 at 5:43 AM, Emmanuel Dreyfus <span dir="ltr"><<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On Sun, Aug 19, 2012 at 12:13:08AM -0700, Anand Avati wrote:<br>
> Do you see all the protocol/client's connection succeeding on graph 1<br>
> before 'switched to graph 1' log? In the above excerpt you have shown<br>
> "client-1" succeeding log. What about other protocol clients?<br>
<br>
</div>It succeeds as well: below is the log output without the added sleep(2).<br>
<br>
I understand the client is signaled to reload the volume before the<br>
truster.gluster.dht attributes are set.</blockquote><div><br></div><div>The trusted.gluster.dht attribute will not be set for the newly added brick by default, and that should not be an error condition. The funny part is that in the new graph it is finding a "hole". Adding a new brick (even though the new brick does not contribute towards filling the layout) should not cause a hole as the old bricks are already covering the full hash range.</div>
<div><br></div><div>Oh BTW, did you add-brick from 1 brick to 2 bricks? If so it might be understandable as with 1 brick DHT is not loaded and there will be no hash ranges pre-assigned. If so can you try by starting with (volume create) with 2 bricks and then add-brick a 3rd one?</div>
<div><br></div><div>Avati</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> Is it possible there is<br>
a barrier missing somewhere server side? Where is that supposed to<br>
happen?<br>
<br>
<br>
[2012-08-19 14:32:09.664064] I [rpc-clnt.c:1660:rpc_clnt_reconfig]<br>
1-vndfs-client-0: changing port to 24058 (from 0)<br>
[2012-08-19 14:32:09.666053] I [rpc-clnt.c:1660:rpc_clnt_reconfig]<br>
1-vndfs-client-1: changing port to 24059 (from 0)<br>
[2012-08-19 14:32:12.807520] I [client-handshake.c:1636:<br>
select_server_supported_programs] 1-vndfs-client-0: Using Program<br>
<div class="im"> GlusterFS 3.3git, Num (1298437), Version (330)<br>
</div>[2012-08-19 14:32:12.808697] I [client-handshake.c:1433:client_setvolume_cbk]<br>
1-vndfs-client-0: Connected to <a href="http://192.0.2.103:24058" target="_blank">192.0.2.103:24058</a>, attached to remote<br>
volume '/export/vnd0a'.<br>
[2012-08-19 14:32:12.808792] I [client-handshake.c:1445:client_setvolume_cbk]<br>
1-vndfs-client-0: Server and Client lk-version numbers are not same,<br>
reopening the fds<br>
[2012-08-19 14:32:12.809469] I [client-handshake.c:1636:<br>
select_server_supported_programs] 1-vndfs-client-1: Using Program<br>
<div class="im"> GlusterFS 3.3git, Num (1298437), Version (330)<br>
</div>[2012-08-19 14:32:12.809827] I [client-handshake.c:453:<br>
client_set_lk_version_cbk] 1-vndfs-client-0: Server lk version = 1<br>
[2012-08-19 14:32:12.819362] I [client-handshake.c:1433:client_setvolume_cbk]<br>
1-vndfs-client-1: Connected to <a href="http://192.0.2.103:24059" target="_blank">192.0.2.103:24059</a>, attached to remote<br>
volume '/export/vnd1a'.<br>
[2012-08-19 14:32:12.819475] I [client-handshake.c:1445:<br>
client_setvolume_cbk] 1-vndfs-client-1: Server and Client lk-version<br>
<div class="im"> numbers are not same, reopening the fds<br>
</div>[2012-08-19 14:32:12.855737] I [fuse-bridge.c:4195:fuse_graph_setup] 0-fuse:<br>
switched to graph 1<br>
[2012-08-19 14:32:12.858810] I [client-handshake.c:453:<br>
<div class="im"> client_set_lk_version_cbk] 1-vndfs-client-1: Server lk version = 1<br>
</div>[2012-08-19 14:32:12.899641] I [client.c:2151:notify] 0-vndfs-client-0:<br>
<div class="im"> current graph is no longer active, destroying rpc_client<br>
</div>[2012-08-19 14:32:12.902488] I [client.c:2090:client_rpc_notify]<br>
0-vndfs-client-0: disconnected<br>
[2012-08-19 14:32:12.909907] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]<br>
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve<br>
(Invalid argument)<br>
[2012-08-19 14:32:12.910014] E [fuse-bridge.c:353:fuse_lookup_resume]<br>
<div class="im"> 0-fuse: failed to resolve path (null)<br>
</div>[2012-08-19 14:32:12.912901] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]<br>
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve<br>
(Invalid argument)<br>
[2012-08-19 14:32:12.913002] E [fuse-bridge.c:353:fuse_lookup_resume]<br>
<div class="im"> 0-fuse: failed to resolve path (null)<br>
</div>[2012-08-19 14:32:12.915572] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]<br>
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve<br>
(Invalid argument)<br>
[2012-08-19 14:32:12.915673] W [fuse-bridge.c:1749:fuse_create_resume]<br>
0-glusterfs-fuse: 2063 CREATE<br>
00000000-0000-0000-0000-000000000000/bb9e267890c23aaa1ada196f222f166d5846f6<br>
resolution failed<br>
[2012-08-19 14:32:12.920535] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]<br>
0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve<br>
(Invalid argument)<br>
[2012-08-19 14:32:12.920645] E [fuse-bridge.c:844:fuse_setattr_resume]<br>
0-glusterfs-fuse: 2064: SETATTR 3107999480<br>
(a10abc68-284d-4768-a65b-be200d965aa5) resolution failed<br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
Emmanuel Dreyfus<br>
<a href="mailto:manu@netbsd.org">manu@netbsd.org</a><br>
</font></span></blockquote></div><br>