<br><br><div class="gmail_quote">On Fri, Aug 17, 2012 at 10:06 PM, Emmanuel Dreyfus <span dir="ltr">&lt;<a href="mailto:manu@netbsd.org" target="_blank">manu@netbsd.org</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi<br>
<br>
How add-brick is supposed to be transparent for processes using the<br>
glusterfs volume?<br>
<br>
In my experiecne, add-brick on an inactive filesystems is completely<br>
transparent. However, if there is some activity, during the operation, I<br>
get transcient errors:<br>
<br>
# cp -r /usr/local/src/glusterfs-33git ./<br>
(here I add-brick)<br>
cp: ./glusterfs-33git/.git/objects/f0: No such file or directory<br>
<br>
In the FUSE operation log, I can see a lookup for the file that fails<br>
with ENOENT, followed by MKDIR that also fails with ENOENT<br>
<br>
Here is the glusterfs client log after I add the brick. Is that behavior<br>
expected, or is there something missing I should implement in NetBSD<br>
FUSE implemetation?<br>
<br>
[2012-08-18 06:56:29.500791] I [rpc-clnt.c:1660:rpc_clnt_reconfig]<br>
  7-vndfs-client-0: changing port to 24010 (from 0)<br>
[2012-08-18 06:56:29.501855] I [rpc-clnt.c:1660:rpc_clnt_reconfig]<br>
  7-vndfs-client-1: changing port to 24014 (from 0)<br>
[2012-08-18 06:56:33.381571] I<br>
  [client-handshake.c:1636:select_server_supported_programs]<br>
  7-vndfs-client-0: Using Program GlusterFS 3.3git, Num (1298437),<br>
  Version (330)<br>
[2012-08-18 06:56:33.381902] I<br>
  [client-handshake.c:1636:select_server_supported_programs]<br>
  7-vndfs-client-1: Using Program GlusterFS 3.3git, Num (1298437),<br>
  Version (330)<br>
[2012-08-18 06:56:33.382405] I<br>
  [client-handshake.c:1433:client_setvolume_cbk] 7-vndfs-client-0:<br>
  Connected to <a href="http://193.54.82.103:24010" target="_blank">193.54.82.103:24010</a>, attached to remote volume &#39;<br>
  /export/vnd0a&#39;.<br>
[2012-08-18 06:56:33.382496] I<br>
  [client-handshake.c:1445:client_setvolume_cbk] 7-vndfs-client-0:<br>
  Server and Client lk-version numbers are not same, reopening the fds<br>
[2012-08-18 06:56:33.383367] I<br>
  [client-handshake.c:453:client_set_lk_version_cbk] 7-vndfs-client-0:<br>
  Server lk version = 1<br>
[2012-08-18 06:56:33.391422] I<br>
  [client-handshake.c:1433:client_setvolume_cbk] 7-vndfs-client-1:<br>
  Connected to <a href="http://193.54.82.103:24014" target="_blank">193.54.82.103:24014</a>, attached to remote volume &#39;<br>
  /export/vnd1a&#39;.<br>
[2012-08-18 06:56:33.391521] I<br>
  [client-handshake.c:1445:client_setvolume_cbk] 7-vndfs-client-1:<br>
  Server and Client lk-version numbers are not same, reopening the fds<br>
[2012-08-18 06:56:33.432591] I [fuse-bridge.c:4193:fuse_graph_setup]<br>
  0-fuse: switched to graph 7<br>
[2012-08-18 06:56:33.432828] I<br>
  [client-handshake.c:453:client_set_lk_version_cbk] 7-vndfs-client-1:<br>
  Server lk version = 1<br>
[2012-08-18 06:56:33.442249] I [dht-layout.c:593:dht_layout_normalize]<br>
  7-vndfs-dht: found anomalies in /. holes=1 overlaps=0<br>
[2012-08-18 06:56:33.453040] I [client.c:2151:notify] 6-vndfs-client-0:<br>
  current graph is no longer active, destroying rpc_client<br>
[2012-08-18 06:56:33.454784] I [client.c:2090:client_rpc_notify]<br>
  6-vndfs-client-0: disconnected<br>
[2012-08-18 06:56:33.466282] W [<br>
  [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse:<br>
  6a4a33a7-a37b-4a62-b63c-0e3f96226520: failed to resolve (Invalid<br>
  argument)<br></blockquote><div><br></div><div>We need to investigate why there was EINVAL here. Either the resolution should have succeeded or returned ENOENT. The rest what follows is probably just cascaded effect of this.</div>
<div><br></div><div>Avati</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
[2012-08-18 06:56:33.466387] E [fuse-bridge.c:843:fuse_setattr_resume]<br>
  0-glusterfs-fuse: 2827: SETATTR 3032497708<br>
  (6a4a33a7-a37b-4a62-b63c-0e3f96226520) resolution failed<br>
[2012-08-18 06:56:33.471578] W<br>
  [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse:<br>
  85f64202-a5f9-45a2-848d-0e1f4012d4b7: failed to resolve (Invalid<br>
  argument)<br>
[2012-08-18 06:56:33.471704] E [fuse-bridge.c:352:fuse_lookup_resume]<br>
  0-fuse: failed to resolve path (null)<br>
[2012-08-18 06:56:33.476630] W<br>
  [fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse:<br>
  85f64202-a5f9-45a2-848d-0e1f4012d4b7: failed to resolve (Invalid<br>
  argument)<br>
[2012-08-18 06:56:33.476728] E [fuse-bridge.c:352:fuse_lookup_resume]<br>
  0-fuse: failed to resolve path (null)<br>
[2012-08-18 06:56:33.484311] W [<br>
  fuse-resolve.c:152:fuse_resolve_gfid_cbk] 0-fuse:<br>
  85f64202-a5f9-45a2-848d-0e1f4012d4b7: failed to resolve (Invalid<br>
  argument)<br>
[2012-08-18 06:56:33.484414] E [fuse-bridge.c:1261:fuse_mkdir_resume]<br>
  0-glusterfs-fuse: MKDIR 3032485708 (<br>
  00000000-0000-0000-0000-000000000000/f0) resolution failed<br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
Emmanuel Dreyfus<br>
<a href="http://hcpnet.free.fr/pubz" target="_blank">http://hcpnet.free.fr/pubz</a><br>
<a href="mailto:manu@netbsd.org">manu@netbsd.org</a><br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@nongnu.org">Gluster-devel@nongnu.org</a><br>
<a href="https://lists.nongnu.org/mailman/listinfo/gluster-devel" target="_blank">https://lists.nongnu.org/mailman/listinfo/gluster-devel</a><br>
</font></span></blockquote></div><br>