<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 03/01/2013 10:34 AM, Joe Julian
wrote:<br>
</div>
<blockquote
cite="mid:652990a5-9cd2-40f0-b56d-3af21a7fc572@email.android.com"
type="cite">0-gfs33-client-2 would be the third brick in the gfs33
volume, so should be glusterfsd rather than glusterd, so not port
24007.<br>
</blockquote>
1) Client xlators first connect to glusterd on the remote-host,
supplied in their options.<br>
2) Query for the brick process' port (identified by brick's path).<br>
3) Reconfigure the rpc object to connect to the brick process on the
remote-host using the port received.<br>
This is when the client xlator connects to the glusterfsd (or
the brick process) on the remote-host.<br>
<br>
<br>
thanks,<br>
krish<br>
<blockquote
cite="mid:652990a5-9cd2-40f0-b56d-3af21a7fc572@email.android.com"
type="cite"><br>
<div class="gmail_quote">krish <a class="moz-txt-link-rfc2396E" href="mailto:kparthas@redhat.com"><kparthas@redhat.com></a> wrote:
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt
0.8ex; border-left: 1px solid rgb(204, 204, 204);
padding-left: 1ex;">
<pre style="white-space: pre-wrap; word-wrap:break-word; font-family: sans-serif; margin-top: 0px">Hi Emmanuel,
On 03/01/2013 07:55 AM, Emmanuel Dreyfus wrote:
<blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;">Hi
The spurious disconnect I encountered in 3.4 branch still happen in
3.4.0alpha, but glusterfs recovers much better now. However, when
running huge tar -xzf I still hit operation failures, after which
everything is restored to normal state.
Here is the client log, in which the issue is hit at 18:06:36
<a moz-do-not-send="true" href="http://ftp.espci.fr/shadow/manu/client.log">http://ftp.espci.fr/shadow/manu/client.log</a>
The relevant part is below. I understand glusterfs is able to restore
its connections and everything works fine, except when it happens on all
volumes simultaneously.
[2013-02-28 18:06:36.105271] W
[socket.c:1962:__socket_proto_state_machine] 0-gfs33-client-3: reading
from socket failed. Error (No message available), peer
(<a moz-do-not-send="true" href="192.0.2.98:49153">192.0.2.98:49153</a>)
[2013-02-28 18:06:36.105340] E [rpc-clnt.c:368:saved_frames_unwind]
0-gfs33-client-3: forced unwinding frame type(GlusterFS 3.3)
op(LOOKUP(27)) called at 2013-02-28 18:06:36.104358 (xid=0x3728220x)
[2013-02-28 18:06:36.105454] W
[client-rpc-fops.c:2624:client3_3_lookup_cbk] 0-gfs33-client-3: remote
operation failed: Socket is not connected. Path:
/manu/netbsd/usr/src/external (6fb65713-062a-464d-a9d4-e97dab3c298b)
[2013-02-28 18:06:36.105514] E [rpc-clnt.c:368:saved_frames_unwind]
0-gfs33-client-3: forced unwinding frame type(GlusterFS 3.3)
op(RELEASE(41)) called at 2013-02-28 18:06:36.104843 (xid=0x3728221x)
[2013-02-28 18:06:36.105537] I [client.c:2097:client_rpc_notify]
0-gfs33-client-3: disconnected
[2013-02-28 18:06:36.105571] E
[afr-common.c:3761:afr_notify]
0-gfs33-replicate-1: All subvolumes are down. Going offline until
atleast one of them comes back up.[2013-02-28 18:06:36.112037] I
[afr-common.c:3882:afr_local_init] 0-gfs33-replicate-1: no subvolumes up
</blockquote>I see that 0-gfs33-client-2 xlator is unable to connect to glusterd
(that should be) running
on hotstuff:24007. The client xlator attempts to reconnect every 3s
since last attempt.
This is why we see logs about client disconnection repeat.
Could you check if glusterd was running on the host "hotstuff", when the
client
experiences spurious disconnects?
To confirm this when you notice the 'spurious' disconnects, try
# telnet hotstuff 24007
thanks,
krish
<hr>
Gluster-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-devel@nongnu.org">Gluster-devel@nongnu.org</a>
<a moz-do-not-send="true" href="https://lists.nongnu.org/mailman/listinfo/gluster-devel">https://lists.nongnu.org/mailman/listinfo/gluster-devel</a>
</pre>
</blockquote>
</div>
</blockquote>
<br>
</body>
</html>