<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>
<pre>Hi Krish,

i can only give last lines from the log. Client Log &quot;mnt-master.log&quot; is empty.

NFS.Log -&gt;
</pre>

<div>+------------------------------------------------------------------------------+<br/>
[2013-09-18 09:21:09.240892] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-3: changing port to 49155 (from 0)<br/>
[2013-09-18 09:21:09.240981] W [socket.c:514:__socket_rwv] 0-vol2-client-3: readv failed (No data available)<br/>
[2013-09-18 09:21:09.241524] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-2: changing port to 49155 (from 0)<br/>
[2013-09-18 09:21:09.241571] W [socket.c:514:__socket_rwv] 0-vol2-client-2: readv failed (No data available)<br/>
[2013-09-18 09:21:09.242757] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-0: changing port to 49157 (from 0)<br/>
[2013-09-18 09:21:09.242872] W [socket.c:514:__socket_rwv] 0-vol2-client-0: readv failed (No data available)<br/>
[2013-09-18 09:21:09.244183] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:21:09.244482] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:21:09.244610] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-3: Connected to 127.0.1.1:49155, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:21:09.244637] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-3: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:21:09.244766] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:21:09.244845] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-3: Server lk version = 1<br/>
[2013-09-18 09:21:09.245016] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-2: Connected to 10.100.28.99:49155, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:21:09.245049] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-2: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:21:09.245300] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-0: Connected to 10.100.28.96:49157, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:21:09.245340] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-0: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:21:09.245452] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-2: Server lk version = 1<br/>
[2013-09-18 09:21:09.245759] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-0: Server lk version = 1<br/>
[2013-09-18 09:21:09.383654] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-1: changing port to 49157 (from 0)<br/>
[2013-09-18 09:21:09.383710] W [socket.c:514:__socket_rwv] 0-vol2-client-1: readv failed (No data available)<br/>
[2013-09-18 09:21:09.385377] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:21:09.387653] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-1: Connected to 10.100.28.95:49157, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:21:09.387690] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-1: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:21:09.388139] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-1: Server lk version = 1<br/>
[2013-09-18 09:23:49.068544] W [socket.c:514:__socket_rwv] 0-vol2-client-2: readv failed (No data available)<br/>
[2013-09-18 09:23:49.068613] W [socket.c:1962:__socket_proto_state_machine] 0-vol2-client-2: reading from socket failed. Error (No data available), peer (10.100.28.99:49155)<br/>
[2013-09-18 09:23:49.068668] I [client.c:2097:client_rpc_notify] 0-vol2-client-2: disconnected<br/>
[2013-09-18 09:23:51.617338] W [socket.c:514:__socket_rwv] 0-vol2-client-3: readv failed (No data available)<br/>
[2013-09-18 09:23:51.839866] W [socket.c:1962:__socket_proto_state_machine] 0-vol2-client-3: reading from socket failed. Error (No data available), peer (127.0.1.1:49155)<br/>
[2013-09-18 09:23:51.839956] I [client.c:2097:client_rpc_notify] 0-vol2-client-3: disconnected<br/>
[2013-09-18 09:23:51.839998] W [socket.c:514:__socket_rwv] 0-vol2-client-1: readv failed (No data available)<br/>
[2013-09-18 09:23:51.840018] W [socket.c:1962:__socket_proto_state_machine] 0-vol2-client-1: reading from socket failed. Error (No data available), peer (10.100.28.95:49157)<br/>
[2013-09-18 09:23:51.840050] I [client.c:2097:client_rpc_notify] 0-vol2-client-1: disconnected<br/>
[2013-09-18 09:23:51.840071] W [socket.c:514:__socket_rwv] 0-vol2-client-0: readv failed (No data available)<br/>
[2013-09-18 09:23:51.840085] W [socket.c:1962:__socket_proto_state_machine] 0-vol2-client-0: reading from socket failed. Error (No data available), peer (10.100.28.96:49157)<br/>
[2013-09-18 09:23:51.840112] I [client.c:2097:client_rpc_notify] 0-vol2-client-0: disconnected<br/>
[2013-09-18 09:28:18.642995] I [glusterfsd.c:1910:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.4.0 (/usr/sbin/glusterfs -s localhost --volfile-id gluster/nfs -p /var/lib/glusterd/nfs/run/nfs.pid -l /var/log/glusterfs/nfs.log -S /var/run/54d646f36ad61604bb40181c3414e72a.socket)<br/>
[2013-09-18 09:28:18.657480] I [socket.c:3480:socket_init] 0-socket.glusterfsd: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.657512] I [socket.c:3495:socket_init] 0-socket.glusterfsd: using system polling thread<br/>
[2013-09-18 09:28:18.657611] I [socket.c:3480:socket_init] 0-glusterfs: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.657622] I [socket.c:3495:socket_init] 0-glusterfs: using system polling thread<br/>
[2013-09-18 09:28:18.758745] I [socket.c:3480:socket_init] 0-socket.nfs-server: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.758794] I [socket.c:3495:socket_init] 0-socket.nfs-server: using system polling thread<br/>
[2013-09-18 09:28:18.777432] I [socket.c:3480:socket_init] 0-socket.nfs-server: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.777463] I [socket.c:3495:socket_init] 0-socket.nfs-server: using system polling thread<br/>
[2013-09-18 09:28:18.778374] I [socket.c:3480:socket_init] 0-socket.nfs-server: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.778401] I [socket.c:3495:socket_init] 0-socket.nfs-server: using system polling thread<br/>
[2013-09-18 09:28:18.778827] I [socket.c:3480:socket_init] 0-socket.NLM: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.778851] I [socket.c:3495:socket_init] 0-socket.NLM: using system polling thread<br/>
[2013-09-18 09:28:18.799436] I [socket.c:3480:socket_init] 0-socket.ACL: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.799488] I [socket.c:3495:socket_init] 0-socket.ACL: using system polling thread<br/>
[2013-09-18 09:28:18.799825] I [nfs.c:844:init] 0-nfs: NFS service started<br/>
[2013-09-18 09:28:18.801611] I [socket.c:3480:socket_init] 0-vol2-client-3: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.801660] I [socket.c:3495:socket_init] 0-vol2-client-3: using system polling thread<br/>
[2013-09-18 09:28:18.802523] I [socket.c:3480:socket_init] 0-vol2-client-2: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.802549] I [socket.c:3495:socket_init] 0-vol2-client-2: using system polling thread<br/>
[2013-09-18 09:28:18.803375] I [socket.c:3480:socket_init] 0-vol2-client-1: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.803402] I [socket.c:3495:socket_init] 0-vol2-client-1: using system polling thread<br/>
[2013-09-18 09:28:18.804226] I [socket.c:3480:socket_init] 0-vol2-client-0: SSL support is NOT enabled<br/>
[2013-09-18 09:28:18.804249] I [socket.c:3495:socket_init] 0-vol2-client-0: using system polling thread<br/>
[2013-09-18 09:28:18.804282] W [graph.c:314:_log_if_unknown_option] 0-nfs-server: option &#39;rpc-auth.auth-glusterfs&#39; is not recognized<br/>
[2013-09-18 09:28:18.804315] W [graph.c:314:_log_if_unknown_option] 0-nfs-server: option &#39;rpc-auth-allow-insecure&#39; is not recognized<br/>
[2013-09-18 09:28:18.804348] W [graph.c:314:_log_if_unknown_option] 0-nfs-server: option &#39;transport-type&#39; is not recognized<br/>
[2013-09-18 09:28:18.804405] I [client.c:2154:notify] 0-vol2-client-0: parent translators are ready, attempting connect on transport<br/>
[2013-09-18 09:28:18.806524] I [client.c:2154:notify] 0-vol2-client-1: parent translators are ready, attempting connect on transport<br/>
[2013-09-18 09:28:18.808010] I [client.c:2154:notify] 0-vol2-client-2: parent translators are ready, attempting connect on transport<br/>
[2013-09-18 09:28:18.809293] I [client.c:2154:notify] 0-vol2-client-3: parent translators are ready, attempting connect on transport<br/>
Given volfile:<br/>
+------------------------------------------------------------------------------+<br/>
&nbsp; 1: volume vol2-client-0<br/>
&nbsp; 2:&nbsp;&nbsp;&nbsp;&nbsp; type protocol/client<br/>
&nbsp; 3:&nbsp;&nbsp;&nbsp;&nbsp; option password 91b3407a-bc87-4d18-8e13-9a76757fc509<br/>
&nbsp; 4:&nbsp;&nbsp;&nbsp;&nbsp; option username 7e69cee6-0b69-4d37-a068-49645e4d3632<br/>
&nbsp; 5:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type tcp<br/>
&nbsp; 6:&nbsp;&nbsp;&nbsp;&nbsp; option remote-subvolume /glusterfs/vol2<br/>
&nbsp; 7:&nbsp;&nbsp;&nbsp;&nbsp; option remote-host node4<br/>
&nbsp; 8: end-volume<br/>
&nbsp; 9:<br/>
&nbsp;10: volume vol2-client-1<br/>
&nbsp;11:&nbsp;&nbsp;&nbsp;&nbsp; type protocol/client<br/>
&nbsp;12:&nbsp;&nbsp;&nbsp;&nbsp; option password 91b3407a-bc87-4d18-8e13-9a76757fc509<br/>
&nbsp;13:&nbsp;&nbsp;&nbsp;&nbsp; option username 7e69cee6-0b69-4d37-a068-49645e4d3632<br/>
&nbsp;14:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type tcp<br/>
&nbsp;15:&nbsp;&nbsp;&nbsp;&nbsp; option remote-subvolume /glusterfs/vol2<br/>
&nbsp;16:&nbsp;&nbsp;&nbsp;&nbsp; option remote-host node2<br/>
&nbsp;17: end-volume<br/>
&nbsp;18:<br/>
&nbsp;19: volume vol2-client-2<br/>
&nbsp;20:&nbsp;&nbsp;&nbsp;&nbsp; type protocol/client<br/>
&nbsp;21:&nbsp;&nbsp;&nbsp;&nbsp; option password 91b3407a-bc87-4d18-8e13-9a76757fc509<br/>
&nbsp;22:&nbsp;&nbsp;&nbsp;&nbsp; option username 7e69cee6-0b69-4d37-a068-49645e4d3632<br/>
&nbsp;23:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type tcp<br/>
&nbsp;24:&nbsp;&nbsp;&nbsp;&nbsp; option remote-subvolume /glusterfs/vol2<br/>
&nbsp;25:&nbsp;&nbsp;&nbsp;&nbsp; option remote-host node3<br/>
&nbsp;26: end-volume<br/>
&nbsp;27:<br/>
&nbsp;28: volume vol2-client-3<br/>
&nbsp;29:&nbsp;&nbsp;&nbsp;&nbsp; type protocol/client<br/>
&nbsp;30:&nbsp;&nbsp;&nbsp;&nbsp; option password 91b3407a-bc87-4d18-8e13-9a76757fc509<br/>
&nbsp;31:&nbsp;&nbsp;&nbsp;&nbsp; option username 7e69cee6-0b69-4d37-a068-49645e4d3632<br/>
&nbsp;32:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type tcp<br/>
&nbsp;33:&nbsp;&nbsp;&nbsp;&nbsp; option remote-subvolume /glusterfs/vol2<br/>
&nbsp;34:&nbsp;&nbsp;&nbsp;&nbsp; option remote-host node1<br/>
&nbsp;35: end-volume<br/>
&nbsp;36:<br/>
&nbsp;37: volume vol2-stripe-0<br/>
&nbsp;38:&nbsp;&nbsp;&nbsp;&nbsp; type cluster/stripe<br/>
&nbsp;39:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-client-0 vol2-client-1 vol2-client-2 vol2-client-3<br/>
&nbsp;40: end-volume<br/>
&nbsp;41:<br/>
&nbsp;42: volume vol2-dht<br/>
&nbsp;43:&nbsp;&nbsp;&nbsp;&nbsp; type cluster/distribute<br/>
&nbsp;44:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-stripe-0<br/>
&nbsp;45: end-volume<br/>
&nbsp;46:<br/>
&nbsp;47: volume vol2-write-behind<br/>
&nbsp;48:&nbsp;&nbsp;&nbsp;&nbsp; type performance/write-behind<br/>
&nbsp;49:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-dht<br/>
&nbsp;50: end-volume<br/>
&nbsp;51:<br/>
&nbsp;52: volume vol2<br/>
&nbsp;53:&nbsp;&nbsp;&nbsp;&nbsp; type debug/io-stats<br/>
&nbsp;54:&nbsp;&nbsp;&nbsp;&nbsp; option count-fop-hits off<br/>
&nbsp;55:&nbsp;&nbsp;&nbsp;&nbsp; option latency-measurement off<br/>
&nbsp;56:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-write-behind<br/>
&nbsp;57: end-volume<br/>
&nbsp;58:<br/>
&nbsp;59: volume nfs-server<br/>
&nbsp;60:&nbsp;&nbsp;&nbsp;&nbsp; type nfs/server<br/>
&nbsp;61:&nbsp;&nbsp;&nbsp;&nbsp; option nfs3.vol2.volume-id b6adce45-ee99-4f2b-bd48-9d7e0fbcb827<br/>
&nbsp;62:&nbsp;&nbsp;&nbsp;&nbsp; option rpc-auth.addr.vol2.allow *<br/>
&nbsp;63:&nbsp;&nbsp;&nbsp;&nbsp; option nfs.nlm on<br/>
&nbsp;64:&nbsp;&nbsp;&nbsp;&nbsp; option nfs.dynamic-volumes on<br/>
&nbsp;65:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2<br/>
&nbsp;66: end-volume</div>

<div>+------------------------------------------------------------------------------+<br/>
[2013-09-18 09:28:18.810623] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-3: changing port to 49155 (from 0)<br/>
[2013-09-18 09:28:18.810721] W [socket.c:514:__socket_rwv] 0-vol2-client-3: readv failed (No data available)<br/>
[2013-09-18 09:28:18.811326] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-2: changing port to 49155 (from 0)<br/>
[2013-09-18 09:28:18.811437] W [socket.c:514:__socket_rwv] 0-vol2-client-2: readv failed (No data available)<br/>
[2013-09-18 09:28:18.812998] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-3: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:28:18.813125] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-0: changing port to 49157 (from 0)<br/>
[2013-09-18 09:28:18.813165] W [socket.c:514:__socket_rwv] 0-vol2-client-0: readv failed (No data available)<br/>
[2013-09-18 09:28:18.814747] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-3: Connected to 127.0.1.1:49155, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:28:18.814780] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-3: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:28:18.815017] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-3: Server lk version = 1<br/>
[2013-09-18 09:28:18.815072] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-2: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:28:18.815432] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:28:18.815558] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-2: Connected to 10.100.28.99:49155, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:28:18.815586] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-2: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:28:18.815993] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-2: Server lk version = 1<br/>
[2013-09-18 09:28:18.816104] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-0: Connected to 10.100.28.96:49157, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:28:18.816130] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-0: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:28:18.816561] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-0: Server lk version = 1<br/>
[2013-09-18 09:28:19.144684] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-vol2-client-1: changing port to 49157 (from 0)<br/>
[2013-09-18 09:28:19.144738] W [socket.c:514:__socket_rwv] 0-vol2-client-1: readv failed (No data available)<br/>
[2013-09-18 09:28:19.153116] I [client-handshake.c:1658:select_server_supported_programs] 0-vol2-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)<br/>
[2013-09-18 09:28:19.153832] I [client-handshake.c:1456:client_setvolume_cbk] 0-vol2-client-1: Connected to 10.100.28.95:49157, attached to remote volume &#39;/glusterfs/vol2&#39;.<br/>
[2013-09-18 09:28:19.153864] I [client-handshake.c:1468:client_setvolume_cbk] 0-vol2-client-1: Server and Client lk-version numbers are not same, reopening the fds<br/>
[2013-09-18 09:28:19.154638] I [client-handshake.c:450:client_set_lk_version_cbk] 0-vol2-client-1: Server lk version = 1</div>

<div>&nbsp;</div>

<pre>brick log glusterfs-vol2.log</pre>

<div>+------------------------------------------------------------------------------+<br/>
[2013-09-18 09:21:09.195521] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node1-8378-2013/09/18-08:37:36:361631-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:21:09.200276] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node1-4145-2013/09/18-09:21:39:495394-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:21:09.200455] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node219437-2013/09/18-08:52:28:929975-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:21:09.244417] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node314971-2013/09/18-09:21:09:192018-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:21:09.256680] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node411356-2013/09/18-09:20:21:293412-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:21:09.433451] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node14936-2013/09/18-09:20:10:806010-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:23:50.613589] I [server.c:762:server_rpc_notify] 0-vol2-server: disconnecting connectionfrom node3 4145-2013/09/18-09:21:39:495394-vol2-client-3-0<br/>
[2013-09-18 09:23:50.613629] I [server-helpers.c:726:server_connection_put] 0-vol2-server: Shutting down connection node3-4145-2013/09/18-09:21:39:495394-vol2-client-3-0<br/>
[2013-09-18 09:23:50.613660] I [server-helpers.c:614:server_connection_destroy] 0-vol2-server: destroyed connection of node4-4145-2013/09/18-09:21:39:495394-vol2-client-3-0<br/>
[2013-09-18 09:23:51.614435] W [glusterfsd.c:1002:cleanup_and_exit] (--&gt;/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f7469de3a7d] (--&gt;/lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7f746a47db50] (--&gt;/usr/sbin/glusterfsd(glusterfs_sigwaiter+0xd5) [0x7f746af6f545]))) 0-: received signum (15), shutting down<br/>
[2013-09-18 09:23:51.614536] W [glusterfsd.c:1002:cleanup_and_exit] (--&gt;/lib/x86_64-linux-gnu/libc.so.6(+0x43020) [0x7f7469d4c020] (--&gt;/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(synctask_wrap+0x12) [0x7f746ab0be12] (--&gt;/usr/sbin/glusterfsd(glusterfs_handle_terminate+0x15) [0x7f746af716a5]))) 0-: received signum (15), shutting down<br/>
[2013-09-18 09:28:16.879709] I [glusterfsd.c:1910:main] 0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version 3.4.0 (/usr/sbin/glusterfsd -s node4 --volfile-id vol2.node2.glusterfs-vol2 -p /var/lib/glusterd/vols/vol2/run/node3-glusterfs-vol2.pid -S /var/run/cf49f06a33087f2fd52fe54d1d70fbdd.socket --brick-name /glusterfs/vol2 -l /var/log/glusterfs/bricks/glusterfs-vol2.log --xlator-option *-posix.glusterd-uuid=7088470c-955b-4d1b-bc83-ec3d1925adec --brick-port 49155 --xlator-option vol2-server.listen-port=49155)<br/>
[2013-09-18 09:28:16.907192] I [socket.c:3480:socket_init] 0-socket.glusterfsd: SSL support is NOT enabled<br/>
[2013-09-18 09:28:16.907251] I [socket.c:3495:socket_init] 0-socket.glusterfsd: using system polling thread<br/>
[2013-09-18 09:28:16.907434] I [socket.c:3480:socket_init] 0-glusterfs: SSL support is NOT enabled<br/>
[2013-09-18 09:28:16.907458] I [socket.c:3495:socket_init] 0-glusterfs: using system polling thread<br/>
[2013-09-18 09:28:17.035492] I [graph.c:239:gf_add_cmdline_options] 0-vol2-server: adding option &#39;listen-port&#39; for volume &#39;vol2-server&#39; with value &#39;49155&#39;<br/>
[2013-09-18 09:28:17.035520] I [graph.c:239:gf_add_cmdline_options] 0-vol2-posix: adding option &#39;glusterd-uuid&#39; for volume &#39;vol2-posix&#39; with value &#39;7088470c-955b-4d1b-bc83-ec3d1925adec&#39;<br/>
[2013-09-18 09:28:17.038055] W [options.c:848:xl_opt_validate] 0-vol2-server: option &#39;listen-port&#39; is deprecated, preferred is &#39;transport.socket.listen-port&#39;, continuing with correction<br/>
[2013-09-18 09:28:17.038122] I [socket.c:3480:socket_init] 0-tcp.vol2-server: SSL support is NOT enabled<br/>
[2013-09-18 09:28:17.038137] I [socket.c:3495:socket_init] 0-tcp.vol2-server: using system polling thread<br/>
Given volfile:<br/>
+------------------------------------------------------------------------------+<br/>
&nbsp; 1: volume vol2-posix<br/>
&nbsp; 2:&nbsp;&nbsp;&nbsp;&nbsp; type storage/posix<br/>
&nbsp; 3:&nbsp;&nbsp;&nbsp;&nbsp; option volume-id b6adce45-ee99-4f2b-bd48-9d7e0fbcb827<br/>
&nbsp; 4:&nbsp;&nbsp;&nbsp;&nbsp; option directory /glusterfs/vol2<br/>
&nbsp; 5: end-volume<br/>
&nbsp; 6:<br/>
&nbsp; 7: volume vol2-access-control<br/>
&nbsp; 8:&nbsp;&nbsp;&nbsp;&nbsp; type features/access-control<br/>
&nbsp; 9:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-posix<br/>
&nbsp;10: end-volume<br/>
&nbsp;11:<br/>
&nbsp;12: volume vol2-locks<br/>
&nbsp;13:&nbsp;&nbsp;&nbsp;&nbsp; type features/locks<br/>
&nbsp;14:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-access-control<br/>
&nbsp;15: end-volume<br/>
&nbsp;16:<br/>
&nbsp;17: volume vol2-io-threads<br/>
&nbsp;18:&nbsp;&nbsp;&nbsp;&nbsp; type performance/io-threads<br/>
&nbsp;19:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-locks<br/>
&nbsp;20: end-volume<br/>
&nbsp;21:<br/>
&nbsp;22: volume vol2-index<br/>
&nbsp;23:&nbsp;&nbsp;&nbsp;&nbsp; type features/index<br/>
&nbsp;24:&nbsp;&nbsp;&nbsp;&nbsp; option index-base /glusterfs/vol2/.glusterfs/indices<br/>
&nbsp;25:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-io-threads<br/>
&nbsp;26: end-volume<br/>
&nbsp;27:<br/>
&nbsp;28: volume vol2-marker<br/>
&nbsp;29:&nbsp;&nbsp;&nbsp;&nbsp; type features/marker<br/>
&nbsp;30:&nbsp;&nbsp;&nbsp;&nbsp; option quota off<br/>
&nbsp;31:&nbsp;&nbsp;&nbsp;&nbsp; option xtime off<br/>
&nbsp;32:&nbsp;&nbsp;&nbsp;&nbsp; option timestamp-file /var/lib/glusterd/vols/vol2/marker.tstamp<br/>
&nbsp;33:&nbsp;&nbsp;&nbsp;&nbsp; option volume-uuid b6adce45-ee99-4f2b-bd48-9d7e0fbcb827<br/>
&nbsp;34:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-index<br/>
&nbsp;35: end-volume<br/>
&nbsp;36:<br/>
&nbsp;37: volume /glusterfs/vol2<br/>
&nbsp;38:&nbsp;&nbsp;&nbsp;&nbsp; type debug/io-stats<br/>
&nbsp;39:&nbsp;&nbsp;&nbsp;&nbsp; option count-fop-hits off<br/>
&nbsp;40:&nbsp;&nbsp;&nbsp;&nbsp; option latency-measurement off<br/>
&nbsp;41:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes vol2-marker<br/>
&nbsp;42: end-volume<br/>
&nbsp;43:<br/>
&nbsp;44: volume vol2-server<br/>
&nbsp;45:&nbsp;&nbsp;&nbsp;&nbsp; type protocol/server<br/>
&nbsp;46:&nbsp;&nbsp;&nbsp;&nbsp; option auth.addr./glusterfs/vol2.allow *<br/>
&nbsp;47:&nbsp;&nbsp;&nbsp;&nbsp; option auth.login.7e69cee6-0b69-4d37-a068-49645e4d3632.password 91b3407a-bc87-4d18-8e13-9a76757fc509<br/>
&nbsp;48:&nbsp;&nbsp;&nbsp;&nbsp; option auth.login./glusterfs/vol2.allow 7e69cee6-0b69-4d37-a068-49645e4d3632<br/>
&nbsp;49:&nbsp;&nbsp;&nbsp;&nbsp; option transport-type tcp<br/>
&nbsp;50:&nbsp;&nbsp;&nbsp;&nbsp; subvolumes /glusterfs/vol2<br/>
&nbsp;51: end-volume</div>

<div>+------------------------------------------------------------------------------+<br/>
[2013-09-18 09:28:18.639745] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node1-19437-2013/09/18-08:52:28:929975-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:28:18.644421] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node2-8378-2013/09/18-08:37:36:361631-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:28:18.739752] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node3-2966-2013/09/18-09:27:30:999387-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:28:18.813289] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node4-2968-2013/09/18-09:28:18:637310-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:28:19.306136] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node2-2899-2013/09/18-09:27:21:89775-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:28:20.854799] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from node3-2998-2013/09/18-09:28:48:994413-vol2-client-3-0 (version: 3.4.0)<br/>
[2013-09-18 09:40:28.436226] I [server.c:762:server_rpc_notify] 0-vol2-server: disconnecting connectionfrom client1-19437-2013/09/18-08:52:28:929975-vol2-client-3-0<br/>
[2013-09-18 09:40:28.436279] I [server-helpers.c:726:server_connection_put] 0-vol2-server: Shutting down connection client1-19437-2013/09/18-08:52:28:929975-vol2-client-3-0<br/>
[2013-09-18 09:40:28.436311] I [server-helpers.c:614:server_connection_destroy] 0-vol2-server: destroyed connection of client1-19437-2013/09/18-08:52:28:929975-vol2-client-3-0<br/>
[2013-09-18 09:40:37.850585] I [server-handshake.c:567:server_setvolume] 0-vol2-server: accepted client from client1-22402-2013/09/18-09:41:24:57138-vol2-client-3-0 (version: 3.4.0)</div>

<pre>does this help more?

------------
Dragon,

Could you attach the brick and client log files? This information
is not sufficient. The error messages in etc-glusterfs.. log regarding
actor error makes me believe that the client volfile is pointing to
glusterd (management daemon) to be the brick process. So, it would
help if you provide the entire client and brick log files.

thanks,
krish</pre>
</div></div></body></html>