Steve,<br> In 1.4.0 pre-releases protocol is undergoing changes and compatibility across different versions of client and servers is not guaranteed untill stable release.<br><br> You can try running both client and server with same pre-release version of glusterfs.<br>
<br>--<br>gowda<br><br><div class="gmail_quote">On Wed, Nov 12, 2008 at 1:12 AM, Steve <span dir="ltr"><<a href="mailto:steeeeeveee@gmx.net">steeeeeveee@gmx.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
I have two GlusterFS servers. One is called nemesis (has IP <a href="http://192.168.0.145" target="_blank">192.168.0.145</a>) and the other is called spock (has IP <a href="http://192.168.0.115" target="_blank">192.168.0.115</a>).<br>
<br>
I have updated GlusterFS on nemesis to 1.4.0_pre9 and left 1.4.0_pre5 on spock. After starting GlusterFS server on nemesis I get this error:<br>
---<br>
nemesis glusterfs # glusterfsd --no-daemon --log-file=/dev/stdout --log-level=DEBUG --volume-specfile=/etc/glusterfs/glusterfs-server.vol<br>
2008-11-11 20:14:52 D [glusterfs.c:291:_get_specfp] glusterfs: loading volume specfile /etc/glusterfs/glusterfs-server.vol<br>
<br>
Version : glusterfs 1.4.0pre9 built on Nov 11 2008 20:08:50<br>
TLA Revision : glusterfs--mainline--3.0--patch-591<br>
Starting Time: 2008-11-11 20:14:52<br>
Command line : glusterfsd --no-daemon --log-file=/dev/stdout --log-level=DEBUG --volume-specfile=/etc/glusterfs/glusterfs-server.vol<br>
given volume specfile<br>
+-----<br>
1: ##############################################<br>
2: ### GlusterFS Server Volume Specification ##<br>
3: ### NEMESIS ##<br>
4: ##############################################<br>
5:<br>
6: # dataspace on local<br>
7: volume gfs-ds<br>
8: type storage/posix # POSIX FS translator<br>
9: option directory /local/gfs-brick001 # Export this directoy<br>
10: end-volume<br>
11:<br>
12: # posix locks on local<br>
13: volume gfs-ds-locks<br>
14: type features/posix-locks<br>
15: subvolumes gfs-ds<br>
16: option mandatory on # Enables mandatory locking on all files<br>
17: end-volume<br>
18:<br>
19: # dataspace on remote<br>
20: volume gfs-remote-ds<br>
21: type protocol/client<br>
22: option transport-type tcp/client # For TCP/IP transport<br>
23: option remote-host <a href="http://192.168.0.115" target="_blank">192.168.0.115</a> # IP address of the remote storage<br>
24: option remote-port 6996 # Default is 6996<br>
25: option remote-subvolume gfs-ds-locks # Remote dataspace<br>
26: option transport-timeout 10 # Value in seconds; it should be set relatively low<br>
27: end-volume<br>
28:<br>
29: # automatic file replication translator for dataspace<br>
30: volume gfs-ds-afr<br>
31: type cluster/afr<br>
32: subvolumes gfs-ds-locks gfs-remote-ds # Local and remote dataspaces<br>
33: end-volume<br>
34:<br>
35: # the actual exported volume<br>
36: volume gfs<br>
37: type performance/io-threads<br>
38: option thread-count 8 # Deault is 1<br>
39: option cache-size 64MB # Default is 64MB<br>
40: subvolumes gfs-ds-afr<br>
41: end-volume<br>
42:<br>
43: # server declaration<br>
44: volume server<br>
45: type protocol/server<br>
46: option transport-type tcp/server # For TCP/IP transport<br>
47: option listen-port 6996 # Default is 6996<br>
48: subvolumes gfs<br>
49: # storage network access only<br>
50: option auth.addr.gfs-ds-locks.allow <a href="http://192.168.0." target="_blank">192.168.0.</a>*,<a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br>
51: option auth.addr.gfs.allow <a href="http://192.168.0." target="_blank">192.168.0.</a>*<br>
52: end-volume<br>
+-----<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'gfs-ds'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:gfs-ds:storage/posix<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-ds:directory:/local/gfs-brick001<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-ds<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'gfs-ds-locks'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so<br>
2008-11-11 20:14:52 D [xlator.c:407:xlator_set_type] xlator: dlsym(notify) on /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so: undefined symbol: notify -- neglecting<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:gfs-ds-locks:features/posix-locks<br>
2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: child:gfs-ds-locks->gfs-ds<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-ds-locks:mandatory:on<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-ds-locks<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'gfs-remote-ds'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:gfs-remote-ds:protocol/client<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-remote-ds:transport-type:tcp/client<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-remote-ds:remote-host:<a href="http://192.168.0.115" target="_blank">192.168.0.115</a><br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-remote-ds:remote-port:6996<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-remote-ds:remote-subvolume:gfs-ds-locks<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs-remote-ds:transport-timeout:10<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-remote-ds<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'gfs-ds-afr'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:gfs-ds-afr:cluster/afr<br>
2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: child:gfs-ds-afr->gfs-ds-locks<br>
2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: child:gfs-ds-afr->gfs-remote-ds<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs-ds-afr<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'gfs'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so<br>
2008-11-11 20:14:52 D [xlator.c:407:xlator_set_type] xlator: dlsym(notify) on /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so: undefined symbol: notify -- neglecting<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:gfs:performance/io-threads<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs:thread-count:8<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:gfs:cache-size:64MB<br>
2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: child:gfs->gfs-ds-afr<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:gfs<br>
2008-11-11 20:14:52 D [spec.y:178:new_section] parser: New node for 'server'<br>
2008-11-11 20:14:52 D [xlator.c:367:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so<br>
2008-11-11 20:14:52 D [spec.y:202:section_type] parser: Type:server:protocol/server<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:server:transport-type:tcp/server<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:server:listen-port:6996<br>
2008-11-11 20:14:52 D [spec.y:335:section_sub] parser: child:server->gfs<br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:server:auth.addr.gfs-ds-locks.allow:<a href="http://192.168.0." target="_blank">192.168.0.</a>*,<a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br>
2008-11-11 20:14:52 D [spec.y:268:section_option] parser: Option:server:auth.addr.gfs.allow:<a href="http://192.168.0." target="_blank">192.168.0.</a>*<br>
2008-11-11 20:14:52 D [spec.y:350:section_end] parser: end:server<br>
2008-11-11 20:14:52 D [glusterfs.c:814:main] glusterfs: running in pid 19898<br>
<br>
2008-11-11 20:14:52 D [transport.c:104:transport_load] transport: attempt to load file /usr/lib/glusterfs/1.4.0pre9/transport/socket.so<br>
2008-11-11 20:14:52 D [server-protocol.c:7367:init] server: defaulting limits.transaction-size to 4194304<br>
2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds: Initialization done<br>
2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds-locks: Initialization done<br>
2008-11-11 20:14:52 D [client-protocol.c:4988:init] gfs-remote-ds: setting transport-timeout to 10<br>
2008-11-11 20:14:52 D [transport.c:104:transport_load] transport: attempt to load file /usr/lib/glusterfs/1.4.0pre9/transport/socket.so<br>
2008-11-11 20:14:52 D [client-protocol.c:5032:init] gfs-remote-ds: defaulting limits.transaction-size to 268435456<br>
2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-remote-ds: Initialization done<br>
2008-11-11 20:14:52 D [xlator.c:491:xlator_init_rec] gfs-ds-afr: Initialization done<br>
2008-11-11 20:14:52 D [io-threads.c:1174:init] io-threads: Using conf->thread_count = 8<br>
2008-11-11 20:14:52 D [io-threads.c:1203:init] io-threads: Using conf->cache_size = 67108864<br>
2008-11-11 20:14:52 D [client-protocol.c:5264:notify] gfs-remote-ds: got GF_EVENT_PARENT_UP, attempting connect on transport<br>
2008-11-11 20:14:52 D [client-protocol.c:5264:notify] gfs-remote-ds: got GF_EVENT_PARENT_UP, attempting connect on transport<br>
2008-11-11 20:14:52 D [client-protocol.c:4680:client_protocol_reconnect] gfs-remote-ds: attempting reconnect<br>
2008-11-11 20:14:52 D [common-utils.c:213:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: <a href="http://192.168.0.115" target="_blank">192.168.0.115</a><br>
2008-11-11 20:14:52 D [common-utils.c:250:gf_resolve_ip6] resolver: returning ip-192.168.0.115 (port-6996) for hostname: <a href="http://192.168.0.115" target="_blank">192.168.0.115</a> and port: 6996<br>
2008-11-11 20:14:52 D [client-protocol.c:5301:notify] gfs-remote-ds: got GF_EVENT_CHILD_UP<br>
2008-11-11 20:14:52 D [socket.c:924:socket_connect] gfs-remote-ds: connect () called on transport already connected<br>
2008-11-11 20:14:52 W [common-utils.c:156:gf_print_bytes] glusterfs: Total data (in bytes): transfered (258), received (152)<br>
pending frames:<br>
frame : type(2) op(0)<br>
<br>
Signal received: 11<br>
configuration details:argp 1<br>
backtrace 1<br>
dlfcn 1<br>
fdatasync 1<br>
libpthread 1<br>
llistxattr 1<br>
setfsid 1<br>
spinlock 1<br>
epoll.h 1<br>
xattr.h 1<br>
tv_nsec 1<br>
package-string: glusterfs 1.4.0pre9<br>
[0xb7ef9400]<br>
/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(protocol_client_interpret+0x1c1)[0xb7cceb27]<br>
/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(protocol_client_pollin+0xe4)[0xb7ccf56f]<br>
/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so(notify+0x73)[0xb7ccf608]<br>
/usr/lib/glusterfs/1.4.0pre9/transport/socket.so[0xb746f97d]<br>
/usr/lib/glusterfs/1.4.0pre9/transport/socket.so[0xb746fc7c]<br>
/usr/lib/libglusterfs.so.0[0xb7ee4036]<br>
/usr/lib/libglusterfs.so.0(event_dispatch+0x7a)[0xb7ee435a]<br>
glusterfsd(main+0xd97)[0x804bab8]<br>
/lib/libc.so.6(__libc_start_main+0xfa)[0xb7d4a42a]<br>
---------<br>
Segmentation fault (core dumped)<br>
nemesis glusterfs #<br>
---<br>
<br>
<br>
<br>
This is the full stacktrace of the dumped core on nemesis:<br>
---<br>
nemesis glusterfs # gdb /usr/sbin/glusterfsd /var/tmp/19898<br>
GNU gdb 6.8<br>
Copyright (C) 2008 Free Software Foundation, Inc.<br>
License GPLv3+: GNU GPL version 3 or later <<a href="http://gnu.org/licenses/gpl.html" target="_blank">http://gnu.org/licenses/gpl.html</a>><br>
This is free software: you are free to change and redistribute it.<br>
There is NO WARRANTY, to the extent permitted by law. Type "show copying"<br>
and "show warranty" for details.<br>
This GDB was configured as "i686-pc-linux-gnu"...<br>
<br>
warning: Can't read pathname for load map: Input/output error.<br>
Reading symbols from /usr/lib/libglusterfs.so.0...Reading symbols from /usr/lib/debug/usr/lib/libglusterfs.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/libglusterfs.so.0<br>
Reading symbols from /lib/libdl.so.2...Reading symbols from /usr/lib/debug/lib/libdl-2.7.so.debug...done.<br>
done.<br>
Loaded symbols for /lib/libdl.so.2<br>
Reading symbols from /lib/libpthread.so.0...Reading symbols from /usr/lib/debug/lib/libpthread-2.7.so.debug...done.<br>
done.<br>
Loaded symbols for /lib/libpthread.so.0<br>
Reading symbols from /lib/libc.so.6...Reading symbols from /usr/lib/debug/lib/libc-2.7.so.debug...done.<br>
done.<br>
Loaded symbols for /lib/libc.so.6<br>
Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.7.so.debug...done.<br>
done.<br>
Loaded symbols for /lib/ld-linux.so.2<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/storage/posix.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/features/posix-locks.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/client.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/cluster/afr.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/performance/io-threads.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/xlator/protocol/server.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/transport/socket.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/transport/socket.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/transport/socket.so<br>
Reading symbols from /usr/lib/glusterfs/1.4.0pre9/auth/addr.so...Reading symbols from /usr/lib/debug/usr/lib/glusterfs/1.4.0pre9/auth/addr.so.0.0.0.debug...done.<br>
done.<br>
Loaded symbols for /usr/lib/glusterfs/1.4.0pre9/auth/addr.so<br>
Reading symbols from /lib/libnss_files.so.2...Reading symbols from /usr/lib/debug/lib/libnss_files-2.7.so.debug...done.<br>
done.<br>
Loaded symbols for /lib/libnss_files.so.2<br>
Reading symbols from /usr/lib/gcc/i686-pc-linux-gnu/4.3.2/libgcc_s.so.1...done.<br>
Loaded symbols for /usr/lib/gcc/i686-pc-linux-gnu/4.3.2/libgcc_s.so.1<br>
Core was generated by `glusterfsd --no-daemon --log-file=/dev/stdout --log-level=DEBUG --volume-specfi'.<br>
Program terminated with signal 11, Segmentation fault.<br>
[New process 19898]<br>
[New process 19907]<br>
[New process 19901]<br>
[New process 19902]<br>
[New process 19903]<br>
[New process 19904]<br>
[New process 19900]<br>
[New process 19905]<br>
[New process 19906]<br>
[New process 19899]<br>
#0 0xb7ccab4c in client_stat_cbk (frame=0x805ac80, hdr=0x805ab88, hdrlen=140, buf=0x0, buflen=0) at client-protocol.c:3085<br>
3085 client-protocol.c: No such file or directory.<br>
in client-protocol.c<br>
(gdb) bt full<br>
#0 0xb7ccab4c in client_stat_cbk (frame=0x805ac80, hdr=0x805ab88, hdrlen=140, buf=0x0, buflen=0) at client-protocol.c:3085<br>
fn = (ret_fn_t) 0<br>
_parent = (call_frame_t *) 0x0<br>
stbuf = {st_dev = 0, __pad1 = 0, __st_ino = 0, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0, st_rdev = 0,<br>
__pad2 = 0, st_size = 0, st_blksize = 0, st_blocks = 0, st_atim = {tv_sec = 0, tv_nsec = 0}, st_mtim = {tv_sec = 0,<br>
tv_nsec = 0}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_ino = 0}<br>
rsp = (gf_fop_stat_rsp_t *) 0x805aba8<br>
op_ret = -1<br>
op_errno = 22<br>
#1 0xb7cceb27 in protocol_client_interpret (this=0x80552c0, trans=0x8057818, hdr_p=0x805ab88 "", hdrlen=140, buf_p=0x0,<br>
buflen=0) at client-protocol.c:4929<br>
ret = -1<br>
frame = (call_frame_t *) 0x805ac80<br>
hdr = (gf_hdr_common_t *) 0x805ab88<br>
callid = 2<br>
type = 4<br>
op = 0<br>
__FUNCTION__ = "protocol_client_interpret"<br>
#2 0xb7ccf56f in protocol_client_pollin (this=0x80552c0, trans=0x8057818) at client-protocol.c:5165<br>
priv = (client_proto_priv_t *) 0x8057a88<br>
ret = 0<br>
buf = 0x0<br>
buflen = 0<br>
hdr = 0x805ab88 ""<br>
hdrlen = 140<br>
connected = 0<br>
#3 0xb7ccf608 in notify (this=0x80552c0, event=2, data=0x8057818) at client-protocol.c:5207<br>
priv = (client_proto_priv_t *) 0x80500c8<br>
ret = -1<br>
trans = (transport_t *) 0x8057818<br>
__FUNCTION__ = "notify"<br>
#4 0xb746f97d in socket_event_poll_in (this=0x8057818) at socket.c:678<br>
ret = 0<br>
#5 0xb746fc7c in socket_event_handler (fd=7, idx=1, data=0x8057818, poll_in=1, poll_out=0, poll_err=0) at socket.c:778<br>
this = (transport_t *) 0x8057818<br>
priv = (socket_private_t *) 0x8057b28<br>
ret = 0<br>
#6 0xb7ee4036 in event_dispatch_epoll (event_pool=0x80500c8) at event.c:853<br>
event_data = (struct event_data *) 0x80595cc<br>
handler = (event_handler_t) 0xb746fbd7 <socket_event_handler><br>
data = (void *) 0x8057818<br>
idx = 1<br>
events = (struct epoll_event *) 0x80595c8<br>
---Type <return> to continue, or q <return> to quit---<br>
size = 1<br>
i = 0<br>
ret = 1<br>
__FUNCTION__ = "event_dispatch_epoll"<br>
#7 0xb7ee435a in event_dispatch (event_pool=0x80500c8) at event.c:959<br>
__FUNCTION__ = "event_dispatch"<br>
#8 0x0804bab8 in main (argc=5, argv=0xbfb18694) at glusterfs.c:835<br>
rv = 0<br>
ctx = (glusterfs_ctx_t *) 0x8050008<br>
cmd_args = (cmd_args_t *) 0x8050008<br>
pool = (call_pool_t *) 0x8050140<br>
stbuf = {st_dev = 3216082440, __pad1 = 34300, __st_ino = 0, st_mode = 0, st_nlink = 0, st_uid = 0, st_gid = 0,<br>
st_rdev = 0, __pad2 = 0, st_size = -5192203587464100288, st_blksize = 134516962, st_blocks = 1, st_atim = {tv_sec = 0,<br>
tv_nsec = 0}, st_mtim = {tv_sec = 0, tv_nsec = 0}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_ino = 0}<br>
tmp_logfile = '\0' <repeats 1023 times><br>
timestr = '\0' <repeats 255 times><br>
base_exec_name = 0x80500a8 "/dev/stdout"<br>
utime = 0<br>
tm = (struct tm *) 0x0<br>
ret = 0<br>
lim = {rlim_cur = 18446744073709551615, rlim_max = 18446744073709551615}<br>
specfp = (FILE *) 0x8050390<br>
graph = (xlator_t *) 0x8056498<br>
trav = (xlator_t *) 0x8056498<br>
fuse_volume_found = 0<br>
server_or_fuse_found = 1<br>
__FUNCTION__ = "main"<br>
(gdb) quit<br>
nemesis glusterfs #<br>
---<br>
<br>
<br>
<br>
On the second node where I run GlusterFS server (host spock) I get this debug output while running the server and attempting to connect from nemesis:<br>
----<br>
mail ~ # glusterfsd --no-daemon --log-file=/dev/stdout --log-level=DEBUG --volume-specfile=/etc/glusterfs/glusterfs-server.vol<br>
2008-11-11 20:23:10 D [glusterfs.c:271:_get_specfp] glusterfsd: loading volume specfile /etc/glusterfs/glusterfs-server.vol<br>
<br>
Version : glusterfs 1.4.0pre5 built on Nov 6 2008 16:26:05<br>
TLA Revision : glusterfs--mainline--3.0--patch-359<br>
Starting Time: 2008-11-11 20:23:10<br>
Command line : glusterfsd --no-daemon --log-file=/dev/stdout --log-level=DEBUG --volume-specfile=/etc/glusterfs/glusterfs-server.vol<br>
given volume specfile<br>
+-----<br>
1: ##############################################<br>
2: ### GlusterFS Server Volume Specification ##<br>
3: ### SPOCK ##<br>
4: ##############################################<br>
5:<br>
6: # dataspace on local<br>
7: volume gfs-ds<br>
8: type storage/posix # POSIX FS translator<br>
9: option directory /local/gfs-brick001 # Export this directoy<br>
10: end-volume<br>
11:<br>
12: # posix locks on local<br>
13: volume gfs-ds-locks<br>
14: type features/posix-locks<br>
15: subvolumes gfs-ds<br>
16: option mandatory on # Enables mandatory locking on all files<br>
17: end-volume<br>
18:<br>
19: # dataspace on remote<br>
20: volume gfs-remote-ds<br>
21: type protocol/client<br>
22: option transport-type tcp/client # For TCP/IP transport<br>
23: option remote-host <a href="http://192.168.0.145" target="_blank">192.168.0.145</a> # IP address of the remote storage<br>
24: option remote-port 6996 # Default is 6996<br>
25: option remote-subvolume gfs-ds-locks # Remote dataspace<br>
26: option transport-timeout 10 # Value in seconds; it should be set relatively low<br>
27: end-volume<br>
28:<br>
29: # automatic file replication translator for dataspace<br>
30: volume gfs-ds-afr<br>
31: type cluster/afr<br>
32: subvolumes gfs-ds-locks gfs-remote-ds # Local and remote dataspaces<br>
33: end-volume<br>
34:<br>
35: # the actual exported volume<br>
36: volume gfs<br>
37: type performance/io-threads<br>
38: option thread-count 8 # Deault is 1<br>
39: option cache-size 64MB # Default is 64MB<br>
40: subvolumes gfs-ds-afr<br>
41: end-volume<br>
42:<br>
43: # server declaration<br>
44: volume server<br>
45: type protocol/server<br>
46: option transport-type tcp/server # For TCP/IP transport<br>
47: option listen-port 6996 # Default is 6996<br>
48: subvolumes gfs<br>
49: # storage network access only<br>
50: option auth.addr.gfs-ds-locks.allow <a href="http://192.168.0." target="_blank">192.168.0.</a>*,<a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br>
51: option auth.addr.gfs.allow <a href="http://192.168.0." target="_blank">192.168.0.</a>*<br>
52: end-volume<br>
+-----<br>
2008-11-11 20:23:10 D [spec.y:194:new_section] parser: New node for 'gfs-ds'<br>
2008-11-11 20:23:10 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/storage/posix.so<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:gfs-ds:storage/posix<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-ds:directory:/local/gfs-brick001<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-ds<br>
2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for 'gfs-ds-locks'<br>
2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/features/posix-locks.so<br>
2008-11-11 20:23:11 D [xlator.c:318:xlator_set_type] gfs-ds-locks: dlsym(notify) on /usr/lib/glusterfs/1.4.0pre5/xlator/features/posix-locks.so: undefined symbol: notify -- neglecting<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:gfs-ds-locks:features/posix-locks<br>
2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: child:gfs-ds-locks->gfs-ds<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-ds-locks:mandatory:on<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-ds-locks<br>
2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for 'gfs-remote-ds'<br>
2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/protocol/client.so<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:gfs-remote-ds:protocol/client<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-remote-ds:transport-type:tcp/client<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-remote-ds:remote-host:<a href="http://192.168.0.145" target="_blank">192.168.0.145</a><br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-remote-ds:remote-port:6996<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-remote-ds:remote-subvolume:gfs-ds-locks<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs-remote-ds:transport-timeout:10<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-remote-ds<br>
2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for 'gfs-ds-afr'<br>
2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/cluster/afr.so<br>
2008-11-11 20:23:11 D [xlator.c:324:xlator_set_type] gfs-ds-afr: strict option validation is not enforced -- neglecting<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:gfs-ds-afr:cluster/afr<br>
2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: child:gfs-ds-afr->gfs-ds-locks<br>
2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: child:gfs-ds-afr->gfs-remote-ds<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs-ds-afr<br>
2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for 'gfs'<br>
2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/performance/io-threads.so<br>
2008-11-11 20:23:11 D [xlator.c:318:xlator_set_type] gfs: dlsym(notify) on /usr/lib/glusterfs/1.4.0pre5/xlator/performance/io-threads.so: undefined symbol: notify -- neglecting<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:gfs:performance/io-threads<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs:thread-count:8<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:gfs:cache-size:64MB<br>
2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: child:gfs->gfs-ds-afr<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:gfs<br>
2008-11-11 20:23:11 D [spec.y:194:new_section] parser: New node for 'server'<br>
2008-11-11 20:23:11 D [xlator.c:289:xlator_set_type] xlator: attempt to load file /usr/lib/glusterfs/1.4.0pre5/xlator/protocol/server.so<br>
2008-11-11 20:23:11 D [spec.y:219:section_type] parser: Type:server:protocol/server<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:server:transport-type:tcp/server<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:server:listen-port:6996<br>
2008-11-11 20:23:11 D [spec.y:352:section_sub] parser: child:server->gfs<br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:server:auth.addr.gfs-ds-locks.allow:<a href="http://192.168.0." target="_blank">192.168.0.</a>*,<a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br>
2008-11-11 20:23:11 D [spec.y:285:section_option] parser: Option:server:auth.addr.gfs.allow:<a href="http://192.168.0." target="_blank">192.168.0.</a>*<br>
2008-11-11 20:23:11 D [spec.y:367:section_end] parser: end:server<br>
2008-11-11 20:23:11 D [glusterfs.c:771:main] glusterfsd: running in pid 17646<br>
<br>
2008-11-11 20:23:11 D [transport.c:104:transport_load] transport: attempt to load file /usr/lib/glusterfs/1.4.0pre5/transport/socket.so<br>
2008-11-11 20:23:11 D [server-protocol.c:6267:init] server: defaulting limits.transaction-size to 4194304<br>
2008-11-11 20:23:11 D [client-protocol.c:4383:init] gfs-remote-ds: setting transport-timeout to 10<br>
2008-11-11 20:23:11 D [transport.c:104:transport_load] transport: attempt to load file /usr/lib/glusterfs/1.4.0pre5/transport/socket.so<br>
2008-11-11 20:23:11 D [client-protocol.c:4427:init] gfs-remote-ds: defaulting limits.transaction-size to 268435456<br>
2008-11-11 20:23:11 D [afr.c:6397:init] gfs-ds-afr: self-heal is enabled (default)<br>
2008-11-11 20:23:11 D [afr.c:6425:init] gfs-ds-afr: (default) reads will be scheduled between the children<br>
2008-11-11 20:23:11 D [afr.c:6309:notify] gfs-ds-afr: GF_EVENT_CHILD_UP from gfs-ds-locks<br>
2008-11-11 20:23:11 D [afr.c:6241:afr_check_xattr_cbk] gfs-ds-afr: 'gfs-ds-locks' supports Extended attribute<br>
2008-11-11 20:23:11 D [client-protocol.c:4653:notify] gfs-remote-ds: got GF_EVENT_PARENT_UP, attempting connect on transport<br>
2008-11-11 20:23:11 D [io-threads.c:1229:init] io-threads: Using conf->thread_count = 8<br>
2008-11-11 20:23:11 D [io-threads.c:1262:init] io-threads: Using conf->cache_size = -5192566377910632448<br>
2008-11-11 20:23:11 D [client-protocol.c:4126:client_protocol_reconnect] gfs-remote-ds: attempting reconnect<br>
2008-11-11 20:23:11 D [common-utils.c:215:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a><br>
2008-11-11 20:23:11 D [common-utils.c:252:gf_resolve_ip6] resolver: returning ip-192.168.0.145 (port-6996) for hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a> and port: 6996<br>
2008-11-11 20:23:11 E [socket.c:708:socket_connect_finish] gfs-remote-ds: connection failed (Connection refused)<br>
2008-11-11 20:23:11 D [socket.c:183:__socket_disconnect] gfs-remote-ds: shutdown() returned -1. setting connection state to -1<br>
2008-11-11 20:23:11 D [client-protocol.c:4153:protocol_client_cleanup] gfs-remote-ds: cleaning up state in transport object 0xb7f41608<br>
2008-11-11 20:23:11 D [client-protocol.c:4179:protocol_client_cleanup] gfs-remote-ds: priv->timer is NULL!!!!<br>
2008-11-11 20:23:11 W [socket.c:93:__socket_rwv] gfs-remote-ds: EOF from peer<br>
2008-11-11 20:23:11 D [socket.c:568:socket_proto_state_machine] gfs-remote-ds: socket read failed (Transport endpoint is not connected) in state 1 ()<br>
2008-11-11 20:23:11 D [client-protocol.c:4153:protocol_client_cleanup] gfs-remote-ds: cleaning up state in transport object 0xb7f41608<br>
2008-11-11 20:23:11 D [client-protocol.c:4179:protocol_client_cleanup] gfs-remote-ds: priv->timer is NULL!!!!<br>
2008-11-11 20:23:12 D [client-protocol.c:4126:client_protocol_reconnect] gfs-remote-ds: attempting reconnect<br>
2008-11-11 20:23:12 D [common-utils.c:208:gf_resolve_ip6] resolver: flushing DNS cache<br>
2008-11-11 20:23:12 D [common-utils.c:215:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a><br>
2008-11-11 20:23:12 D [common-utils.c:252:gf_resolve_ip6] resolver: returning ip-192.168.0.145 (port-6996) for hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a> and port: 6996<br>
2008-11-11 20:23:12 D [socket.c:183:__socket_disconnect] gfs-remote-ds: shutdown() returned -1. setting connection state to -1<br>
2008-11-11 20:23:12 D [client-protocol.c:4153:protocol_client_cleanup] gfs-remote-ds: cleaning up state in transport object 0xb7f41608<br>
2008-11-11 20:23:12 D [client-protocol.c:4179:protocol_client_cleanup] gfs-remote-ds: priv->timer is NULL!!!!<br>
2008-11-11 20:23:12 W [socket.c:93:__socket_rwv] gfs-remote-ds: EOF from peer<br>
2008-11-11 20:23:12 D [socket.c:568:socket_proto_state_machine] gfs-remote-ds: socket read failed (Transport endpoint is not connected) in state 1 ()<br>
2008-11-11 20:23:12 D [client-protocol.c:4153:protocol_client_cleanup] gfs-remote-ds: cleaning up state in transport object 0xb7f41608<br>
2008-11-11 20:23:12 D [client-protocol.c:4179:protocol_client_cleanup] gfs-remote-ds: priv->timer is NULL!!!!<br>
2008-11-11 20:23:14 W [socket.c:93:__socket_rwv] server: EOF from peer <a href="http://192.168.0.144:1023" target="_blank">192.168.0.144:1023</a><br>
2008-11-11 20:23:14 D [socket.c:568:socket_proto_state_machine] server: socket read failed (Transport endpoint is not connected) in state 1 (<a href="http://192.168.0.144:1023" target="_blank">192.168.0.144:1023</a>)<br>
2008-11-11 20:23:14 D [server-protocol.c:6182:server_protocol_cleanup] server: cleaned up transport state for client <a href="http://192.168.0.144:1023" target="_blank">192.168.0.144:1023</a><br>
2008-11-11 20:23:14 D [socket.c:1287:fini] server: transport 0xb7f44a50 destroyed<br>
2008-11-11 20:23:14 D [client-protocol.c:4126:client_protocol_reconnect] gfs-remote-ds: attempting reconnect<br>
2008-11-11 20:23:14 D [common-utils.c:208:gf_resolve_ip6] resolver: flushing DNS cache<br>
2008-11-11 20:23:14 D [common-utils.c:215:gf_resolve_ip6] resolver: DNS cache not present, freshly probing hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a><br>
2008-11-11 20:23:14 D [common-utils.c:252:gf_resolve_ip6] resolver: returning ip-192.168.0.145 (port-6996) for hostname: <a href="http://192.168.0.145" target="_blank">192.168.0.145</a> and port: 6996<br>
2008-11-11 20:23:14 D [socket.c:183:__socket_disconnect] gfs-remote-ds: shutdown() returned -1. setting connection state to -1<br>
2008-11-11 20:23:14 D [client-protocol.c:4153:protocol_client_cleanup] gfs-remote-ds: cleaning up state in transport object 0xb7f41608<br>
^C<br>
mail ~ #<br>
----<br>
<br>
<br>
Does any one know what the problem is or how to fix that?<br>
<br>
<br>
// Steve<br>
--<br>
GMX Download-Spiele: Preizsturz! Alle Puzzle-Spiele Deluxe über 60% billiger.<br>
<a href="http://games.entertainment.gmx.net/de/entertainment/games/download/puzzle/index.html" target="_blank">http://games.entertainment.gmx.net/de/entertainment/games/download/puzzle/index.html</a><br>
<br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@nongnu.org">Gluster-devel@nongnu.org</a><br>
<a href="http://lists.nongnu.org/mailman/listinfo/gluster-devel" target="_blank">http://lists.nongnu.org/mailman/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><br>-- <br>hard work often pays off after time, but laziness always pays off now<br>