<div class="gmail_quote"><div>Hi Konstantin,<br> Can you check with latest git now?<br><br>Regards,<br><br><br></div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div><div class="h5"><div class="gmail_quote">On Fri, Mar 20, 2009 at 7:25 PM, Konstantin A. Lepikhov <span dir="ltr"><<a href="mailto:lakostis@unsafe.ru" target="_blank">lakostis@unsafe.ru</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Greetins!<br>
<br>
Latest 2.0.0git have problems with afr:<br>
<br>
I have 2 nodes with shared storage, both operate as client and server. On<br>
shared storage located webapp synced from git. When I try to pull upstream<br>
changes to that webapp glusterfs got sig 11. Simple git status got the<br>
same results. I haven't this problem on 1.3 version of glusterfs but<br>
it was terribly slow.<br>
<br>
This error reproducible on both nodes and even with cluster/replicate.<br>
<br>
glusterfs.log:<br>
<br>
Version : glusterfs 2.0.0git built on Mar 19 2009 20:01:13<br>
TLA Revision : git://<a href="http://git.sv.gnu.org/gluster.git" target="_blank">git.sv.gnu.org/gluster.git</a><br>
Starting Time: 2009-03-20 03:28:54<br>
Command line : glusterfs -f /etc/glusterfs/afr-client-new.vol<br>
--volume-name forum-cache /exports/forum<br>
PID : 19819<br>
System name : Linux<br>
Nodename : aabb<br>
Kernel Release : 2.6.26-ovz-smp-alt0.3<br>
Hardware Identifier: i686<br>
<br>
Given volfile:<br>
+------------------------------------------------------------------------------+<br>
1: volume aabb<br>
2: type protocol/client<br>
3: option transport-type tcp<br>
4: option transport-timeout 10<br>
5: option remote-host 127.0.0.1<br>
6: option remote-subvolume iot<br>
7: end-volume<br>
8:<br>
9: volume xxyy<br>
10: type protocol/client<br>
11: option transport-type tcp<br>
12: option transport-timeout 30<br>
13: option remote-host <some remote ip><br>
14: option remote-subvolume iot<br>
15: end-volume<br>
16:<br>
17: volume forum-afr<br>
18: #type cluster/replicate<br>
19: type cluster/distribute<br>
20: subvolumes aabb xxyy<br>
21: end-volume<br>
22:<br>
23: volume writebehind<br>
24: type performance/write-behind<br>
25: option aggregate-size 128KB<br>
26: option window-size 1MB<br>
27: subvolumes forum-afr<br>
28: end-volume<br>
29:<br>
30: volume forum-cache<br>
31: type performance/io-cache<br>
32: option cache-size 128MB<br>
33: subvolumes writebehind<br>
34: end-volume<br>
<br>
+------------------------------------------------------------------------------+<br>
2009-03-20 03:28:54 W [xlator.c:430:validate_xlator_volume_options]<br>
writebehind: option 'window-size' is deprecated, preferred is<br>
'cache-size', continuing with correction<br>
2009-03-20 03:28:54 W [xlator.c:430:validate_xlator_volume_options]<br>
writebehind: option 'aggregate-size' is deprecated, preferred is<br>
'block-size', continuing with correction<br>
2009-03-20 03:28:54 N [glusterfsd.c:1134:main] glusterfs: Successfully<br>
started<br>
2009-03-20 03:28:54 N [client-protocol.c:6159:client_setvolume_cbk]<br>
aabb: connection and handshake succeeded<br>
2009-03-20 03:28:54 N [client-protocol.c:6159:client_setvolume_cbk]<br>
aabb: connection and handshake succeeded<br>
2009-03-20 03:28:54 W [dht-common.c:114:dht_lookup_dir_cbk] forum-afr:<br>
lookup of / on xxyy returned error (Transport endpoint is not<br>
connected)<br>
2009-03-20 03:28:54 E [dht-layout.c:486:dht_layout_normalize] forum-afr:<br>
found anomalies in /. holes=1 overlaps=0<br>
2009-03-20 03:28:54 W [dht-common.c:152:dht_lookup_dir_cbk] forum-afr:<br>
fixing assignment on /<br>
2009-03-20 03:28:54 E [dht-selfheal.c:424:dht_selfheal_directory]<br>
forum-afr: 1 subvolumes down -- not fixing<br>
2009-03-20 03:28:54 N [client-protocol.c:6159:client_setvolume_cbk]<br>
xxyy: connection and handshake succeeded<br>
2009-03-20 03:28:54 N [client-protocol.c:6159:client_setvolume_cbk]<br>
xxyy: connection and handshake succeeded<br>
2009-03-20 03:29:01 W [dht-common.c:670:dht_lookup] forum-afr: incomplete<br>
layout failure for path=/<br>
2009-03-20 03:29:01 W [fuse-bridge.c:301:need_fresh_lookup] fuse-bridge:<br>
revalidate of / failed (Resource temporarily unavailable)<br>
pending frames:<br>
frame : type(1) op(FLUSH)<br>
frame : type(1) op(FLUSH)<br>
<br>
patchset: git://<a href="http://git.sv.gnu.org/gluster.git" target="_blank">git.sv.gnu.org/gluster.git</a><br>
signal received: 11<br>
configuration details:argp 1<br>
backtrace 1<br>
bdb->cursor->get 1<br>
db.h 1<br>
dlfcn 1<br>
fdatasync 1<br>
libpthread 1<br>
llistxattr 1<br>
setfsid 1<br>
spinlock 1<br>
epoll.h 1<br>
xattr.h 1<br>
st_atim.tv_nsec 1<br>
package-string: glusterfs 2.0.0git<br>
/lib/libc.so.6[0xb7e1c708]<br>
/usr/lib/glusterfs/2.0.0git/xlator/performance/write-behind.so(wb_do_ops+0x3e)[0xb7d7345e]<br>
/usr/lib/glusterfs/2.0.0git/xlator/performance/write-behind.so(wb_process_queue+0xcb)[0xb7d7354b]<br>
/usr/lib/glusterfs/2.0.0git/xlator/performance/write-behind.so(wb_flush+0x160)[0xb7d73980]<br>
/usr/lib/libglusterfs.so.0(default_flush+0x9b)[0xb7f712fb]<br>
/usr/lib/glusterfs/2.0.0git/xlator/mount/fuse.so[0xb7d59a51]<br>
/usr/lib/libfuse.so.2[0xb7d47901]<br>
/usr/lib/libfuse.so.2[0xb7d463e9]<br>
/usr/lib/libfuse.so.2(fuse_session_process+0x26)[0xb7d48f46]<br>
/usr/lib/glusterfs/2.0.0git/xlator/mount/fuse.so[0xb7d5fcfe]<br>
/lib/libpthread.so.0[0xb7f4adaa]<br>
/lib/libc.so.6(clone+0x5e)[0xb7ebef4e]<br>
---------<br>
<br>
glusterfsd.log:<br>
<br>
================================================================================<br>
Version : glusterfs 2.0.0git built on Mar 19 2009 20:01:13<br>
TLA Revision : git://<a href="http://git.sv.gnu.org/gluster.git" target="_blank">git.sv.gnu.org/gluster.git</a><br>
Starting Time: 2009-03-20 03:20:31<br>
Command line : /usr/sbin/glusterfsd -p /var/run/glusterfsd.pid -f<br>
/etc/glusterfs/afr-server-new.vol<br>
PID : 18819<br>
System name : Linux<br>
Nodename : aabb<br>
Kernel Release : 2.6.26-ovz-smp-alt0.3<br>
Hardware Identifier: i686<br>
<br>
Given volfile:<br>
+------------------------------------------------------------------------------+<br>
1: volume posix<br>
2: type storage/posix<br>
3: option directory /var/lib/vz/storage/forum<br>
4: end-volume<br>
5:<br>
6: volume forum-files<br>
7: type features/locks<br>
8: subvolumes posix<br>
9: end-volume<br>
10:<br>
11: volume iot<br>
12: type performance/io-threads<br>
13: option thread-count 4<br>
14: subvolumes forum-files<br>
15: end-volume<br>
16:<br>
17: volume server<br>
18: type protocol/server<br>
19: option transport-type tcp<br>
20: option transport.socket.listen-port 6996<br>
21: subvolumes iot<br>
22: option auth.addr.iot.allow *<br>
23: end-volume<br>
<br>
+------------------------------------------------------------------------------+<br>
2009-03-20 03:20:31 N [glusterfsd.c:1134:main] glusterfs: Successfully started<br>
2009-03-20 03:20:32 N [server-protocol.c:7513:mop_setvolume] server: accepted client from xxyy:1023<br>
2009-03-20 03:20:35 N [server-protocol.c:7513:mop_setvolume] server: accepted client from xxyy:1022<br>
2009-03-20 03:20:35 N [server-protocol.c:7513:mop_setvolume] server: accepted client from <a href="http://127.0.0.1:1023" target="_blank">127.0.0.1:1023</a><br>
2009-03-20 03:20:35 N [server-protocol.c:7513:mop_setvolume] server: accepted client from <a href="http://127.0.0.1:1022" target="_blank">127.0.0.1:1022</a><br>
2009-03-20 03:24:51 E [posix.c:758:posix_mknod] posix: mknod on /html/upload/config.php: File exists<br>
2009-03-20 03:28:35 N [server-protocol.c:8268:notify] server: <a href="http://127.0.0.1:1023" target="_blank">127.0.0.1:1023</a> disconnected<br>
2009-03-20 03:28:35 N [server-protocol.c:8268:notify] server: <a href="http://127.0.0.1:1022" target="_blank">127.0.0.1:1022</a> disconnected<br>
2009-03-20 03:28:35 N [server-helpers.c:530:server_connection_destroy] server: destroyed connection of aabb-18718-2009/03/20-03:16:25:432103-altlinux<br>
2009-03-20 03:28:54 N [server-protocol.c:7513:mop_setvolume] server: accepted client from <a href="http://127.0.0.1:1021" target="_blank">127.0.0.1:1021</a><br>
2009-03-20 03:28:54 N [server-protocol.c:7513:mop_setvolume] server: accepted client from <a href="http://127.0.0.1:1020" target="_blank">127.0.0.1:1020</a><br>
<font color="#888888"><br>
--<br>
WBR et al.<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
</font></blockquote></div><br>
</div></div><br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Amar Tumballi<br><br>